Apr 13 16:13:50 user devstack@n-api.service[62052]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Apr 13 16:13:50 user devstack@n-api.service[62052]: *** Starting uWSGI 2.0.20-debian (64bit) on [Thu Apr 13 16:13:50 2023] *** Apr 13 16:13:50 user devstack@n-api.service[62052]: compiled with version: 11.2.0 on 21 March 2022 11:00:44 Apr 13 16:13:50 user devstack@n-api.service[62052]: os: Linux-5.15.0-67-generic #74-Ubuntu SMP Wed Feb 22 14:14:39 UTC 2023 Apr 13 16:13:50 user devstack@n-api.service[62052]: nodename: user Apr 13 16:13:50 user devstack@n-api.service[62052]: machine: x86_64 Apr 13 16:13:50 user devstack@n-api.service[62052]: clock source: unix Apr 13 16:13:50 user devstack@n-api.service[62052]: pcre jit disabled Apr 13 16:13:50 user devstack@n-api.service[62052]: detected number of CPU cores: 12 Apr 13 16:13:50 user devstack@n-api.service[62052]: current working directory: / Apr 13 16:13:50 user devstack@n-api.service[62052]: detected binary path: /usr/bin/uwsgi-core Apr 13 16:13:50 user devstack@n-api.service[62052]: your processes number limit is 63637 Apr 13 16:13:50 user devstack@n-api.service[62052]: your memory page size is 4096 bytes Apr 13 16:13:50 user devstack@n-api.service[62052]: detected max file descriptor number: 2048 Apr 13 16:13:50 user devstack@n-api.service[62052]: lock engine: pthread robust mutexes Apr 13 16:13:50 user devstack@n-api.service[62052]: thunder lock: enabled Apr 13 16:13:50 user devstack@n-api.service[62052]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Apr 13 16:13:50 user devstack@n-api.service[62052]: Python version: 3.10.6 (main, Mar 10 2023, 10:55:28) [GCC 11.3.0] Apr 13 16:13:50 user devstack@n-api.service[62052]: Python main interpreter initialized at 0x55564307e990 Apr 13 16:13:50 user devstack@n-api.service[62052]: python threads support enabled Apr 13 16:13:50 user devstack@n-api.service[62052]: your server socket listen backlog is limited to 100 connections Apr 13 16:13:50 user devstack@n-api.service[62052]: your mercy for graceful operations on workers is 90 seconds Apr 13 16:13:50 user devstack@n-api.service[62052]: mapped 537436 bytes (524 KB) for 3 cores Apr 13 16:13:50 user devstack@n-api.service[62052]: *** Operational MODE: preforking *** Apr 13 16:13:50 user devstack@n-api.service[62052]: *** uWSGI is running in multiple interpreter mode *** Apr 13 16:13:50 user devstack@n-api.service[62052]: spawned uWSGI master process (pid: 62052) Apr 13 16:13:50 user devstack@n-api.service[62052]: spawned uWSGI worker 1 (pid: 62053, cores: 1) Apr 13 16:13:50 user devstack@n-api.service[62052]: spawned uWSGI worker 2 (pid: 62054, cores: 1) Apr 13 16:13:50 user devstack@n-api.service[62052]: spawned uWSGI worker 3 (pid: 62055, cores: 1) Apr 13 16:13:50 user devstack@n-api.service[62052]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 13 16:13:51 user devstack@n-api.service[62054]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 13 16:13:51 user devstack@n-api.service[62053]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 13 16:13:51 user devstack@n-api.service[62055]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 13 16:13:55 user devstack@n-api.service[62054]: live_migration_uri is deprecated for removal in favor of two other options that Apr 13 16:13:55 user devstack@n-api.service[62054]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 13 16:13:55 user devstack@n-api.service[62054]: and ``live_migration_inbound_addr`` respectively. Apr 13 16:13:55 user devstack@n-api.service[62054]: ). Its value may be silently ignored in the future. Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 13 16:13:55 user devstack@n-api.service[62055]: live_migration_uri is deprecated for removal in favor of two other options that Apr 13 16:13:55 user devstack@n-api.service[62055]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 13 16:13:55 user devstack@n-api.service[62055]: and ``live_migration_inbound_addr`` respectively. Apr 13 16:13:55 user devstack@n-api.service[62055]: ). Its value may be silently ignored in the future. Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 13 16:13:55 user devstack@n-api.service[62053]: live_migration_uri is deprecated for removal in favor of two other options that Apr 13 16:13:55 user devstack@n-api.service[62053]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 13 16:13:55 user devstack@n-api.service[62053]: and ``live_migration_inbound_addr`` respectively. Apr 13 16:13:55 user devstack@n-api.service[62053]: ). Its value may be silently ignored in the future. Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=62054) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=62055) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: INFO dbcounter [None req-a81d4f47-3085-4094-8747-a328166dc0f1 None None] Registered counter for database nova_api Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG oslo_db.sqlalchemy.engines [None req-a81d4f47-3085-4094-8747-a328166dc0f1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=62054) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writer thread running {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62055]: INFO dbcounter [None req-dc057eae-8234-43f4-868f-71968639532a None None] Registered counter for database nova_api Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=62053) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG oslo_db.sqlalchemy.engines [None req-dc057eae-8234-43f4-868f-71968639532a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=62055) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writer thread running {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG nova.context [None req-a81d4f47-3085-4094-8747-a328166dc0f1 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),32d212d5-26fb-41ef-bcfb-e4b208444da1(cell1) {{(pid=62054) load_cells /opt/stack/nova/nova/context.py:464}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-a81d4f47-3085-4094-8747-a328166dc0f1 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-a81d4f47-3085-4094-8747-a328166dc0f1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-a81d4f47-3085-4094-8747-a328166dc0f1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-a81d4f47-3085-4094-8747-a328166dc0f1 None None] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-a81d4f47-3085-4094-8747-a328166dc0f1 None None] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-a81d4f47-3085-4094-8747-a328166dc0f1 None None] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:13:55 user devstack@n-api.service[62054]: INFO dbcounter [None req-a81d4f47-3085-4094-8747-a328166dc0f1 None None] Registered counter for database nova_cell0 Apr 13 16:13:55 user devstack@n-api.service[62054]: INFO dbcounter [None req-a81d4f47-3085-4094-8747-a328166dc0f1 None None] Registered counter for database nova_cell1 Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG oslo_db.sqlalchemy.engines [None req-a81d4f47-3085-4094-8747-a328166dc0f1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=62054) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writer thread running {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG oslo_db.sqlalchemy.engines [None req-a81d4f47-3085-4094-8747-a328166dc0f1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=62054) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG nova.context [None req-dc057eae-8234-43f4-868f-71968639532a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),32d212d5-26fb-41ef-bcfb-e4b208444da1(cell1) {{(pid=62055) load_cells /opt/stack/nova/nova/context.py:464}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-dc057eae-8234-43f4-868f-71968639532a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-dc057eae-8234-43f4-868f-71968639532a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-dc057eae-8234-43f4-868f-71968639532a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-dc057eae-8234-43f4-868f-71968639532a None None] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-dc057eae-8234-43f4-868f-71968639532a None None] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-dc057eae-8234-43f4-868f-71968639532a None None] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:13:55 user devstack@n-api.service[62055]: INFO dbcounter [None req-dc057eae-8234-43f4-868f-71968639532a None None] Registered counter for database nova_cell0 Apr 13 16:13:55 user devstack@n-api.service[62053]: INFO dbcounter [None req-c410498d-38c2-4bf1-bfe4-78f2f1fc2bcd None None] Registered counter for database nova_api Apr 13 16:13:55 user devstack@n-api.service[62055]: INFO dbcounter [None req-dc057eae-8234-43f4-868f-71968639532a None None] Registered counter for database nova_cell1 Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG oslo_db.sqlalchemy.engines [None req-dc057eae-8234-43f4-868f-71968639532a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=62055) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writer thread running {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG oslo_db.sqlalchemy.engines [None req-dc057eae-8234-43f4-868f-71968639532a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=62055) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG oslo_db.sqlalchemy.engines [None req-c410498d-38c2-4bf1-bfe4-78f2f1fc2bcd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=62053) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writer thread running {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG nova.context [None req-c410498d-38c2-4bf1-bfe4-78f2f1fc2bcd None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),32d212d5-26fb-41ef-bcfb-e4b208444da1(cell1) {{(pid=62053) load_cells /opt/stack/nova/nova/context.py:464}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-c410498d-38c2-4bf1-bfe4-78f2f1fc2bcd None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-c410498d-38c2-4bf1-bfe4-78f2f1fc2bcd None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-c410498d-38c2-4bf1-bfe4-78f2f1fc2bcd None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-c410498d-38c2-4bf1-bfe4-78f2f1fc2bcd None None] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-c410498d-38c2-4bf1-bfe4-78f2f1fc2bcd None None] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-c410498d-38c2-4bf1-bfe4-78f2f1fc2bcd None None] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:13:55 user devstack@n-api.service[62053]: INFO dbcounter [None req-c410498d-38c2-4bf1-bfe4-78f2f1fc2bcd None None] Registered counter for database nova_cell0 Apr 13 16:13:55 user devstack@n-api.service[62053]: INFO dbcounter [None req-c410498d-38c2-4bf1-bfe4-78f2f1fc2bcd None None] Registered counter for database nova_cell1 Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG oslo_db.sqlalchemy.engines [None req-c410498d-38c2-4bf1-bfe4-78f2f1fc2bcd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=62053) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writer thread running {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writer thread running {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG oslo_db.sqlalchemy.engines [None req-c410498d-38c2-4bf1-bfe4-78f2f1fc2bcd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=62053) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 13 16:13:55 user devstack@n-api.service[62054]: INFO dbcounter [None req-a81d4f47-3085-4094-8747-a328166dc0f1 None None] Registered counter for database nova_cell0 Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG oslo_db.sqlalchemy.engines [None req-a81d4f47-3085-4094-8747-a328166dc0f1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=62054) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 13 16:13:55 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writer thread running {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writer thread running {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 13 16:13:55 user devstack@n-api.service[62055]: INFO dbcounter [None req-dc057eae-8234-43f4-868f-71968639532a None None] Registered counter for database nova_cell0 Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG oslo_db.sqlalchemy.engines [None req-dc057eae-8234-43f4-868f-71968639532a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=62055) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 13 16:13:55 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writer thread running {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writer thread running {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 13 16:13:55 user devstack@n-api.service[62053]: INFO dbcounter [None req-c410498d-38c2-4bf1-bfe4-78f2f1fc2bcd None None] Registered counter for database nova_cell0 Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG oslo_db.sqlalchemy.engines [None req-c410498d-38c2-4bf1-bfe4-78f2f1fc2bcd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=62053) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 13 16:13:55 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writer thread running {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 13 16:13:55 user devstack@n-api.service[62054]: WARNING keystonemiddleware.auth_token [None req-a81d4f47-3085-4094-8747-a328166dc0f1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 13 16:13:55 user devstack@n-api.service[62054]: WARNING keystonemiddleware.auth_token [None req-a81d4f47-3085-4094-8747-a328166dc0f1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 13 16:13:55 user devstack@n-api.service[62055]: WARNING keystonemiddleware.auth_token [None req-dc057eae-8234-43f4-868f-71968639532a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 13 16:13:55 user devstack@n-api.service[62055]: WARNING keystonemiddleware.auth_token [None req-dc057eae-8234-43f4-868f-71968639532a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 13 16:13:56 user devstack@n-api.service[62053]: WARNING keystonemiddleware.auth_token [None req-c410498d-38c2-4bf1-bfe4-78f2f1fc2bcd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 13 16:13:56 user devstack@n-api.service[62053]: WARNING keystonemiddleware.auth_token [None req-c410498d-38c2-4bf1-bfe4-78f2f1fc2bcd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 13 16:13:56 user devstack@n-api.service[62054]: WARNING keystonemiddleware.auth_token [None req-a81d4f47-3085-4094-8747-a328166dc0f1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 13 16:13:56 user devstack@n-api.service[62054]: WARNING keystonemiddleware.auth_token [None req-a81d4f47-3085-4094-8747-a328166dc0f1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 13 16:13:56 user devstack@n-api.service[62054]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55564307e990 pid: 62054 (default app) Apr 13 16:13:56 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-a81d4f47-3085-4094-8747-a328166dc0f1 None None] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:13:56 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-a81d4f47-3085-4094-8747-a328166dc0f1 None None] 10.0.0.210 "GET /compute/v2.1/" status: 200 len: 387 microversion: 2.1 time: 0.001497 Apr 13 16:13:56 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 1/1] 10.0.0.210 () {50 vars in 783 bytes} [Thu Apr 13 16:13:56 2023] GET /compute/v2.1/ => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:13:56 user devstack@n-api.service[62055]: WARNING keystonemiddleware.auth_token [None req-dc057eae-8234-43f4-868f-71968639532a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 13 16:13:56 user devstack@n-api.service[62055]: WARNING keystonemiddleware.auth_token [None req-dc057eae-8234-43f4-868f-71968639532a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 13 16:13:56 user devstack@n-api.service[62055]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55564307e990 pid: 62055 (default app) Apr 13 16:13:56 user devstack@n-api.service[62053]: WARNING keystonemiddleware.auth_token [None req-c410498d-38c2-4bf1-bfe4-78f2f1fc2bcd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 13 16:13:56 user devstack@n-api.service[62053]: WARNING keystonemiddleware.auth_token [None req-c410498d-38c2-4bf1-bfe4-78f2f1fc2bcd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 13 16:13:56 user devstack@n-api.service[62053]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55564307e990 pid: 62053 (default app) Apr 13 16:16:05 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-a81d4f47-3085-4094-8747-a328166dc0f1 None None] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:16:05 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-a81d4f47-3085-4094-8747-a328166dc0f1 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001648 Apr 13 16:16:05 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 2/2] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 13 16:16:05 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:16:05 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_api:SELECT=3 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:16:05 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_cell0:SELECT=3 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:16:05 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_cell1:SELECT=3 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:16:05 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_cell0:SELECT=3 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:16:05 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-b973f2c1-fb26-438b-8d5a-ebb141481b46 admin admin] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:16:05 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-b973f2c1-fb26-438b-8d5a-ebb141481b46 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.377410 Apr 13 16:16:05 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 1/3] 10.0.0.210 () {60 vars in 1285 bytes} [Thu Apr 13 16:16:05 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:16:07 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-c410498d-38c2-4bf1-bfe4-78f2f1fc2bcd None None] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:16:07 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-c410498d-38c2-4bf1-bfe4-78f2f1fc2bcd None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002219 Apr 13 16:16:07 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 1/4] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 13 16:16:07 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:16:07 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_api:SELECT=3 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:16:07 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_cell0:SELECT=3 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:16:07 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_cell1:SELECT=3 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:16:07 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:16:07 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-90c4a73d-9f4a-47b6-a515-dca57d24d533 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 1, "name": "cirros256", "ram": 256, "disk": 1}} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:16:07 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-90c4a73d-9f4a-47b6-a515-dca57d24d533 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.309500 Apr 13 16:16:07 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 3/5] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 13 16:16:07 2023] POST /compute/v2.1/flavors => generated 405 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 16:16:07 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-40934588-3093-4899-a803-49d3a30f4e72 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:16:07 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-40934588-3093-4899-a803-49d3a30f4e72 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.049787 Apr 13 16:16:07 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 2/6] 10.0.0.210 () {64 vars in 1329 bytes} [Thu Apr 13 16:16:07 2023] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:16:09 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-c410498d-38c2-4bf1-bfe4-78f2f1fc2bcd None None] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:16:09 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-c410498d-38c2-4bf1-bfe4-78f2f1fc2bcd None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001532 Apr 13 16:16:09 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 2/7] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 13 16:16:09 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:16:09 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-bac19f42-90c7-4b9f-9527-e3aeb424f8ee admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1", "rxtx_factor": 1.0, "name": "ds512M", "disk": 5, "ram": 512, "os-flavor-access:is_public": true, "vcpus": 1}} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:16:09 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-bac19f42-90c7-4b9f-9527-e3aeb424f8ee admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.102505 Apr 13 16:16:09 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 4/8] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 13 16:16:09 2023] POST /compute/v2.1/flavors => generated 402 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 16:16:09 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-9c2c5b17-1b3a-4d22-900b-983280e5da3b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:16:09 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-9c2c5b17-1b3a-4d22-900b-983280e5da3b admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025954 Apr 13 16:16:09 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 3/9] 10.0.0.210 () {64 vars in 1329 bytes} [Thu Apr 13 16:16:09 2023] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:16:11 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-c410498d-38c2-4bf1-bfe4-78f2f1fc2bcd None None] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:16:11 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-c410498d-38c2-4bf1-bfe4-78f2f1fc2bcd None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002127 Apr 13 16:16:11 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 3/10] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 13 16:16:11 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:16:11 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-e0fb6327-94a3-4463-8a0b-992e0213204b admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "disk": 10, "id": "d2", "ram": 1024, "vcpus": 1, "name": "ds1G"}} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:16:11 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-e0fb6327-94a3-4463-8a0b-992e0213204b admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.057922 Apr 13 16:16:11 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 5/11] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 13 16:16:11 2023] POST /compute/v2.1/flavors => generated 402 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 16:16:11 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-9258a39c-812b-4e83-9272-56c52c4dcd72 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:16:11 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-9258a39c-812b-4e83-9272-56c52c4dcd72 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029055 Apr 13 16:16:11 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 4/12] 10.0.0.210 () {64 vars in 1329 bytes} [Thu Apr 13 16:16:11 2023] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:16:13 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-c410498d-38c2-4bf1-bfe4-78f2f1fc2bcd None None] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:16:13 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-c410498d-38c2-4bf1-bfe4-78f2f1fc2bcd None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001461 Apr 13 16:16:13 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 4/13] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 13 16:16:13 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:16:13 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-4115f31e-db0f-4d5d-9906-f01685a0a65e admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "d3", "rxtx_factor": 1.0, "name": "ds2G", "vcpus": 2, "ram": 2048, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:16:13 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-4115f31e-db0f-4d5d-9906-f01685a0a65e admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.058875 Apr 13 16:16:13 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 6/14] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 13 16:16:13 2023] POST /compute/v2.1/flavors => generated 402 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 16:16:13 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-3c75c9c1-a40d-4d77-aa37-289c59833ee1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:16:13 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-3c75c9c1-a40d-4d77-aa37-289c59833ee1 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.023993 Apr 13 16:16:13 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 5/15] 10.0.0.210 () {64 vars in 1329 bytes} [Thu Apr 13 16:16:13 2023] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:16:15 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-c410498d-38c2-4bf1-bfe4-78f2f1fc2bcd None None] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:16:15 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-c410498d-38c2-4bf1-bfe4-78f2f1fc2bcd None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001610 Apr 13 16:16:15 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 5/16] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 13 16:16:15 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 16:16:15 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-bb956b4c-2a8c-4e37-b67c-9e1238d284ee admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "os-flavor-access:is_public": true, "swap": 0, "id": "d4", "vcpus": 4, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 20}} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:16:15 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-bb956b4c-2a8c-4e37-b67c-9e1238d284ee admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.070218 Apr 13 16:16:15 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 7/17] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 13 16:16:15 2023] POST /compute/v2.1/flavors => generated 402 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 16:16:15 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-01816f59-1f3b-4932-8311-126fff41bd59 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:16:15 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-01816f59-1f3b-4932-8311-126fff41bd59 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025098 Apr 13 16:16:15 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 6/18] 10.0.0.210 () {64 vars in 1329 bytes} [Thu Apr 13 16:16:15 2023] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:16:17 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-c410498d-38c2-4bf1-bfe4-78f2f1fc2bcd None None] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:16:17 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-c410498d-38c2-4bf1-bfe4-78f2f1fc2bcd None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001611 Apr 13 16:16:17 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 6/19] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 13 16:16:17 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:16:17 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-a2c10db3-25ce-420e-b82e-a7b2bc48d114 admin admin] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:16:17 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-a2c10db3-25ce-420e-b82e-a7b2bc48d114 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2096 microversion: 2.61 time: 0.066961 Apr 13 16:16:17 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 8/20] 10.0.0.210 () {60 vars in 1285 bytes} [Thu Apr 13 16:16:17 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 2096 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 16:16:19 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-01816f59-1f3b-4932-8311-126fff41bd59 admin admin] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:16:19 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-01816f59-1f3b-4932-8311-126fff41bd59 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002300 Apr 13 16:16:19 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 7/21] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 13 16:16:19 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:16:19 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_api:SELECT=3 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:16:19 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_cell1:SELECT=3 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:16:19 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_cell0:SELECT=3 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:16:19 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_cell0:SELECT=3 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:16:20 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-d4e5b680-a6b2-4f7f-876a-0b0addbe1701 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny", "swap": 0, "rxtx_factor": 1.0, "id": "1", "vcpus": 1, "os-flavor-access:is_public": true}} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:16:20 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-d4e5b680-a6b2-4f7f-876a-0b0addbe1701 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 400 microversion: 2.61 time: 0.333744 Apr 13 16:16:20 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 7/22] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 13 16:16:19 2023] POST /compute/v2.1/flavors => generated 400 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 16:16:20 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-b81acb95-8a98-4b85-a07d-3c78b6ad8b33 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:16:20 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-b81acb95-8a98-4b85-a07d-3c78b6ad8b33 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037729 Apr 13 16:16:20 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 9/23] 10.0.0.210 () {64 vars in 1326 bytes} [Thu Apr 13 16:16:20 2023] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:16:22 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-01816f59-1f3b-4932-8311-126fff41bd59 admin admin] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:16:22 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-01816f59-1f3b-4932-8311-126fff41bd59 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001335 Apr 13 16:16:22 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 8/24] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 13 16:16:22 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:16:22 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-23bd22e2-741e-42e5-bd99-02fe2a76d739 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "m1.small", "swap": 0, "id": "2", "ram": 2048, "disk": 20, "os-flavor-access:is_public": true, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:16:22 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-23bd22e2-741e-42e5-bd99-02fe2a76d739 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.063419 Apr 13 16:16:22 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 8/25] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 13 16:16:22 2023] POST /compute/v2.1/flavors => generated 403 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 16:16:22 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-2acae8e2-b7ec-4de5-b9b6-a66b362c53bd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:16:22 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-2acae8e2-b7ec-4de5-b9b6-a66b362c53bd admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030687 Apr 13 16:16:22 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 10/26] 10.0.0.210 () {64 vars in 1326 bytes} [Thu Apr 13 16:16:22 2023] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:16:24 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-01816f59-1f3b-4932-8311-126fff41bd59 admin admin] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:16:24 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-01816f59-1f3b-4932-8311-126fff41bd59 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001396 Apr 13 16:16:24 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 9/27] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 13 16:16:24 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:16:24 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-f7fc789e-faea-494c-93cd-17bf86f5a0f3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "vcpus": 2, "rxtx_factor": 1.0, "swap": 0, "name": "m1.medium", "disk": 40, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096}} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:16:24 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-f7fc789e-faea-494c-93cd-17bf86f5a0f3 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.066104 Apr 13 16:16:24 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 9/28] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 13 16:16:24 2023] POST /compute/v2.1/flavors => generated 404 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 16:16:24 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-f92e356e-4a61-4a05-bd8d-0dc2a976ce2f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:16:24 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-f92e356e-4a61-4a05-bd8d-0dc2a976ce2f admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.024197 Apr 13 16:16:24 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 11/29] 10.0.0.210 () {64 vars in 1326 bytes} [Thu Apr 13 16:16:24 2023] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:16:26 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-01816f59-1f3b-4932-8311-126fff41bd59 admin admin] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:16:26 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-01816f59-1f3b-4932-8311-126fff41bd59 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001512 Apr 13 16:16:26 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 10/30] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 13 16:16:26 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:16:26 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-5af88e1a-6319-4532-8138-23f076ff33c5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 4, "disk": 80, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "4", "ram": 8192, "os-flavor-access:is_public": true, "name": "m1.large"}} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:16:26 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-5af88e1a-6319-4532-8138-23f076ff33c5 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.080886 Apr 13 16:16:26 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 10/31] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 13 16:16:26 2023] POST /compute/v2.1/flavors => generated 403 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 16:16:26 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-430544b6-6edc-43ba-a4ff-37784d69bf5d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:16:26 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-430544b6-6edc-43ba-a4ff-37784d69bf5d admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025375 Apr 13 16:16:26 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 12/32] 10.0.0.210 () {64 vars in 1326 bytes} [Thu Apr 13 16:16:26 2023] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:16:28 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-01816f59-1f3b-4932-8311-126fff41bd59 admin admin] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:16:28 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-01816f59-1f3b-4932-8311-126fff41bd59 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001623 Apr 13 16:16:28 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 11/33] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 13 16:16:28 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:16:28 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-b6fa7531-1781-41b1-8457-8013d1e0fc54 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "rxtx_factor": 1.0, "id": "5", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "m1.xlarge", "os-flavor-access:is_public": true, "vcpus": 8, "disk": 160}} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:16:28 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-b6fa7531-1781-41b1-8457-8013d1e0fc54 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.065098 Apr 13 16:16:28 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 11/34] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 13 16:16:28 2023] POST /compute/v2.1/flavors => generated 406 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 16:16:28 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-0a73a6cd-fae7-43f7-8a64-75f65117c74c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:16:28 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-0a73a6cd-fae7-43f7-8a64-75f65117c74c admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.023329 Apr 13 16:16:28 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 13/35] 10.0.0.210 () {64 vars in 1326 bytes} [Thu Apr 13 16:16:28 2023] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:17:00 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-01816f59-1f3b-4932-8311-126fff41bd59 admin admin] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:17:00 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-01816f59-1f3b-4932-8311-126fff41bd59 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002202 Apr 13 16:17:00 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 12/36] 10.0.0.210 () {58 vars in 1006 bytes} [Thu Apr 13 16:17:00 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:17:00 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=5 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:17:00 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-adfdcd7b-cf5e-40a5-a23e-d7274c018bc2 admin admin] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:17:00 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-adfdcd7b-cf5e-40a5-a23e-d7274c018bc2 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:17:00 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-adfdcd7b-cf5e-40a5-a23e-d7274c018bc2 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:17:00 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-adfdcd7b-cf5e-40a5-a23e-d7274c018bc2 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:17:00 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-adfdcd7b-cf5e-40a5-a23e-d7274c018bc2 admin admin] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:17:00 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-adfdcd7b-cf5e-40a5-a23e-d7274c018bc2 admin admin] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:17:00 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-adfdcd7b-cf5e-40a5-a23e-d7274c018bc2 admin admin] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:17:00 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-adfdcd7b-cf5e-40a5-a23e-d7274c018bc2 admin admin] 10.0.0.210 "GET /compute/v2.1/os-services?binary=nova-compute&host=user" status: 200 len: 247 microversion: 2.69 time: 0.087980 Apr 13 16:17:00 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 12/37] 10.0.0.210 () {64 vars in 1388 bytes} [Thu Apr 13 16:17:00 2023] GET /compute/v2.1/os-services?binary=nova-compute&host=user => generated 247 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 16:17:32 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-0a73a6cd-fae7-43f7-8a64-75f65117c74c admin admin] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:17:32 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-0a73a6cd-fae7-43f7-8a64-75f65117c74c admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001445 Apr 13 16:17:32 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 14/38] 10.0.0.210 () {58 vars in 1006 bytes} [Thu Apr 13 16:17:32 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:17:32 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_api:SELECT=32,nova_api:SAVEPOINT=5,nova_api:INSERT=5,nova_api:RELEASE=5 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:17:32 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-0a70c09a-f566-46b9-8db2-1d86474dd13e admin admin] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:17:32 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-0a70c09a-f566-46b9-8db2-1d86474dd13e admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4182 microversion: 2.61 time: 0.072999 Apr 13 16:17:32 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 13/39] 10.0.0.210 () {64 vars in 1367 bytes} [Thu Apr 13 16:17:32 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 4182 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 16:17:37 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-adfdcd7b-cf5e-40a5-a23e-d7274c018bc2 admin admin] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:17:37 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-adfdcd7b-cf5e-40a5-a23e-d7274c018bc2 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002071 Apr 13 16:17:37 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 13/40] 10.0.0.210 () {58 vars in 1006 bytes} [Thu Apr 13 16:17:37 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:17:37 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:17:37 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-e39d231d-c18e-4ef5-b302-4b925815db42 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "42", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.nano", "ram": 128, "disk": 1, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:17:37 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-e39d231d-c18e-4ef5-b302-4b925815db42 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.071059 Apr 13 16:17:37 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 15/41] 10.0.0.210 () {68 vars in 1358 bytes} [Thu Apr 13 16:17:37 2023] POST /compute/v2.1/flavors => generated 403 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 16:17:37 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-0bba1205-202e-40fc-b54e-2361238cc7da admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:17:37 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-0bba1205-202e-40fc-b54e-2361238cc7da admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029506 Apr 13 16:17:37 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 14/42] 10.0.0.210 () {68 vars in 1411 bytes} [Thu Apr 13 16:17:37 2023] POST /compute/v2.1/flavors/42/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:17:41 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-adfdcd7b-cf5e-40a5-a23e-d7274c018bc2 admin admin] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:17:41 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-adfdcd7b-cf5e-40a5-a23e-d7274c018bc2 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001704 Apr 13 16:17:41 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 14/43] 10.0.0.210 () {58 vars in 1006 bytes} [Thu Apr 13 16:17:41 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:17:41 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-9972db55-6b34-4092-a935-9004d6e5ea68 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 192, "vcpus": 1, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 1, "id": "84", "name": "m1.micro", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:17:41 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-9972db55-6b34-4092-a935-9004d6e5ea68 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.067157 Apr 13 16:17:41 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 16/44] 10.0.0.210 () {68 vars in 1358 bytes} [Thu Apr 13 16:17:41 2023] POST /compute/v2.1/flavors => generated 404 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 16:17:41 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-3f4a5728-4e71-4e3a-8f22-510be0a8b0c3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:17:41 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-3f4a5728-4e71-4e3a-8f22-510be0a8b0c3 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025374 Apr 13 16:17:41 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 15/45] 10.0.0.210 () {68 vars in 1411 bytes} [Thu Apr 13 16:17:41 2023] POST /compute/v2.1/flavors/84/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:19:55 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_cell0:SELECT=2 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:19:55 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_cell1:SELECT=2 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:19:55 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_api:SELECT=4 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:19:55 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_api:SELECT=6,nova_api:INSERT=2 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:19:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-b3fc025e-06a5-4e3d-a465-bd1ce7ccebc4 tempest-VolumesSnapshotsTestJSON-1604074109 tempest-VolumesSnapshotsTestJSON-1604074109-project-member] Action: 'create', calling method: .version_select at 0x7f96e5897490>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-713538459"}} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:19:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-aed5ada9-e881-4a5a-a0d6-716e2c4812ca tempest-VolumesGetTestJSON-1657551016 tempest-VolumesGetTestJSON-1657551016-project-member] Action: 'create', calling method: .version_select at 0x7f96e58a2c20>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-719241019", "metadata": {"Type": "work"}}} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:19:56 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-b3fc025e-06a5-4e3d-a465-bd1ce7ccebc4 tempest-VolumesSnapshotsTestJSON-1604074109 tempest-VolumesSnapshotsTestJSON-1604074109-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 1.188149 Apr 13 16:19:56 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 17/46] 10.0.0.210 () {64 vars in 1232 bytes} [Thu Apr 13 16:19:55 2023] POST /compute/v2.1/os-volumes => generated 344 bytes in 1192 msecs (HTTP/1.1 200) 10 headers in 447 bytes (1 switches on core 0) Apr 13 16:19:56 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=2,nova_api:RELEASE=2 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:19:56 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-4f58a055-de2a-4238-835f-ab2f39b4e1d5 tempest-VolumesSnapshotsTestJSON-1604074109 tempest-VolumesSnapshotsTestJSON-1604074109-project-member] Calling method '.version_select at 0x7f96e59d3250>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:19:56 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-4f58a055-de2a-4238-835f-ab2f39b4e1d5 tempest-VolumesSnapshotsTestJSON-1604074109 tempest-VolumesSnapshotsTestJSON-1604074109-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/9039b70c-c6f2-47ac-8916-8fda0b51c38e" status: 200 len: 344 microversion: 2.1 time: 0.229864 Apr 13 16:19:56 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 16/47] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 16:19:56 2023] GET /compute/v2.1/os-volumes/9039b70c-c6f2-47ac-8916-8fda0b51c38e => generated 344 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:19:56 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-aed5ada9-e881-4a5a-a0d6-716e2c4812ca tempest-VolumesGetTestJSON-1657551016 tempest-VolumesGetTestJSON-1657551016-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 1.630075 Apr 13 16:19:56 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 15/48] 10.0.0.210 () {64 vars in 1233 bytes} [Thu Apr 13 16:19:55 2023] POST /compute/v2.1/os-volumes => generated 352 bytes in 1632 msecs (HTTP/1.1 200) 10 headers in 447 bytes (1 switches on core 0) Apr 13 16:19:56 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-f80e6001-111a-4f53-a830-c1c50365032e tempest-VolumesGetTestJSON-1657551016 tempest-VolumesGetTestJSON-1657551016-project-member] Calling method '.version_select at 0x7f96e5727910>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:19:57 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-f80e6001-111a-4f53-a830-c1c50365032e tempest-VolumesGetTestJSON-1657551016 tempest-VolumesGetTestJSON-1657551016-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/33ac7ed4-21b7-4a54-a349-0cfa731a7cb4" status: 200 len: 352 microversion: 2.1 time: 0.056783 Apr 13 16:19:57 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 18/49] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 16:19:56 2023] GET /compute/v2.1/os-volumes/33ac7ed4-21b7-4a54-a349-0cfa731a7cb4 => generated 352 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:19:57 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-d089e138-dc29-4d15-b3f6-895296fce73a tempest-VolumesSnapshotsTestJSON-1604074109 tempest-VolumesSnapshotsTestJSON-1604074109-project-member] Calling method '.version_select at 0x7f96e571b1c0>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:19:57 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-d089e138-dc29-4d15-b3f6-895296fce73a tempest-VolumesSnapshotsTestJSON-1604074109 tempest-VolumesSnapshotsTestJSON-1604074109-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/9039b70c-c6f2-47ac-8916-8fda0b51c38e" status: 200 len: 345 microversion: 2.1 time: 0.075156 Apr 13 16:19:57 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 17/50] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 16:19:57 2023] GET /compute/v2.1/os-volumes/9039b70c-c6f2-47ac-8916-8fda0b51c38e => generated 345 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:19:57 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-ad5dabc4-58d5-4b60-89ff-41404ad5a6fd tempest-VolumesSnapshotsTestJSON-1604074109 tempest-VolumesSnapshotsTestJSON-1604074109-project-member] Action: 'create', calling method: .version_select at 0x7f96e57301f0>, body: {"snapshot": {"volume_id": "9039b70c-c6f2-47ac-8916-8fda0b51c38e", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1472734574"}} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:19:58 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-14e3b338-44fc-40fa-a679-148db9beb9d7 tempest-VolumesGetTestJSON-1657551016 tempest-VolumesGetTestJSON-1657551016-project-member] Calling method '.version_select at 0x7f96e5744040>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:19:58 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-14e3b338-44fc-40fa-a679-148db9beb9d7 tempest-VolumesGetTestJSON-1657551016 tempest-VolumesGetTestJSON-1657551016-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/33ac7ed4-21b7-4a54-a349-0cfa731a7cb4" status: 200 len: 353 microversion: 2.1 time: 0.050920 Apr 13 16:19:58 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 19/51] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 16:19:58 2023] GET /compute/v2.1/os-volumes/33ac7ed4-21b7-4a54-a349-0cfa731a7cb4 => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:19:58 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-cb0862e4-bf82-4762-a3ab-94735e80d8d0 tempest-VolumesGetTestJSON-1657551016 tempest-VolumesGetTestJSON-1657551016-project-member] Calling method '.version_select at 0x7f96e571b880>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:19:58 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-ad5dabc4-58d5-4b60-89ff-41404ad5a6fd tempest-VolumesSnapshotsTestJSON-1604074109 tempest-VolumesSnapshotsTestJSON-1604074109-project-member] 10.0.0.210 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.280643 Apr 13 16:19:58 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 16/52] 10.0.0.210 () {64 vars in 1239 bytes} [Thu Apr 13 16:19:57 2023] POST /compute/v2.1/os-snapshots => generated 287 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 16:19:58 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-a391dae6-4f88-487b-8038-21bfc7d587a9 tempest-VolumesSnapshotsTestJSON-1604074109 tempest-VolumesSnapshotsTestJSON-1604074109-project-member] Calling method '.version_select at 0x7f96e5727e20>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:19:58 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-a391dae6-4f88-487b-8038-21bfc7d587a9 tempest-VolumesSnapshotsTestJSON-1604074109 tempest-VolumesSnapshotsTestJSON-1604074109-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/a1f8deca-1413-4537-af05-3933fd3e2968" status: 200 len: 287 microversion: 2.1 time: 0.071300 Apr 13 16:19:58 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 20/53] 10.0.0.210 () {62 vars in 1328 bytes} [Thu Apr 13 16:19:58 2023] GET /compute/v2.1/os-snapshots/a1f8deca-1413-4537-af05-3933fd3e2968 => generated 287 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:19:58 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-133f5c58-6f66-49c1-a482-324302835540 tempest-VolumesSnapshotsTestJSON-1604074109 tempest-VolumesSnapshotsTestJSON-1604074109-project-member] Calling method '.version_select at 0x7f96e57313f0>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:19:58 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-133f5c58-6f66-49c1-a482-324302835540 tempest-VolumesSnapshotsTestJSON-1604074109 tempest-VolumesSnapshotsTestJSON-1604074109-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.049945 Apr 13 16:19:58 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 17/54] 10.0.0.210 () {62 vars in 1217 bytes} [Thu Apr 13 16:19:58 2023] GET /compute/v2.1/os-snapshots => generated 290 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:19:58 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-c609b12a-c6c6-4395-b4d0-5f9e966f7834 tempest-VolumesSnapshotsTestJSON-1604074109 tempest-VolumesSnapshotsTestJSON-1604074109-project-member] Calling method '.version_select at 0x7f96e5744310>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:19:58 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-c609b12a-c6c6-4395-b4d0-5f9e966f7834 tempest-VolumesSnapshotsTestJSON-1604074109 tempest-VolumesSnapshotsTestJSON-1604074109-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/a1f8deca-1413-4537-af05-3933fd3e2968" status: 200 len: 287 microversion: 2.1 time: 0.033644 Apr 13 16:19:58 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 21/55] 10.0.0.210 () {62 vars in 1328 bytes} [Thu Apr 13 16:19:58 2023] GET /compute/v2.1/os-snapshots/a1f8deca-1413-4537-af05-3933fd3e2968 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:19:58 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-cb0862e4-bf82-4762-a3ab-94735e80d8d0 tempest-VolumesGetTestJSON-1657551016 tempest-VolumesGetTestJSON-1657551016-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/33ac7ed4-21b7-4a54-a349-0cfa731a7cb4" status: 200 len: 353 microversion: 2.1 time: 0.256063 Apr 13 16:19:58 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 18/56] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 16:19:58 2023] GET /compute/v2.1/os-volumes/33ac7ed4-21b7-4a54-a349-0cfa731a7cb4 => generated 353 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:19:58 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-4152ff5e-6930-4026-a237-f103c5dcc6c4 tempest-VolumesGetTestJSON-1657551016 tempest-VolumesGetTestJSON-1657551016-project-member] Calling method '.version_select at 0x7f96e5732170>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:19:58 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-4152ff5e-6930-4026-a237-f103c5dcc6c4 tempest-VolumesGetTestJSON-1657551016 tempest-VolumesGetTestJSON-1657551016-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/33ac7ed4-21b7-4a54-a349-0cfa731a7cb4" status: 202 len: 0 microversion: 2.1 time: 0.081705 Apr 13 16:19:58 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 18/57] 10.0.0.210 () {62 vars in 1325 bytes} [Thu Apr 13 16:19:58 2023] DELETE /compute/v2.1/os-volumes/33ac7ed4-21b7-4a54-a349-0cfa731a7cb4 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 16:19:58 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-008559f8-313d-4542-ab7d-aa3d634ceeca tempest-VolumesGetTestJSON-1657551016 tempest-VolumesGetTestJSON-1657551016-project-member] Calling method '.version_select at 0x7f96e5744820>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:19:58 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-008559f8-313d-4542-ab7d-aa3d634ceeca tempest-VolumesGetTestJSON-1657551016 tempest-VolumesGetTestJSON-1657551016-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/33ac7ed4-21b7-4a54-a349-0cfa731a7cb4" status: 200 len: 352 microversion: 2.1 time: 0.071391 Apr 13 16:19:58 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 22/58] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 16:19:58 2023] GET /compute/v2.1/os-volumes/33ac7ed4-21b7-4a54-a349-0cfa731a7cb4 => generated 352 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:19:59 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-00c6afed-01bb-4001-b0b3-1002f3bfe92d tempest-VolumesSnapshotsTestJSON-1604074109 tempest-VolumesSnapshotsTestJSON-1604074109-project-member] Calling method '.version_select at 0x7f96e571bd00>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:19:59 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-00c6afed-01bb-4001-b0b3-1002f3bfe92d tempest-VolumesSnapshotsTestJSON-1604074109 tempest-VolumesSnapshotsTestJSON-1604074109-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/a1f8deca-1413-4537-af05-3933fd3e2968" status: 200 len: 287 microversion: 2.1 time: 0.101260 Apr 13 16:19:59 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 19/59] 10.0.0.210 () {62 vars in 1328 bytes} [Thu Apr 13 16:19:59 2023] GET /compute/v2.1/os-snapshots/a1f8deca-1413-4537-af05-3933fd3e2968 => generated 287 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:19:59 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-7b3df95f-fd49-4c35-ae36-4bbe50101401 tempest-VolumesGetTestJSON-1657551016 tempest-VolumesGetTestJSON-1657551016-project-member] Calling method '.version_select at 0x7f96e5731b40>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:19:59 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-7b3df95f-fd49-4c35-ae36-4bbe50101401 tempest-VolumesGetTestJSON-1657551016 tempest-VolumesGetTestJSON-1657551016-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/33ac7ed4-21b7-4a54-a349-0cfa731a7cb4" status: 200 len: 352 microversion: 2.1 time: 0.052083 Apr 13 16:19:59 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 19/60] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 16:19:59 2023] GET /compute/v2.1/os-volumes/33ac7ed4-21b7-4a54-a349-0cfa731a7cb4 => generated 352 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:20:00 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-529f61e7-37c2-4cce-a846-bb4d8cd01efb tempest-VolumesSnapshotsTestJSON-1604074109 tempest-VolumesSnapshotsTestJSON-1604074109-project-member] Calling method '.version_select at 0x7f96e57279a0>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:20:00 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-529f61e7-37c2-4cce-a846-bb4d8cd01efb tempest-VolumesSnapshotsTestJSON-1604074109 tempest-VolumesSnapshotsTestJSON-1604074109-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/a1f8deca-1413-4537-af05-3933fd3e2968" status: 200 len: 288 microversion: 2.1 time: 0.033585 Apr 13 16:20:00 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 23/61] 10.0.0.210 () {62 vars in 1328 bytes} [Thu Apr 13 16:20:00 2023] GET /compute/v2.1/os-snapshots/a1f8deca-1413-4537-af05-3933fd3e2968 => generated 288 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:20:00 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-e0404d92-4984-4b95-bf44-209c3eb78184 tempest-VolumesSnapshotsTestJSON-1604074109 tempest-VolumesSnapshotsTestJSON-1604074109-project-member] Calling method '.version_select at 0x7f96e571b6d0>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:20:00 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-e0404d92-4984-4b95-bf44-209c3eb78184 tempest-VolumesSnapshotsTestJSON-1604074109 tempest-VolumesSnapshotsTestJSON-1604074109-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-snapshots/a1f8deca-1413-4537-af05-3933fd3e2968" status: 202 len: 0 microversion: 2.1 time: 0.056895 Apr 13 16:20:00 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 20/62] 10.0.0.210 () {62 vars in 1331 bytes} [Thu Apr 13 16:20:00 2023] DELETE /compute/v2.1/os-snapshots/a1f8deca-1413-4537-af05-3933fd3e2968 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 16:20:00 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-7df84635-8db3-4d5d-ba27-874d6ea10e69 tempest-VolumesSnapshotsTestJSON-1604074109 tempest-VolumesSnapshotsTestJSON-1604074109-project-member] Calling method '.version_select at 0x7f96e57312d0>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:20:00 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-7df84635-8db3-4d5d-ba27-874d6ea10e69 tempest-VolumesSnapshotsTestJSON-1604074109 tempest-VolumesSnapshotsTestJSON-1604074109-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/a1f8deca-1413-4537-af05-3933fd3e2968" status: 200 len: 287 microversion: 2.1 time: 0.039533 Apr 13 16:20:00 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 20/63] 10.0.0.210 () {62 vars in 1328 bytes} [Thu Apr 13 16:20:00 2023] GET /compute/v2.1/os-snapshots/a1f8deca-1413-4537-af05-3933fd3e2968 => generated 287 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:20:00 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-99c0037b-e5c1-4084-aabe-74191ef0f536 tempest-VolumesGetTestJSON-1657551016 tempest-VolumesGetTestJSON-1657551016-project-member] Calling method '.version_select at 0x7f96e5744af0>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:20:00 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-99c0037b-e5c1-4084-aabe-74191ef0f536 tempest-VolumesGetTestJSON-1657551016 tempest-VolumesGetTestJSON-1657551016-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/33ac7ed4-21b7-4a54-a349-0cfa731a7cb4" status: 200 len: 352 microversion: 2.1 time: 0.052471 Apr 13 16:20:00 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 24/64] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 16:20:00 2023] GET /compute/v2.1/os-volumes/33ac7ed4-21b7-4a54-a349-0cfa731a7cb4 => generated 352 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:20:01 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-20f7b5e7-419d-4444-b108-ee808022599d tempest-VolumesSnapshotsTestJSON-1604074109 tempest-VolumesSnapshotsTestJSON-1604074109-project-member] Calling method '.version_select at 0x7f96e5730040>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:20:01 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-20f7b5e7-419d-4444-b108-ee808022599d tempest-VolumesSnapshotsTestJSON-1604074109 tempest-VolumesSnapshotsTestJSON-1604074109-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/a1f8deca-1413-4537-af05-3933fd3e2968" status: 200 len: 287 microversion: 2.1 time: 0.031105 Apr 13 16:20:01 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 21/65] 10.0.0.210 () {62 vars in 1328 bytes} [Thu Apr 13 16:20:01 2023] GET /compute/v2.1/os-snapshots/a1f8deca-1413-4537-af05-3933fd3e2968 => generated 287 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:20:01 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-00fe3ef9-9f28-4163-854f-b31e6e94a7a3 tempest-VolumesGetTestJSON-1657551016 tempest-VolumesGetTestJSON-1657551016-project-member] Calling method '.version_select at 0x7f96e5730f70>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:20:01 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-00fe3ef9-9f28-4163-854f-b31e6e94a7a3 tempest-VolumesGetTestJSON-1657551016 tempest-VolumesGetTestJSON-1657551016-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/33ac7ed4-21b7-4a54-a349-0cfa731a7cb4" status: 200 len: 352 microversion: 2.1 time: 0.049399 Apr 13 16:20:01 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 21/66] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 16:20:01 2023] GET /compute/v2.1/os-volumes/33ac7ed4-21b7-4a54-a349-0cfa731a7cb4 => generated 352 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:20:02 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-6002b933-39ab-4da0-b4e6-32f3a3062ffd tempest-VolumesSnapshotsTestJSON-1604074109 tempest-VolumesSnapshotsTestJSON-1604074109-project-member] Calling method '.version_select at 0x7f96e5744280>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:20:02 user devstack@n-api.service[62054]: INFO nova.api.openstack.wsgi [None req-6002b933-39ab-4da0-b4e6-32f3a3062ffd tempest-VolumesSnapshotsTestJSON-1604074109 tempest-VolumesSnapshotsTestJSON-1604074109-project-member] HTTP exception thrown: Snapshot a1f8deca-1413-4537-af05-3933fd3e2968 could not be found. Apr 13 16:20:02 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-6002b933-39ab-4da0-b4e6-32f3a3062ffd tempest-VolumesSnapshotsTestJSON-1604074109 tempest-VolumesSnapshotsTestJSON-1604074109-project-member] Request method failure captured: Apr 13 16:20:02 user devstack@n-api.service[62054]: request: GET /compute/v2.1/os-snapshots/a1f8deca-1413-4537-af05-3933fd3e2968 HTTP/1.1 Apr 13 16:20:02 user devstack@n-api.service[62054]: Accept: application/json Apr 13 16:20:02 user devstack@n-api.service[62054]: Accept-Encoding: identity Apr 13 16:20:02 user devstack@n-api.service[62054]: Connection: close Apr 13 16:20:02 user devstack@n-api.service[62054]: Content-Length: 0 Apr 13 16:20:02 user devstack@n-api.service[62054]: Content-Type: application/json Apr 13 16:20:02 user devstack@n-api.service[62054]: Host: 10.0.0.210 Apr 13 16:20:02 user devstack@n-api.service[62054]: Openstack-System-Scope: None Apr 13 16:20:02 user devstack@n-api.service[62054]: User-Agent: python-urllib3/1.26.15 Apr 13 16:20:02 user devstack@n-api.service[62054]: X-Auth-Token: gAAAAABkOCurpQPgZlBU0CpfiIjymejZLXx5tHd8LphslGQ-YpbTi53Abzwly7pe3NF_EcaZweD-vRggB09J42hqScEDb15Dhh7_qD_9xqqRvxgB1wTOPqPncJthA7KOn3GC5I5rUan0iMJAfW8YU0D-kNBJB-J4jWXilmePS7GTSHI7H2L96xw Apr 13 16:20:02 user devstack@n-api.service[62054]: X-Domain-Id: None Apr 13 16:20:02 user devstack@n-api.service[62054]: X-Domain-Name: None Apr 13 16:20:02 user devstack@n-api.service[62054]: X-Identity-Status: Confirmed Apr 13 16:20:02 user devstack@n-api.service[62054]: X-Is-Admin-Project: True Apr 13 16:20:02 user devstack@n-api.service[62054]: X-Project-Domain-Id: default Apr 13 16:20:02 user devstack@n-api.service[62054]: X-Project-Domain-Name: Default Apr 13 16:20:02 user devstack@n-api.service[62054]: X-Project-Id: 1a7921287aeb4d74bae5e530899e5709 Apr 13 16:20:02 user devstack@n-api.service[62054]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1604074109 Apr 13 16:20:02 user devstack@n-api.service[62054]: X-Role: reader,member Apr 13 16:20:02 user devstack@n-api.service[62054]: X-Roles: reader,member Apr 13 16:20:02 user devstack@n-api.service[62054]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/1a7921287aeb4d74bae5e530899e5709"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1a7921287aeb4d74bae5e530899e5709"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1a7921287aeb4d74bae5e530899e5709"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 13 16:20:02 user devstack@n-api.service[62054]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1604074109 Apr 13 16:20:02 user devstack@n-api.service[62054]: X-Tenant-Id: 1a7921287aeb4d74bae5e530899e5709 Apr 13 16:20:02 user devstack@n-api.service[62054]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1604074109 Apr 13 16:20:02 user devstack@n-api.service[62054]: X-User: tempest-VolumesSnapshotsTestJSON-1604074109-project-member Apr 13 16:20:02 user devstack@n-api.service[62054]: X-User-Domain-Id: default Apr 13 16:20:02 user devstack@n-api.service[62054]: X-User-Domain-Name: Default Apr 13 16:20:02 user devstack@n-api.service[62054]: X-User-Id: 0e084c37825a49f69ee40e9daf736c0d Apr 13 16:20:02 user devstack@n-api.service[62054]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1604074109-project-member Apr 13 16:20:02 user devstack@n-api.service[62054]: method: Apr 13 16:20:02 user devstack@n-api.service[62054]: exception: Snapshot a1f8deca-1413-4537-af05-3933fd3e2968 could not be found. Apr 13 16:20:02 user devstack@n-api.service[62054]: action_args: {'id': 'a1f8deca-1413-4537-af05-3933fd3e2968'} Apr 13 16:20:02 user devstack@n-api.service[62054]: {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 16:20:02 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:20:02 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Apr 13 16:20:02 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Apr 13 16:20:02 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Apr 13 16:20:02 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Apr 13 16:20:02 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 174, in get Apr 13 16:20:02 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Apr 13 16:20:02 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 13 16:20:02 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 13 16:20:02 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 13 16:20:02 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 13 16:20:02 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 16:20:02 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 16:20:02 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 16:20:02 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 16:20:02 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot a1f8deca-1413-4537-af05-3933fd3e2968 could not be found. (HTTP 404) (Request-ID: req-3303372f-c9ad-44df-bfd8-e55787cf0045) Apr 13 16:20:02 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:20:02 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:20:02 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:20:02 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:20:02 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Apr 13 16:20:02 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Apr 13 16:20:02 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 13 16:20:02 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 13 16:20:02 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Apr 13 16:20:02 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Apr 13 16:20:02 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 13 16:20:02 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 13 16:20:02 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Apr 13 16:20:02 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Apr 13 16:20:02 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Apr 13 16:20:02 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Apr 13 16:20:02 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 174, in get Apr 13 16:20:02 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Apr 13 16:20:02 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 13 16:20:02 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 13 16:20:02 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 13 16:20:02 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 13 16:20:02 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 16:20:02 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 16:20:02 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 16:20:02 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 16:20:02 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot a1f8deca-1413-4537-af05-3933fd3e2968 could not be found. Apr 13 16:20:02 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:20:02 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:20:02 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:20:02 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:20:02 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 16:20:02 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 16:20:02 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 16:20:02 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 16:20:02 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 13 16:20:02 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 13 16:20:02 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 16:20:02 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 16:20:02 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Apr 13 16:20:02 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 16:20:02 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot a1f8deca-1413-4537-af05-3933fd3e2968 could not be found. Apr 13 16:20:02 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:20:02 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:20:02 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:20:02 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:20:02 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 16:20:02 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 16:20:02 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 16:20:02 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 16:20:02 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot a1f8deca-1413-4537-af05-3933fd3e2968 could not be found. Apr 13 16:20:02 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:20:02 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-6002b933-39ab-4da0-b4e6-32f3a3062ffd tempest-VolumesSnapshotsTestJSON-1604074109 tempest-VolumesSnapshotsTestJSON-1604074109-project-member] Returning 404 to user: Snapshot a1f8deca-1413-4537-af05-3933fd3e2968 could not be found. {{(pid=62054) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 16:20:02 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-6002b933-39ab-4da0-b4e6-32f3a3062ffd tempest-VolumesSnapshotsTestJSON-1604074109 tempest-VolumesSnapshotsTestJSON-1604074109-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/a1f8deca-1413-4537-af05-3933fd3e2968" status: 404 len: 111 microversion: 2.1 time: 0.045731 Apr 13 16:20:02 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 25/67] 10.0.0.210 () {62 vars in 1328 bytes} [Thu Apr 13 16:20:02 2023] GET /compute/v2.1/os-snapshots/a1f8deca-1413-4537-af05-3933fd3e2968 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 16:20:02 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-3db84f78-57da-456b-82e0-510c1b61efc5 tempest-VolumesSnapshotsTestJSON-1604074109 tempest-VolumesSnapshotsTestJSON-1604074109-project-member] Calling method '.version_select at 0x7f96e571b250>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:20:02 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-41574000-99ed-43ff-a72a-4039b1001949 tempest-VolumesGetTestJSON-1657551016 tempest-VolumesGetTestJSON-1657551016-project-member] Calling method '.version_select at 0x7f96e5731990>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:20:02 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-3db84f78-57da-456b-82e0-510c1b61efc5 tempest-VolumesSnapshotsTestJSON-1604074109 tempest-VolumesSnapshotsTestJSON-1604074109-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/9039b70c-c6f2-47ac-8916-8fda0b51c38e" status: 202 len: 0 microversion: 2.1 time: 0.067167 Apr 13 16:20:02 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 22/68] 10.0.0.210 () {62 vars in 1325 bytes} [Thu Apr 13 16:20:02 2023] DELETE /compute/v2.1/os-volumes/9039b70c-c6f2-47ac-8916-8fda0b51c38e => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 13 16:20:02 user devstack@n-api.service[62053]: INFO nova.api.openstack.wsgi [None req-41574000-99ed-43ff-a72a-4039b1001949 tempest-VolumesGetTestJSON-1657551016 tempest-VolumesGetTestJSON-1657551016-project-member] HTTP exception thrown: Volume 33ac7ed4-21b7-4a54-a349-0cfa731a7cb4 could not be found. Apr 13 16:20:02 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-59c6a8fb-57da-4853-864b-cfaeaa7258d5 tempest-VolumesSnapshotsTestJSON-1604074109 tempest-VolumesSnapshotsTestJSON-1604074109-project-member] Calling method '.version_select at 0x7f96e57452d0>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:20:02 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-41574000-99ed-43ff-a72a-4039b1001949 tempest-VolumesGetTestJSON-1657551016 tempest-VolumesGetTestJSON-1657551016-project-member] Request method failure captured: Apr 13 16:20:02 user devstack@n-api.service[62053]: request: GET /compute/v2.1/os-volumes/33ac7ed4-21b7-4a54-a349-0cfa731a7cb4 HTTP/1.1 Apr 13 16:20:02 user devstack@n-api.service[62053]: Accept: application/json Apr 13 16:20:02 user devstack@n-api.service[62053]: Accept-Encoding: identity Apr 13 16:20:02 user devstack@n-api.service[62053]: Connection: close Apr 13 16:20:02 user devstack@n-api.service[62053]: Content-Length: 0 Apr 13 16:20:02 user devstack@n-api.service[62053]: Content-Type: application/json Apr 13 16:20:02 user devstack@n-api.service[62053]: Host: 10.0.0.210 Apr 13 16:20:02 user devstack@n-api.service[62053]: Openstack-System-Scope: None Apr 13 16:20:02 user devstack@n-api.service[62053]: User-Agent: python-urllib3/1.26.15 Apr 13 16:20:02 user devstack@n-api.service[62053]: X-Auth-Token: gAAAAABkOCurdD3Vno2or4fd3xPeiRwtJUxKHOO9En-W18SINI9NoT6gDwgFUi1gOgPhohMnVIhDeA_KkRijsaS2CeJC8wKEm7xLMYi3jp2iqLJ_OjQC4WRPsn310tfZme8lxlJ9GYcz5OmOgM_0gwKUcKHcm7ikkN34yBa5dGW6P2kd3-yemZc Apr 13 16:20:02 user devstack@n-api.service[62053]: X-Domain-Id: None Apr 13 16:20:02 user devstack@n-api.service[62053]: X-Domain-Name: None Apr 13 16:20:02 user devstack@n-api.service[62053]: X-Identity-Status: Confirmed Apr 13 16:20:02 user devstack@n-api.service[62053]: X-Is-Admin-Project: True Apr 13 16:20:02 user devstack@n-api.service[62053]: X-Project-Domain-Id: default Apr 13 16:20:02 user devstack@n-api.service[62053]: X-Project-Domain-Name: Default Apr 13 16:20:02 user devstack@n-api.service[62053]: X-Project-Id: 3168c78634924a63975d80c51581bc13 Apr 13 16:20:02 user devstack@n-api.service[62053]: X-Project-Name: tempest-VolumesGetTestJSON-1657551016 Apr 13 16:20:02 user devstack@n-api.service[62053]: X-Role: reader,member Apr 13 16:20:02 user devstack@n-api.service[62053]: X-Roles: reader,member Apr 13 16:20:02 user devstack@n-api.service[62053]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3168c78634924a63975d80c51581bc13"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3168c78634924a63975d80c51581bc13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3168c78634924a63975d80c51581bc13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 13 16:20:02 user devstack@n-api.service[62053]: X-Tenant: tempest-VolumesGetTestJSON-1657551016 Apr 13 16:20:02 user devstack@n-api.service[62053]: X-Tenant-Id: 3168c78634924a63975d80c51581bc13 Apr 13 16:20:02 user devstack@n-api.service[62053]: X-Tenant-Name: tempest-VolumesGetTestJSON-1657551016 Apr 13 16:20:02 user devstack@n-api.service[62053]: X-User: tempest-VolumesGetTestJSON-1657551016-project-member Apr 13 16:20:02 user devstack@n-api.service[62053]: X-User-Domain-Id: default Apr 13 16:20:02 user devstack@n-api.service[62053]: X-User-Domain-Name: Default Apr 13 16:20:02 user devstack@n-api.service[62053]: X-User-Id: 3a7c419c74db45538f4f7a312c43b77f Apr 13 16:20:02 user devstack@n-api.service[62053]: X-User-Name: tempest-VolumesGetTestJSON-1657551016-project-member Apr 13 16:20:02 user devstack@n-api.service[62053]: method: Apr 13 16:20:02 user devstack@n-api.service[62053]: exception: Volume 33ac7ed4-21b7-4a54-a349-0cfa731a7cb4 could not be found. Apr 13 16:20:02 user devstack@n-api.service[62053]: action_args: {'id': '33ac7ed4-21b7-4a54-a349-0cfa731a7cb4'} Apr 13 16:20:02 user devstack@n-api.service[62053]: {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 16:20:02 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:20:02 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 13 16:20:02 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 13 16:20:02 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 13 16:20:02 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 13 16:20:02 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 13 16:20:02 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 13 16:20:02 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 13 16:20:02 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 13 16:20:02 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 13 16:20:02 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 13 16:20:02 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 16:20:02 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 16:20:02 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 16:20:02 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 16:20:02 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 33ac7ed4-21b7-4a54-a349-0cfa731a7cb4 could not be found. (HTTP 404) (Request-ID: req-c04c52d6-7740-4b81-81e6-aa20cf76eecc) Apr 13 16:20:02 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:20:02 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:20:02 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:20:02 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:20:02 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 13 16:20:02 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 13 16:20:02 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 13 16:20:02 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 13 16:20:02 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 13 16:20:02 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 13 16:20:02 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 13 16:20:02 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 13 16:20:02 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 13 16:20:02 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 13 16:20:02 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 13 16:20:02 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 13 16:20:02 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 13 16:20:02 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 13 16:20:02 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 13 16:20:02 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 13 16:20:02 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 13 16:20:02 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 13 16:20:02 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 16:20:02 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 16:20:02 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 16:20:02 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 16:20:02 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 33ac7ed4-21b7-4a54-a349-0cfa731a7cb4 could not be found. Apr 13 16:20:02 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:20:02 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:20:02 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:20:02 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:20:02 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 16:20:02 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 16:20:02 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 16:20:02 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 16:20:02 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 13 16:20:02 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 13 16:20:02 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 16:20:02 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 16:20:02 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 13 16:20:02 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 16:20:02 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 33ac7ed4-21b7-4a54-a349-0cfa731a7cb4 could not be found. Apr 13 16:20:02 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:20:02 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:20:02 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:20:02 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:20:02 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 16:20:02 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 16:20:02 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 16:20:02 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 16:20:02 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 33ac7ed4-21b7-4a54-a349-0cfa731a7cb4 could not be found. Apr 13 16:20:02 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:20:02 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-41574000-99ed-43ff-a72a-4039b1001949 tempest-VolumesGetTestJSON-1657551016 tempest-VolumesGetTestJSON-1657551016-project-member] Returning 404 to user: Volume 33ac7ed4-21b7-4a54-a349-0cfa731a7cb4 could not be found. {{(pid=62053) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 16:20:02 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-41574000-99ed-43ff-a72a-4039b1001949 tempest-VolumesGetTestJSON-1657551016 tempest-VolumesGetTestJSON-1657551016-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/33ac7ed4-21b7-4a54-a349-0cfa731a7cb4" status: 404 len: 109 microversion: 2.1 time: 0.044531 Apr 13 16:20:02 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 22/69] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 16:20:02 2023] GET /compute/v2.1/os-volumes/33ac7ed4-21b7-4a54-a349-0cfa731a7cb4 => generated 109 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 16:20:02 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-59c6a8fb-57da-4853-864b-cfaeaa7258d5 tempest-VolumesSnapshotsTestJSON-1604074109 tempest-VolumesSnapshotsTestJSON-1604074109-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/9039b70c-c6f2-47ac-8916-8fda0b51c38e" status: 200 len: 344 microversion: 2.1 time: 0.104318 Apr 13 16:20:02 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 26/70] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 16:20:02 2023] GET /compute/v2.1/os-volumes/9039b70c-c6f2-47ac-8916-8fda0b51c38e => generated 344 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:20:03 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-9ee16fc3-571a-4758-bdc1-038791379f55 tempest-VolumesSnapshotsTestJSON-1604074109 tempest-VolumesSnapshotsTestJSON-1604074109-project-member] Calling method '.version_select at 0x7f96e571ba30>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:20:03 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-9ee16fc3-571a-4758-bdc1-038791379f55 tempest-VolumesSnapshotsTestJSON-1604074109 tempest-VolumesSnapshotsTestJSON-1604074109-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/9039b70c-c6f2-47ac-8916-8fda0b51c38e" status: 200 len: 344 microversion: 2.1 time: 0.064389 Apr 13 16:20:03 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 23/71] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 16:20:03 2023] GET /compute/v2.1/os-volumes/9039b70c-c6f2-47ac-8916-8fda0b51c38e => generated 344 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:20:04 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-0d30df28-1279-45b6-86e7-57d7a58e1c44 tempest-VolumesSnapshotsTestJSON-1604074109 tempest-VolumesSnapshotsTestJSON-1604074109-project-member] Calling method '.version_select at 0x7f96e5730c10>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:20:05 user devstack@n-api.service[62053]: INFO nova.api.openstack.wsgi [None req-0d30df28-1279-45b6-86e7-57d7a58e1c44 tempest-VolumesSnapshotsTestJSON-1604074109 tempest-VolumesSnapshotsTestJSON-1604074109-project-member] HTTP exception thrown: Volume 9039b70c-c6f2-47ac-8916-8fda0b51c38e could not be found. Apr 13 16:20:05 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-0d30df28-1279-45b6-86e7-57d7a58e1c44 tempest-VolumesSnapshotsTestJSON-1604074109 tempest-VolumesSnapshotsTestJSON-1604074109-project-member] Request method failure captured: Apr 13 16:20:05 user devstack@n-api.service[62053]: request: GET /compute/v2.1/os-volumes/9039b70c-c6f2-47ac-8916-8fda0b51c38e HTTP/1.1 Apr 13 16:20:05 user devstack@n-api.service[62053]: Accept: application/json Apr 13 16:20:05 user devstack@n-api.service[62053]: Accept-Encoding: identity Apr 13 16:20:05 user devstack@n-api.service[62053]: Connection: close Apr 13 16:20:05 user devstack@n-api.service[62053]: Content-Length: 0 Apr 13 16:20:05 user devstack@n-api.service[62053]: Content-Type: application/json Apr 13 16:20:05 user devstack@n-api.service[62053]: Host: 10.0.0.210 Apr 13 16:20:05 user devstack@n-api.service[62053]: Openstack-System-Scope: None Apr 13 16:20:05 user devstack@n-api.service[62053]: User-Agent: python-urllib3/1.26.15 Apr 13 16:20:05 user devstack@n-api.service[62053]: X-Auth-Token: gAAAAABkOCurpQPgZlBU0CpfiIjymejZLXx5tHd8LphslGQ-YpbTi53Abzwly7pe3NF_EcaZweD-vRggB09J42hqScEDb15Dhh7_qD_9xqqRvxgB1wTOPqPncJthA7KOn3GC5I5rUan0iMJAfW8YU0D-kNBJB-J4jWXilmePS7GTSHI7H2L96xw Apr 13 16:20:05 user devstack@n-api.service[62053]: X-Domain-Id: None Apr 13 16:20:05 user devstack@n-api.service[62053]: X-Domain-Name: None Apr 13 16:20:05 user devstack@n-api.service[62053]: X-Identity-Status: Confirmed Apr 13 16:20:05 user devstack@n-api.service[62053]: X-Is-Admin-Project: True Apr 13 16:20:05 user devstack@n-api.service[62053]: X-Project-Domain-Id: default Apr 13 16:20:05 user devstack@n-api.service[62053]: X-Project-Domain-Name: Default Apr 13 16:20:05 user devstack@n-api.service[62053]: X-Project-Id: 1a7921287aeb4d74bae5e530899e5709 Apr 13 16:20:05 user devstack@n-api.service[62053]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1604074109 Apr 13 16:20:05 user devstack@n-api.service[62053]: X-Role: reader,member Apr 13 16:20:05 user devstack@n-api.service[62053]: X-Roles: reader,member Apr 13 16:20:05 user devstack@n-api.service[62053]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/1a7921287aeb4d74bae5e530899e5709"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1a7921287aeb4d74bae5e530899e5709"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1a7921287aeb4d74bae5e530899e5709"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 13 16:20:05 user devstack@n-api.service[62053]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1604074109 Apr 13 16:20:05 user devstack@n-api.service[62053]: X-Tenant-Id: 1a7921287aeb4d74bae5e530899e5709 Apr 13 16:20:05 user devstack@n-api.service[62053]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1604074109 Apr 13 16:20:05 user devstack@n-api.service[62053]: X-User: tempest-VolumesSnapshotsTestJSON-1604074109-project-member Apr 13 16:20:05 user devstack@n-api.service[62053]: X-User-Domain-Id: default Apr 13 16:20:05 user devstack@n-api.service[62053]: X-User-Domain-Name: Default Apr 13 16:20:05 user devstack@n-api.service[62053]: X-User-Id: 0e084c37825a49f69ee40e9daf736c0d Apr 13 16:20:05 user devstack@n-api.service[62053]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1604074109-project-member Apr 13 16:20:05 user devstack@n-api.service[62053]: method: Apr 13 16:20:05 user devstack@n-api.service[62053]: exception: Volume 9039b70c-c6f2-47ac-8916-8fda0b51c38e could not be found. Apr 13 16:20:05 user devstack@n-api.service[62053]: action_args: {'id': '9039b70c-c6f2-47ac-8916-8fda0b51c38e'} Apr 13 16:20:05 user devstack@n-api.service[62053]: {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 16:20:05 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:20:05 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 13 16:20:05 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 13 16:20:05 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 13 16:20:05 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 13 16:20:05 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 13 16:20:05 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 13 16:20:05 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 13 16:20:05 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 13 16:20:05 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 13 16:20:05 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 13 16:20:05 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 16:20:05 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 16:20:05 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 16:20:05 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 16:20:05 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9039b70c-c6f2-47ac-8916-8fda0b51c38e could not be found. (HTTP 404) (Request-ID: req-02652b9d-faa5-499f-8555-1f089539213f) Apr 13 16:20:05 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:20:05 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:20:05 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:20:05 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:20:05 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 13 16:20:05 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 13 16:20:05 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 13 16:20:05 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 13 16:20:05 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 13 16:20:05 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 13 16:20:05 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 13 16:20:05 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 13 16:20:05 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 13 16:20:05 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 13 16:20:05 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 13 16:20:05 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 13 16:20:05 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 13 16:20:05 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 13 16:20:05 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 13 16:20:05 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 13 16:20:05 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 13 16:20:05 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 13 16:20:05 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 16:20:05 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 16:20:05 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 16:20:05 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 16:20:05 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9039b70c-c6f2-47ac-8916-8fda0b51c38e could not be found. Apr 13 16:20:05 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:20:05 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:20:05 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:20:05 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:20:05 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 16:20:05 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 16:20:05 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 16:20:05 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 16:20:05 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 13 16:20:05 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 13 16:20:05 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 16:20:05 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 16:20:05 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 13 16:20:05 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 16:20:05 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9039b70c-c6f2-47ac-8916-8fda0b51c38e could not be found. Apr 13 16:20:05 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:20:05 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:20:05 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:20:05 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:20:05 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 16:20:05 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 16:20:05 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 16:20:05 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 16:20:05 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9039b70c-c6f2-47ac-8916-8fda0b51c38e could not be found. Apr 13 16:20:05 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:20:05 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-0d30df28-1279-45b6-86e7-57d7a58e1c44 tempest-VolumesSnapshotsTestJSON-1604074109 tempest-VolumesSnapshotsTestJSON-1604074109-project-member] Returning 404 to user: Volume 9039b70c-c6f2-47ac-8916-8fda0b51c38e could not be found. {{(pid=62053) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 16:20:05 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-0d30df28-1279-45b6-86e7-57d7a58e1c44 tempest-VolumesSnapshotsTestJSON-1604074109 tempest-VolumesSnapshotsTestJSON-1604074109-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/9039b70c-c6f2-47ac-8916-8fda0b51c38e" status: 404 len: 109 microversion: 2.1 time: 0.046302 Apr 13 16:20:05 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 23/72] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 16:20:04 2023] GET /compute/v2.1/os-volumes/9039b70c-c6f2-47ac-8916-8fda0b51c38e => generated 109 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 16:20:05 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-dfb0c19a-81c9-4187-a8e1-e9a580367a60 tempest-VolumesSnapshotsTestJSON-1604074109 tempest-VolumesSnapshotsTestJSON-1604074109-project-member] Calling method '.version_select at 0x7f96e5745a20>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:20:05 user devstack@n-api.service[62054]: INFO nova.api.openstack.wsgi [None req-dfb0c19a-81c9-4187-a8e1-e9a580367a60 tempest-VolumesSnapshotsTestJSON-1604074109 tempest-VolumesSnapshotsTestJSON-1604074109-project-member] HTTP exception thrown: Volume 9039b70c-c6f2-47ac-8916-8fda0b51c38e could not be found. Apr 13 16:20:05 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-dfb0c19a-81c9-4187-a8e1-e9a580367a60 tempest-VolumesSnapshotsTestJSON-1604074109 tempest-VolumesSnapshotsTestJSON-1604074109-project-member] Request method failure captured: Apr 13 16:20:05 user devstack@n-api.service[62054]: request: DELETE /compute/v2.1/os-volumes/9039b70c-c6f2-47ac-8916-8fda0b51c38e HTTP/1.1 Apr 13 16:20:05 user devstack@n-api.service[62054]: Accept: application/json Apr 13 16:20:05 user devstack@n-api.service[62054]: Accept-Encoding: identity Apr 13 16:20:05 user devstack@n-api.service[62054]: Connection: close Apr 13 16:20:05 user devstack@n-api.service[62054]: Content-Length: 0 Apr 13 16:20:05 user devstack@n-api.service[62054]: Content-Type: application/json Apr 13 16:20:05 user devstack@n-api.service[62054]: Host: 10.0.0.210 Apr 13 16:20:05 user devstack@n-api.service[62054]: Openstack-System-Scope: None Apr 13 16:20:05 user devstack@n-api.service[62054]: User-Agent: python-urllib3/1.26.15 Apr 13 16:20:05 user devstack@n-api.service[62054]: X-Auth-Token: gAAAAABkOCurpQPgZlBU0CpfiIjymejZLXx5tHd8LphslGQ-YpbTi53Abzwly7pe3NF_EcaZweD-vRggB09J42hqScEDb15Dhh7_qD_9xqqRvxgB1wTOPqPncJthA7KOn3GC5I5rUan0iMJAfW8YU0D-kNBJB-J4jWXilmePS7GTSHI7H2L96xw Apr 13 16:20:05 user devstack@n-api.service[62054]: X-Domain-Id: None Apr 13 16:20:05 user devstack@n-api.service[62054]: X-Domain-Name: None Apr 13 16:20:05 user devstack@n-api.service[62054]: X-Identity-Status: Confirmed Apr 13 16:20:05 user devstack@n-api.service[62054]: X-Is-Admin-Project: True Apr 13 16:20:05 user devstack@n-api.service[62054]: X-Project-Domain-Id: default Apr 13 16:20:05 user devstack@n-api.service[62054]: X-Project-Domain-Name: Default Apr 13 16:20:05 user devstack@n-api.service[62054]: X-Project-Id: 1a7921287aeb4d74bae5e530899e5709 Apr 13 16:20:05 user devstack@n-api.service[62054]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1604074109 Apr 13 16:20:05 user devstack@n-api.service[62054]: X-Role: reader,member Apr 13 16:20:05 user devstack@n-api.service[62054]: X-Roles: reader,member Apr 13 16:20:05 user devstack@n-api.service[62054]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/1a7921287aeb4d74bae5e530899e5709"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1a7921287aeb4d74bae5e530899e5709"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1a7921287aeb4d74bae5e530899e5709"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 13 16:20:05 user devstack@n-api.service[62054]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1604074109 Apr 13 16:20:05 user devstack@n-api.service[62054]: X-Tenant-Id: 1a7921287aeb4d74bae5e530899e5709 Apr 13 16:20:05 user devstack@n-api.service[62054]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1604074109 Apr 13 16:20:05 user devstack@n-api.service[62054]: X-User: tempest-VolumesSnapshotsTestJSON-1604074109-project-member Apr 13 16:20:05 user devstack@n-api.service[62054]: X-User-Domain-Id: default Apr 13 16:20:05 user devstack@n-api.service[62054]: X-User-Domain-Name: Default Apr 13 16:20:05 user devstack@n-api.service[62054]: X-User-Id: 0e084c37825a49f69ee40e9daf736c0d Apr 13 16:20:05 user devstack@n-api.service[62054]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1604074109-project-member Apr 13 16:20:05 user devstack@n-api.service[62054]: method: Apr 13 16:20:05 user devstack@n-api.service[62054]: exception: Volume 9039b70c-c6f2-47ac-8916-8fda0b51c38e could not be found. Apr 13 16:20:05 user devstack@n-api.service[62054]: action_args: {'id': '9039b70c-c6f2-47ac-8916-8fda0b51c38e'} Apr 13 16:20:05 user devstack@n-api.service[62054]: {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 16:20:05 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:20:05 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 13 16:20:05 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 13 16:20:05 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 13 16:20:05 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 13 16:20:05 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 13 16:20:05 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 13 16:20:05 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 13 16:20:05 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 13 16:20:05 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 13 16:20:05 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 13 16:20:05 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 16:20:05 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 16:20:05 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 16:20:05 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 16:20:05 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9039b70c-c6f2-47ac-8916-8fda0b51c38e could not be found. (HTTP 404) (Request-ID: req-ab09be77-4e8b-4310-984d-1c7e9aee25a7) Apr 13 16:20:05 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:20:05 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:20:05 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:20:05 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:20:05 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 13 16:20:05 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 13 16:20:05 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 13 16:20:05 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 13 16:20:05 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 13 16:20:05 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 13 16:20:05 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 13 16:20:05 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 13 16:20:05 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 13 16:20:05 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 13 16:20:05 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 13 16:20:05 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 13 16:20:05 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 13 16:20:05 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 13 16:20:05 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 13 16:20:05 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 13 16:20:05 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 13 16:20:05 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 13 16:20:05 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 16:20:05 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 16:20:05 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 16:20:05 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 16:20:05 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9039b70c-c6f2-47ac-8916-8fda0b51c38e could not be found. Apr 13 16:20:05 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:20:05 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:20:05 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:20:05 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:20:05 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 16:20:05 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 16:20:05 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 16:20:05 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 16:20:05 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 13 16:20:05 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 13 16:20:05 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 16:20:05 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 16:20:05 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 13 16:20:05 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 16:20:05 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9039b70c-c6f2-47ac-8916-8fda0b51c38e could not be found. Apr 13 16:20:05 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:20:05 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:20:05 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:20:05 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:20:05 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 16:20:05 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 16:20:05 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 16:20:05 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 16:20:05 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9039b70c-c6f2-47ac-8916-8fda0b51c38e could not be found. Apr 13 16:20:05 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:20:05 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-dfb0c19a-81c9-4187-a8e1-e9a580367a60 tempest-VolumesSnapshotsTestJSON-1604074109 tempest-VolumesSnapshotsTestJSON-1604074109-project-member] Returning 404 to user: Volume 9039b70c-c6f2-47ac-8916-8fda0b51c38e could not be found. {{(pid=62054) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 16:20:05 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-dfb0c19a-81c9-4187-a8e1-e9a580367a60 tempest-VolumesSnapshotsTestJSON-1604074109 tempest-VolumesSnapshotsTestJSON-1604074109-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/9039b70c-c6f2-47ac-8916-8fda0b51c38e" status: 404 len: 109 microversion: 2.1 time: 0.043948 Apr 13 16:20:05 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 27/73] 10.0.0.210 () {62 vars in 1325 bytes} [Thu Apr 13 16:20:05 2023] DELETE /compute/v2.1/os-volumes/9039b70c-c6f2-47ac-8916-8fda0b51c38e => generated 109 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 16:20:05 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-670063a3-2fde-47cc-b4c7-52e005bf8a2a tempest-VolumesSnapshotsTestJSON-1604074109 tempest-VolumesSnapshotsTestJSON-1604074109-project-member] Calling method '.version_select at 0x7f96e57303a0>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:20:05 user devstack@n-api.service[62055]: INFO nova.api.openstack.wsgi [None req-670063a3-2fde-47cc-b4c7-52e005bf8a2a tempest-VolumesSnapshotsTestJSON-1604074109 tempest-VolumesSnapshotsTestJSON-1604074109-project-member] HTTP exception thrown: Volume 9039b70c-c6f2-47ac-8916-8fda0b51c38e could not be found. Apr 13 16:20:05 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-670063a3-2fde-47cc-b4c7-52e005bf8a2a tempest-VolumesSnapshotsTestJSON-1604074109 tempest-VolumesSnapshotsTestJSON-1604074109-project-member] Request method failure captured: Apr 13 16:20:05 user devstack@n-api.service[62055]: request: GET /compute/v2.1/os-volumes/9039b70c-c6f2-47ac-8916-8fda0b51c38e HTTP/1.1 Apr 13 16:20:05 user devstack@n-api.service[62055]: Accept: application/json Apr 13 16:20:05 user devstack@n-api.service[62055]: Accept-Encoding: identity Apr 13 16:20:05 user devstack@n-api.service[62055]: Connection: close Apr 13 16:20:05 user devstack@n-api.service[62055]: Content-Length: 0 Apr 13 16:20:05 user devstack@n-api.service[62055]: Content-Type: application/json Apr 13 16:20:05 user devstack@n-api.service[62055]: Host: 10.0.0.210 Apr 13 16:20:05 user devstack@n-api.service[62055]: Openstack-System-Scope: None Apr 13 16:20:05 user devstack@n-api.service[62055]: User-Agent: python-urllib3/1.26.15 Apr 13 16:20:05 user devstack@n-api.service[62055]: X-Auth-Token: gAAAAABkOCurpQPgZlBU0CpfiIjymejZLXx5tHd8LphslGQ-YpbTi53Abzwly7pe3NF_EcaZweD-vRggB09J42hqScEDb15Dhh7_qD_9xqqRvxgB1wTOPqPncJthA7KOn3GC5I5rUan0iMJAfW8YU0D-kNBJB-J4jWXilmePS7GTSHI7H2L96xw Apr 13 16:20:05 user devstack@n-api.service[62055]: X-Domain-Id: None Apr 13 16:20:05 user devstack@n-api.service[62055]: X-Domain-Name: None Apr 13 16:20:05 user devstack@n-api.service[62055]: X-Identity-Status: Confirmed Apr 13 16:20:05 user devstack@n-api.service[62055]: X-Is-Admin-Project: True Apr 13 16:20:05 user devstack@n-api.service[62055]: X-Project-Domain-Id: default Apr 13 16:20:05 user devstack@n-api.service[62055]: X-Project-Domain-Name: Default Apr 13 16:20:05 user devstack@n-api.service[62055]: X-Project-Id: 1a7921287aeb4d74bae5e530899e5709 Apr 13 16:20:05 user devstack@n-api.service[62055]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1604074109 Apr 13 16:20:05 user devstack@n-api.service[62055]: X-Role: reader,member Apr 13 16:20:05 user devstack@n-api.service[62055]: X-Roles: reader,member Apr 13 16:20:05 user devstack@n-api.service[62055]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/1a7921287aeb4d74bae5e530899e5709"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1a7921287aeb4d74bae5e530899e5709"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1a7921287aeb4d74bae5e530899e5709"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 13 16:20:05 user devstack@n-api.service[62055]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1604074109 Apr 13 16:20:05 user devstack@n-api.service[62055]: X-Tenant-Id: 1a7921287aeb4d74bae5e530899e5709 Apr 13 16:20:05 user devstack@n-api.service[62055]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1604074109 Apr 13 16:20:05 user devstack@n-api.service[62055]: X-User: tempest-VolumesSnapshotsTestJSON-1604074109-project-member Apr 13 16:20:05 user devstack@n-api.service[62055]: X-User-Domain-Id: default Apr 13 16:20:05 user devstack@n-api.service[62055]: X-User-Domain-Name: Default Apr 13 16:20:05 user devstack@n-api.service[62055]: X-User-Id: 0e084c37825a49f69ee40e9daf736c0d Apr 13 16:20:05 user devstack@n-api.service[62055]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1604074109-project-member Apr 13 16:20:05 user devstack@n-api.service[62055]: method: Apr 13 16:20:05 user devstack@n-api.service[62055]: exception: Volume 9039b70c-c6f2-47ac-8916-8fda0b51c38e could not be found. Apr 13 16:20:05 user devstack@n-api.service[62055]: action_args: {'id': '9039b70c-c6f2-47ac-8916-8fda0b51c38e'} Apr 13 16:20:05 user devstack@n-api.service[62055]: {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 16:20:05 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:20:05 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 13 16:20:05 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 13 16:20:05 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 13 16:20:05 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 13 16:20:05 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 13 16:20:05 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 13 16:20:05 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 13 16:20:05 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 13 16:20:05 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 13 16:20:05 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 13 16:20:05 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 16:20:05 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 16:20:05 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 16:20:05 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 16:20:05 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9039b70c-c6f2-47ac-8916-8fda0b51c38e could not be found. (HTTP 404) (Request-ID: req-55f94b3f-6ef2-4bc2-ba8f-81b4f24f326f) Apr 13 16:20:05 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:20:05 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:20:05 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:20:05 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:20:05 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 13 16:20:05 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 13 16:20:05 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 13 16:20:05 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 13 16:20:05 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 13 16:20:05 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 13 16:20:05 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 13 16:20:05 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 13 16:20:05 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 13 16:20:05 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 13 16:20:05 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 13 16:20:05 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 13 16:20:05 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 13 16:20:05 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 13 16:20:05 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 13 16:20:05 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 13 16:20:05 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 13 16:20:05 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 13 16:20:05 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 16:20:05 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 16:20:05 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 16:20:05 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 16:20:05 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9039b70c-c6f2-47ac-8916-8fda0b51c38e could not be found. Apr 13 16:20:05 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:20:05 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:20:05 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:20:05 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:20:05 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 16:20:05 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 16:20:05 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 16:20:05 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 16:20:05 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 13 16:20:05 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 13 16:20:05 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 16:20:05 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 16:20:05 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 13 16:20:05 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 16:20:05 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9039b70c-c6f2-47ac-8916-8fda0b51c38e could not be found. Apr 13 16:20:05 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:20:05 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:20:05 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:20:05 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:20:05 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 16:20:05 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 16:20:05 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 16:20:05 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 16:20:05 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9039b70c-c6f2-47ac-8916-8fda0b51c38e could not be found. Apr 13 16:20:05 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:20:05 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-670063a3-2fde-47cc-b4c7-52e005bf8a2a tempest-VolumesSnapshotsTestJSON-1604074109 tempest-VolumesSnapshotsTestJSON-1604074109-project-member] Returning 404 to user: Volume 9039b70c-c6f2-47ac-8916-8fda0b51c38e could not be found. {{(pid=62055) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 16:20:05 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-670063a3-2fde-47cc-b4c7-52e005bf8a2a tempest-VolumesSnapshotsTestJSON-1604074109 tempest-VolumesSnapshotsTestJSON-1604074109-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/9039b70c-c6f2-47ac-8916-8fda0b51c38e" status: 404 len: 109 microversion: 2.1 time: 0.059654 Apr 13 16:20:05 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 24/74] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 16:20:05 2023] GET /compute/v2.1/os-volumes/9039b70c-c6f2-47ac-8916-8fda0b51c38e => generated 109 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 13 16:20:07 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-cb6aefd2-5e41-45f9-a7d4-d9aeb768e470 tempest-VolumesTestJSON-312096451 tempest-VolumesTestJSON-312096451-project-member] Calling method '.version_select at 0x7f96e5731000>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:20:07 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-cb6aefd2-5e41-45f9-a7d4-d9aeb768e470 tempest-VolumesTestJSON-312096451 tempest-VolumesTestJSON-312096451-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/2f0a4fcd-32a7-4e1c-8d55-3c057310b18c" status: 200 len: 350 microversion: 2.1 time: 0.065365 Apr 13 16:20:07 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 24/75] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 16:20:07 2023] GET /compute/v2.1/os-volumes/2f0a4fcd-32a7-4e1c-8d55-3c057310b18c => generated 350 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:20:09 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-e0e6453a-4034-4b61-b9d1-c52c83683f93 tempest-VolumesTestJSON-312096451 tempest-VolumesTestJSON-312096451-project-member] Calling method '.version_select at 0x7f96e5745900>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:20:09 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-e0e6453a-4034-4b61-b9d1-c52c83683f93 tempest-VolumesTestJSON-312096451 tempest-VolumesTestJSON-312096451-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/c484b28d-c8b7-47b9-b317-84168834d004" status: 200 len: 350 microversion: 2.1 time: 0.050133 Apr 13 16:20:09 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 28/76] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 16:20:09 2023] GET /compute/v2.1/os-volumes/c484b28d-c8b7-47b9-b317-84168834d004 => generated 350 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:20:10 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-2a922597-b98d-41de-9b7b-6ec408e681d3 tempest-VolumesTestJSON-312096451 tempest-VolumesTestJSON-312096451-project-member] Calling method '.version_select at 0x7f96e5730af0>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:20:10 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-2a922597-b98d-41de-9b7b-6ec408e681d3 tempest-VolumesTestJSON-312096451 tempest-VolumesTestJSON-312096451-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/bcbc99aa-b47e-4551-b347-828cf1d1d6fa" status: 200 len: 351 microversion: 2.1 time: 0.089937 Apr 13 16:20:10 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 25/77] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 16:20:10 2023] GET /compute/v2.1/os-volumes/bcbc99aa-b47e-4551-b347-828cf1d1d6fa => generated 351 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:20:10 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-51333dfa-c5cc-4bd9-923a-bd2da8cee023 tempest-VolumesTestJSON-312096451 tempest-VolumesTestJSON-312096451-project-member] Calling method '.version_select at 0x7f96e5730940>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:20:10 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-51333dfa-c5cc-4bd9-923a-bd2da8cee023 tempest-VolumesTestJSON-312096451 tempest-VolumesTestJSON-312096451-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.112792 Apr 13 16:20:10 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 25/78] 10.0.0.210 () {62 vars in 1211 bytes} [Thu Apr 13 16:20:10 2023] GET /compute/v2.1/os-volumes => generated 1034 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:20:10 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-2f7d8cd5-7559-4165-9b08-25bd826f4242 tempest-VolumesTestJSON-312096451 tempest-VolumesTestJSON-312096451-project-member] Calling method '.version_select at 0x7f96e57451b0>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:20:11 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-2f7d8cd5-7559-4165-9b08-25bd826f4242 tempest-VolumesTestJSON-312096451 tempest-VolumesTestJSON-312096451-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.117999 Apr 13 16:20:11 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 29/79] 10.0.0.210 () {62 vars in 1226 bytes} [Thu Apr 13 16:20:10 2023] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:20:11 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-addbed14-2845-43b0-af58-ac481b6d1cee tempest-VolumesTestJSON-312096451 tempest-VolumesTestJSON-312096451-project-member] Calling method '.version_select at 0x7f96e5730280>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:20:11 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-addbed14-2845-43b0-af58-ac481b6d1cee tempest-VolumesTestJSON-312096451 tempest-VolumesTestJSON-312096451-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.103143 Apr 13 16:20:11 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 26/80] 10.0.0.210 () {62 vars in 1211 bytes} [Thu Apr 13 16:20:11 2023] GET /compute/v2.1/os-volumes => generated 1034 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:20:11 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-a02dd869-884a-41fb-ae0e-a6e2effcbd63 tempest-VolumesTestJSON-312096451 tempest-VolumesTestJSON-312096451-project-member] Calling method '.version_select at 0x7f96e57469e0>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:20:11 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-a02dd869-884a-41fb-ae0e-a6e2effcbd63 tempest-VolumesTestJSON-312096451 tempest-VolumesTestJSON-312096451-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.092487 Apr 13 16:20:11 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 30/81] 10.0.0.210 () {62 vars in 1244 bytes} [Thu Apr 13 16:20:11 2023] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:20:11 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-427fe007-2b18-4173-a9ac-7524b5682f0e tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-700639075", "imageRef": "708622a9-7465-4492-ade8-b827198f7e30", "flavorRef": "42", "networks": [{"uuid": "ae7f770e-a460-4297-91b5-ed0b908a895a"}]}} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:20:11 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-e920d140-08e4-4289-8f07-27807bc434ce tempest-VolumesTestJSON-312096451 tempest-VolumesTestJSON-312096451-project-member] Calling method '.version_select at 0x7f96e5731900>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:20:11 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-e920d140-08e4-4289-8f07-27807bc434ce tempest-VolumesTestJSON-312096451 tempest-VolumesTestJSON-312096451-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.091285 Apr 13 16:20:11 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 27/82] 10.0.0.210 () {62 vars in 1247 bytes} [Thu Apr 13 16:20:11 2023] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:20:11 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-918a17de-49ba-439a-824b-3b3934703c9a tempest-VolumesTestJSON-312096451 tempest-VolumesTestJSON-312096451-project-member] Calling method '.version_select at 0x7f96e5745630>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:20:11 user devstack@n-api.service[62053]: DEBUG nova.network.neutron [None req-427fe007-2b18-4173-a9ac-7524b5682f0e tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] validate_networks() for [('ae7f770e-a460-4297-91b5-ed0b908a895a', None, None, None, None, None)] {{(pid=62053) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 16:20:11 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-97f2490e-fcb8-4270-90fa-ab115dfe706d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-1790980626", "imageRef": "708622a9-7465-4492-ade8-b827198f7e30", "flavorRef": "42", "networks": [{"uuid": "5a7877ff-8230-470b-90b5-e5dcfc8f0cee"}]}} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:20:11 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-918a17de-49ba-439a-824b-3b3934703c9a tempest-VolumesTestJSON-312096451 tempest-VolumesTestJSON-312096451-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.096592 Apr 13 16:20:11 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 31/83] 10.0.0.210 () {62 vars in 1232 bytes} [Thu Apr 13 16:20:11 2023] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:20:11 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-2ffdaae3-ff80-4e0d-a2ee-f405805aa89f tempest-VolumesTestJSON-312096451 tempest-VolumesTestJSON-312096451-project-member] Calling method '.version_select at 0x7f96e5747010>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:20:11 user devstack@n-api.service[62055]: DEBUG nova.network.neutron [None req-97f2490e-fcb8-4270-90fa-ab115dfe706d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] validate_networks() for [('5a7877ff-8230-470b-90b5-e5dcfc8f0cee', None, None, None, None, None)] {{(pid=62055) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 16:20:11 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-2ffdaae3-ff80-4e0d-a2ee-f405805aa89f tempest-VolumesTestJSON-312096451 tempest-VolumesTestJSON-312096451-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.120665 Apr 13 16:20:11 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 32/84] 10.0.0.210 () {62 vars in 1265 bytes} [Thu Apr 13 16:20:11 2023] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:20:11 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-a609bd20-5187-473e-95af-f38bf9a94722 tempest-VolumesTestJSON-312096451 tempest-VolumesTestJSON-312096451-project-member] Calling method '.version_select at 0x7f96e5746830>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:20:11 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-a609bd20-5187-473e-95af-f38bf9a94722 tempest-VolumesTestJSON-312096451 tempest-VolumesTestJSON-312096451-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.088211 Apr 13 16:20:11 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 33/85] 10.0.0.210 () {62 vars in 1232 bytes} [Thu Apr 13 16:20:11 2023] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:20:13 user devstack@n-api.service[62053]: DEBUG nova.virt.hardware [None req-427fe007-2b18-4173-a9ac-7524b5682f0e tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Flavor limits 0:0:0 {{(pid=62053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 16:20:13 user devstack@n-api.service[62053]: DEBUG nova.virt.hardware [None req-427fe007-2b18-4173-a9ac-7524b5682f0e tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Image limits 0:0:0 {{(pid=62053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 16:20:13 user devstack@n-api.service[62053]: DEBUG nova.virt.hardware [None req-427fe007-2b18-4173-a9ac-7524b5682f0e tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Flavor pref 0:0:0 {{(pid=62053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 16:20:13 user devstack@n-api.service[62053]: DEBUG nova.virt.hardware [None req-427fe007-2b18-4173-a9ac-7524b5682f0e tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Image pref 0:0:0 {{(pid=62053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 16:20:13 user devstack@n-api.service[62053]: DEBUG nova.virt.hardware [None req-427fe007-2b18-4173-a9ac-7524b5682f0e tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 16:20:13 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-427fe007-2b18-4173-a9ac-7524b5682f0e tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:20:13 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-427fe007-2b18-4173-a9ac-7524b5682f0e tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:20:13 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-427fe007-2b18-4173-a9ac-7524b5682f0e tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:20:13 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-427fe007-2b18-4173-a9ac-7524b5682f0e tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:20:13 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-427fe007-2b18-4173-a9ac-7524b5682f0e tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:20:13 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-427fe007-2b18-4173-a9ac-7524b5682f0e tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:20:13 user devstack@n-api.service[62053]: DEBUG nova.quota [None req-427fe007-2b18-4173-a9ac-7524b5682f0e tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Getting quotas for project 5554aa7f1b4d471b8807a845ab1ea33f. Resources: {'instances', 'cores', 'ram'} {{(pid=62053) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 16:20:13 user devstack@n-api.service[62053]: DEBUG nova.quota [None req-427fe007-2b18-4173-a9ac-7524b5682f0e tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Getting quotas for user 4ddd547d240b43ccb213e9d459082309 and project 5554aa7f1b4d471b8807a845ab1ea33f. Resources: {'instances', 'cores', 'ram'} {{(pid=62053) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 16:20:13 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-427fe007-2b18-4173-a9ac-7524b5682f0e tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Going to run 1 instances... {{(pid=62053) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 16:20:13 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-427fe007-2b18-4173-a9ac-7524b5682f0e tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] [instance: 7973e93b-6311-44ed-91ff-e861c32d0277] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='708622a9-7465-4492-ade8-b827198f7e30',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=62053) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 16:20:13 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-427fe007-2b18-4173-a9ac-7524b5682f0e tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 2.297061 Apr 13 16:20:13 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 26/86] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 16:20:11 2023] POST /compute/v2.1/servers => generated 378 bytes in 2299 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 16:20:13 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-1b97fd08-283d-4480-b5af-20f5de01e7e4 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:20:13 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-1b97fd08-283d-4480-b5af-20f5de01e7e4 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] [instance: 7973e93b-6311-44ed-91ff-e861c32d0277] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:20:13 user devstack@n-api.service[62055]: DEBUG nova.virt.hardware [None req-97f2490e-fcb8-4270-90fa-ab115dfe706d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Flavor limits 0:0:0 {{(pid=62055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 16:20:13 user devstack@n-api.service[62055]: DEBUG nova.virt.hardware [None req-97f2490e-fcb8-4270-90fa-ab115dfe706d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Image limits 0:0:0 {{(pid=62055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 16:20:13 user devstack@n-api.service[62055]: DEBUG nova.virt.hardware [None req-97f2490e-fcb8-4270-90fa-ab115dfe706d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Flavor pref 0:0:0 {{(pid=62055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 16:20:13 user devstack@n-api.service[62055]: DEBUG nova.virt.hardware [None req-97f2490e-fcb8-4270-90fa-ab115dfe706d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Image pref 0:0:0 {{(pid=62055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 16:20:13 user devstack@n-api.service[62055]: DEBUG nova.virt.hardware [None req-97f2490e-fcb8-4270-90fa-ab115dfe706d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 16:20:13 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-97f2490e-fcb8-4270-90fa-ab115dfe706d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:20:13 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-97f2490e-fcb8-4270-90fa-ab115dfe706d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:20:13 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-97f2490e-fcb8-4270-90fa-ab115dfe706d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:20:13 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-97f2490e-fcb8-4270-90fa-ab115dfe706d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:20:13 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-97f2490e-fcb8-4270-90fa-ab115dfe706d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:20:13 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-97f2490e-fcb8-4270-90fa-ab115dfe706d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:20:13 user devstack@n-api.service[62054]: DEBUG nova.policy [None req-1b97fd08-283d-4480-b5af-20f5de01e7e4 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ddd547d240b43ccb213e9d459082309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5554aa7f1b4d471b8807a845ab1ea33f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62054) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:20:13 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-1b97fd08-283d-4480-b5af-20f5de01e7e4 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7973e93b-6311-44ed-91ff-e861c32d0277" status: 200 len: 1210 microversion: 2.1 time: 0.265319 Apr 13 16:20:13 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 34/87] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:20:13 2023] GET /compute/v2.1/servers/7973e93b-6311-44ed-91ff-e861c32d0277 => generated 1210 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:20:13 user devstack@n-api.service[62055]: DEBUG nova.quota [None req-97f2490e-fcb8-4270-90fa-ab115dfe706d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Getting quotas for project b2d09a74bf684a9fb1dd1e95d6c23f3c. Resources: {'instances', 'cores', 'ram'} {{(pid=62055) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 16:20:13 user devstack@n-api.service[62055]: DEBUG nova.quota [None req-97f2490e-fcb8-4270-90fa-ab115dfe706d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Getting quotas for user e45a882dbafb4ea4976e4f45289eb2b8 and project b2d09a74bf684a9fb1dd1e95d6c23f3c. Resources: {'instances', 'cores', 'ram'} {{(pid=62055) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 16:20:13 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-97f2490e-fcb8-4270-90fa-ab115dfe706d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Going to run 1 instances... {{(pid=62055) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 16:20:13 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-97f2490e-fcb8-4270-90fa-ab115dfe706d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: f66553f5-5e1b-4f1d-8c5a-63bc340f7586] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='708622a9-7465-4492-ade8-b827198f7e30',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=62055) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 16:20:13 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-97f2490e-fcb8-4270-90fa-ab115dfe706d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 2.477738 Apr 13 16:20:13 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 28/88] 10.0.0.210 () {66 vars in 1265 bytes} [Thu Apr 13 16:20:11 2023] POST /compute/v2.1/servers => generated 378 bytes in 2479 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Apr 13 16:20:13 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-ab0f0c06-5e09-4d15-9406-86da007c0d5e tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:20:13 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-ab0f0c06-5e09-4d15-9406-86da007c0d5e tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: f66553f5-5e1b-4f1d-8c5a-63bc340f7586] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:20:14 user devstack@n-api.service[62053]: DEBUG nova.policy [None req-ab0f0c06-5e09-4d15-9406-86da007c0d5e tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45a882dbafb4ea4976e4f45289eb2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d09a74bf684a9fb1dd1e95d6c23f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62053) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:20:14 user devstack@n-api.service[62053]: DEBUG nova.policy [None req-ab0f0c06-5e09-4d15-9406-86da007c0d5e tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e45a882dbafb4ea4976e4f45289eb2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d09a74bf684a9fb1dd1e95d6c23f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62053) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:20:14 user devstack@n-api.service[62053]: DEBUG nova.policy [None req-ab0f0c06-5e09-4d15-9406-86da007c0d5e tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e45a882dbafb4ea4976e4f45289eb2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d09a74bf684a9fb1dd1e95d6c23f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62053) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:20:14 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-ab0f0c06-5e09-4d15-9406-86da007c0d5e tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f66553f5-5e1b-4f1d-8c5a-63bc340f7586" status: 200 len: 1395 microversion: 2.87 time: 0.219110 Apr 13 16:20:14 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 27/89] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 16:20:13 2023] GET /compute/v2.1/servers/f66553f5-5e1b-4f1d-8c5a-63bc340f7586 => generated 1395 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 16:20:18 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-fb5c5d8f-f929-4a7e-9533-c7c8ac391602 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Action: 'create', calling method: .version_select at 0x7f96e57457e0>, body: {"keypair": {"name": "tempest-keypair-900897003", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBssL1q8UrRqcNBzubLNJC8k8DaqQcRK2ysRGrjAyXNJmaI+jOCwcCVXwOavhCNGPOMX3O9mQsDrY3mOGMrByAQWchmBUsGQlz9ppSMT6HadSQb/fuBY4fFJZdDXCx7D8g=="}} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:20:18 user devstack@n-api.service[62054]: DEBUG nova.quota [None req-fb5c5d8f-f929-4a7e-9533-c7c8ac391602 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Getting quotas for project 7061f2f041954ffe90b0c87b422890e4. Resources: {'key_pairs'} {{(pid=62054) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 16:20:18 user devstack@n-api.service[62054]: DEBUG nova.quota [None req-fb5c5d8f-f929-4a7e-9533-c7c8ac391602 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Getting quotas for user 9bf19848229f45baad45c490cf539508 and project 7061f2f041954ffe90b0c87b422890e4. Resources: {'key_pairs'} {{(pid=62054) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 16:20:18 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-fb5c5d8f-f929-4a7e-9533-c7c8ac391602 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.385890 Apr 13 16:20:18 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 35/90] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 13 16:20:17 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:20:23 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-82991644-6a62-4c17-9e63-e90e77888680 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-865124722", "imageRef": "708622a9-7465-4492-ade8-b827198f7e30", "flavorRef": "42", "networks": [{"uuid": "39832acb-f932-4804-a559-967d9d0ae0ad"}]}} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:20:23 user devstack@n-api.service[62055]: DEBUG nova.network.neutron [None req-82991644-6a62-4c17-9e63-e90e77888680 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] validate_networks() for [('39832acb-f932-4804-a559-967d9d0ae0ad', None, None, None, None, None)] {{(pid=62055) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 16:20:23 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-211e1e8d-0be3-444a-81a4-a9dfb086e524 req-cabe0da4-679e-4f40-8875-fbb78d074488 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7973e93b-6311-44ed-91ff-e861c32d0277", "tag": "8ae83a6c-4fc7-4e2c-8f83-7aece5c239cd"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:20:23 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-211e1e8d-0be3-444a-81a4-a9dfb086e524 req-cabe0da4-679e-4f40-8875-fbb78d074488 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:20:23 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-211e1e8d-0be3-444a-81a4-a9dfb086e524 req-cabe0da4-679e-4f40-8875-fbb78d074488 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:20:23 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-211e1e8d-0be3-444a-81a4-a9dfb086e524 req-cabe0da4-679e-4f40-8875-fbb78d074488 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:20:23 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-211e1e8d-0be3-444a-81a4-a9dfb086e524 req-cabe0da4-679e-4f40-8875-fbb78d074488 service nova] Creating event network-changed:8ae83a6c-4fc7-4e2c-8f83-7aece5c239cd for instance 7973e93b-6311-44ed-91ff-e861c32d0277 on user Apr 13 16:20:23 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-211e1e8d-0be3-444a-81a4-a9dfb086e524 req-cabe0da4-679e-4f40-8875-fbb78d074488 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=62053) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 13 16:20:23 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-211e1e8d-0be3-444a-81a4-a9dfb086e524 req-cabe0da4-679e-4f40-8875-fbb78d074488 service nova] Acquired lock "compute-rpcapi-router" {{(pid=62053) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 13 16:20:23 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-ec00df3d-1b9d-44f9-ba8f-651321585824 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:20:23 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-ec00df3d-1b9d-44f9-ba8f-651321585824 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:20:23 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-ec00df3d-1b9d-44f9-ba8f-651321585824 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:20:23 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-ec00df3d-1b9d-44f9-ba8f-651321585824 None None] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:20:23 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-ec00df3d-1b9d-44f9-ba8f-651321585824 None None] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:20:23 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-ec00df3d-1b9d-44f9-ba8f-651321585824 None None] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:20:23 user devstack@n-api.service[62053]: INFO nova.compute.rpcapi [None req-ec00df3d-1b9d-44f9-ba8f-651321585824 None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 13 16:20:23 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-ec00df3d-1b9d-44f9-ba8f-651321585824 None None] Releasing lock "compute-rpcapi-router" {{(pid=62053) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 13 16:20:23 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-ec00df3d-1b9d-44f9-ba8f-651321585824 None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.162334 Apr 13 16:20:23 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 28/91] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:20:23 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:20:23 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_cell0:SELECT=2 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:20:23 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_cell1:SELECT=2 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:20:23 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_cell0:SELECT=6 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:20:24 user devstack@n-api.service[62055]: DEBUG nova.virt.hardware [None req-82991644-6a62-4c17-9e63-e90e77888680 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Flavor limits 0:0:0 {{(pid=62055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 16:20:24 user devstack@n-api.service[62055]: DEBUG nova.virt.hardware [None req-82991644-6a62-4c17-9e63-e90e77888680 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Image limits 0:0:0 {{(pid=62055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 16:20:24 user devstack@n-api.service[62055]: DEBUG nova.virt.hardware [None req-82991644-6a62-4c17-9e63-e90e77888680 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Flavor pref 0:0:0 {{(pid=62055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 16:20:24 user devstack@n-api.service[62055]: DEBUG nova.virt.hardware [None req-82991644-6a62-4c17-9e63-e90e77888680 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Image pref 0:0:0 {{(pid=62055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 16:20:24 user devstack@n-api.service[62055]: DEBUG nova.virt.hardware [None req-82991644-6a62-4c17-9e63-e90e77888680 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 16:20:24 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-82991644-6a62-4c17-9e63-e90e77888680 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:20:24 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-82991644-6a62-4c17-9e63-e90e77888680 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:20:24 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-82991644-6a62-4c17-9e63-e90e77888680 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:20:24 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-82991644-6a62-4c17-9e63-e90e77888680 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:20:24 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-82991644-6a62-4c17-9e63-e90e77888680 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:20:24 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-82991644-6a62-4c17-9e63-e90e77888680 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:20:24 user devstack@n-api.service[62055]: DEBUG nova.quota [None req-82991644-6a62-4c17-9e63-e90e77888680 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Getting quotas for project 608ff87aadc7408e9010212fd5f482b7. Resources: {'instances', 'cores', 'ram'} {{(pid=62055) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 16:20:24 user devstack@n-api.service[62055]: DEBUG nova.quota [None req-82991644-6a62-4c17-9e63-e90e77888680 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Getting quotas for user 55d232911f5742aa83146f19f13dd198 and project 608ff87aadc7408e9010212fd5f482b7. Resources: {'instances', 'cores', 'ram'} {{(pid=62055) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 16:20:24 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-82991644-6a62-4c17-9e63-e90e77888680 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Going to run 1 instances... {{(pid=62055) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 16:20:24 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-82991644-6a62-4c17-9e63-e90e77888680 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] [instance: 823749e1-56ca-44f9-be83-a36b4851c28f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='708622a9-7465-4492-ade8-b827198f7e30',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=62055) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 16:20:24 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-82991644-6a62-4c17-9e63-e90e77888680 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 1.663942 Apr 13 16:20:24 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 29/92] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 16:20:22 2023] POST /compute/v2.1/servers => generated 378 bytes in 1666 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 16:20:24 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-8a5002de-f91a-401f-ba74-9ca5cda5a6c0 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:20:24 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-8a5002de-f91a-401f-ba74-9ca5cda5a6c0 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] [instance: 823749e1-56ca-44f9-be83-a36b4851c28f] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:20:24 user devstack@n-api.service[62054]: DEBUG nova.policy [None req-8a5002de-f91a-401f-ba74-9ca5cda5a6c0 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d232911f5742aa83146f19f13dd198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608ff87aadc7408e9010212fd5f482b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62054) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:20:24 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-8a5002de-f91a-401f-ba74-9ca5cda5a6c0 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] 10.0.0.210 "GET /compute/v2.1/servers/823749e1-56ca-44f9-be83-a36b4851c28f" status: 200 len: 1208 microversion: 2.1 time: 0.183371 Apr 13 16:20:24 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 36/93] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:20:24 2023] GET /compute/v2.1/servers/823749e1-56ca-44f9-be83-a36b4851c28f => generated 1208 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:20:25 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_cell0:SELECT=8 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:20:25 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-d0cd9bd7-ebce-4ed3-924c-f4ac3d565045 req-e2ca1072-ee78-4a69-b9ab-f35530f29f57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f66553f5-5e1b-4f1d-8c5a-63bc340f7586", "tag": "27d05b76-8556-4365-9050-6bf871e85502"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:20:25 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-d0cd9bd7-ebce-4ed3-924c-f4ac3d565045 req-e2ca1072-ee78-4a69-b9ab-f35530f29f57 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:20:25 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-d0cd9bd7-ebce-4ed3-924c-f4ac3d565045 req-e2ca1072-ee78-4a69-b9ab-f35530f29f57 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:20:25 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-d0cd9bd7-ebce-4ed3-924c-f4ac3d565045 req-e2ca1072-ee78-4a69-b9ab-f35530f29f57 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:20:25 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-d0cd9bd7-ebce-4ed3-924c-f4ac3d565045 req-e2ca1072-ee78-4a69-b9ab-f35530f29f57 service nova] Creating event network-changed:27d05b76-8556-4365-9050-6bf871e85502 for instance f66553f5-5e1b-4f1d-8c5a-63bc340f7586 on user Apr 13 16:20:25 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [req-d0cd9bd7-ebce-4ed3-924c-f4ac3d565045 req-e2ca1072-ee78-4a69-b9ab-f35530f29f57 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044257 Apr 13 16:20:25 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 29/94] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:20:25 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:20:26 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-f0db01f4-bdd2-4695-a17b-6cc5c1b51736 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerStableDeviceRescueTest-server-1807441960", "imageRef": "708622a9-7465-4492-ade8-b827198f7e30", "flavorRef": "42", "networks": [{"uuid": "5a4fe0b3-5f2f-4125-a17d-e2ff424bf01a"}], "security_groups": [{"name": "tempest-securitygroup--424157064"}], "key_name": "tempest-keypair-900897003", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:20:26 user devstack@n-api.service[62055]: DEBUG nova.network.neutron [None req-f0db01f4-bdd2-4695-a17b-6cc5c1b51736 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] validate_networks() for [('5a4fe0b3-5f2f-4125-a17d-e2ff424bf01a', None, None, None, None, None)] {{(pid=62055) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 16:20:27 user devstack@n-api.service[62055]: DEBUG nova.virt.hardware [None req-f0db01f4-bdd2-4695-a17b-6cc5c1b51736 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Flavor limits 0:0:0 {{(pid=62055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 16:20:27 user devstack@n-api.service[62055]: DEBUG nova.virt.hardware [None req-f0db01f4-bdd2-4695-a17b-6cc5c1b51736 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Image limits 0:0:0 {{(pid=62055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 16:20:27 user devstack@n-api.service[62055]: DEBUG nova.virt.hardware [None req-f0db01f4-bdd2-4695-a17b-6cc5c1b51736 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Flavor pref 0:0:0 {{(pid=62055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 16:20:27 user devstack@n-api.service[62055]: DEBUG nova.virt.hardware [None req-f0db01f4-bdd2-4695-a17b-6cc5c1b51736 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Image pref 0:0:0 {{(pid=62055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 16:20:27 user devstack@n-api.service[62055]: DEBUG nova.virt.hardware [None req-f0db01f4-bdd2-4695-a17b-6cc5c1b51736 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 16:20:27 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-f0db01f4-bdd2-4695-a17b-6cc5c1b51736 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:20:27 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-f0db01f4-bdd2-4695-a17b-6cc5c1b51736 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:20:27 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-f0db01f4-bdd2-4695-a17b-6cc5c1b51736 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:20:27 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-f0db01f4-bdd2-4695-a17b-6cc5c1b51736 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:20:27 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-f0db01f4-bdd2-4695-a17b-6cc5c1b51736 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:20:27 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-f0db01f4-bdd2-4695-a17b-6cc5c1b51736 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:20:27 user devstack@n-api.service[62055]: DEBUG nova.quota [None req-f0db01f4-bdd2-4695-a17b-6cc5c1b51736 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Getting quotas for project 7061f2f041954ffe90b0c87b422890e4. Resources: {'instances', 'cores', 'ram'} {{(pid=62055) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 16:20:27 user devstack@n-api.service[62055]: DEBUG nova.quota [None req-f0db01f4-bdd2-4695-a17b-6cc5c1b51736 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Getting quotas for user 9bf19848229f45baad45c490cf539508 and project 7061f2f041954ffe90b0c87b422890e4. Resources: {'instances', 'cores', 'ram'} {{(pid=62055) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 16:20:27 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-f0db01f4-bdd2-4695-a17b-6cc5c1b51736 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Going to run 1 instances... {{(pid=62055) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 16:20:27 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-f0db01f4-bdd2-4695-a17b-6cc5c1b51736 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='708622a9-7465-4492-ade8-b827198f7e30',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=62055) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 16:20:27 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-f0db01f4-bdd2-4695-a17b-6cc5c1b51736 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 1.137571 Apr 13 16:20:27 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 30/95] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 16:20:26 2023] POST /compute/v2.1/servers => generated 403 bytes in 1141 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 16:20:27 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-9bfaeedb-fe26-4d61-9a65-32fbcecfd771 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:20:27 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-9bfaeedb-fe26-4d61-9a65-32fbcecfd771 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:20:27 user devstack@n-api.service[62054]: DEBUG nova.policy [None req-9bfaeedb-fe26-4d61-9a65-32fbcecfd771 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf19848229f45baad45c490cf539508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7061f2f041954ffe90b0c87b422890e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62054) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:20:27 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-9bfaeedb-fe26-4d61-9a65-32fbcecfd771 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bbcccf4b-e861-4254-9be3-a491776214e9" status: 200 len: 1239 microversion: 2.1 time: 0.138175 Apr 13 16:20:27 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 37/96] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:20:27 2023] GET /compute/v2.1/servers/bbcccf4b-e861-4254-9be3-a491776214e9 => generated 1239 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:20:29 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-a45bd9d7-2adf-49cd-859a-8167167bcf5f tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Action: 'create', calling method: .version_select at 0x7f96e56d9f30>, body: {"keypair": {"name": "tempest-keypair-16668737", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAcOvpOD5XjPPEJeFEcW6dxrI654P1ODhBXDII4jBiB5VjoxGbdzMtmJtJGe2JCrSo8EqpecX3xdXT+1+dP2nisICumUhzMVEIQe7hihwBIVzLzKia+yvR9Rz6xcYWfvCw=="}} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:20:29 user devstack@n-api.service[62053]: DEBUG nova.quota [None req-a45bd9d7-2adf-49cd-859a-8167167bcf5f tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Getting quotas for project 5ded8a69b7e941f9bcdc502cfeed79db. Resources: {'key_pairs'} {{(pid=62053) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 16:20:29 user devstack@n-api.service[62053]: DEBUG nova.quota [None req-a45bd9d7-2adf-49cd-859a-8167167bcf5f tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Getting quotas for user 62cf399757f544649fed18ee5a31d50c and project 5ded8a69b7e941f9bcdc502cfeed79db. Resources: {'key_pairs'} {{(pid=62053) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 16:20:29 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-a45bd9d7-2adf-49cd-859a-8167167bcf5f tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.285865 Apr 13 16:20:29 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 30/97] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 13 16:20:29 2023] POST /compute/v2.1/os-keypairs => generated 384 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:20:29 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [req-3b19d7fe-bb20-4ab7-b958-7f085d2db9cc req-5e5b866f-ac2e-42ec-bb87-7acde48d6605 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f66553f5-5e1b-4f1d-8c5a-63bc340f7586", "name": "network-vif-plugged", "status": "completed", "tag": "27d05b76-8556-4365-9050-6bf871e85502"}]} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:20:30 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-3b19d7fe-bb20-4ab7-b958-7f085d2db9cc req-5e5b866f-ac2e-42ec-bb87-7acde48d6605 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:20:30 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-3b19d7fe-bb20-4ab7-b958-7f085d2db9cc req-5e5b866f-ac2e-42ec-bb87-7acde48d6605 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:20:30 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-3b19d7fe-bb20-4ab7-b958-7f085d2db9cc req-5e5b866f-ac2e-42ec-bb87-7acde48d6605 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:20:30 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-3b19d7fe-bb20-4ab7-b958-7f085d2db9cc req-5e5b866f-ac2e-42ec-bb87-7acde48d6605 service nova] Creating event network-vif-plugged:27d05b76-8556-4365-9050-6bf871e85502 for instance f66553f5-5e1b-4f1d-8c5a-63bc340f7586 on user Apr 13 16:20:30 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-3b19d7fe-bb20-4ab7-b958-7f085d2db9cc req-5e5b866f-ac2e-42ec-bb87-7acde48d6605 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=62055) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 13 16:20:30 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-3b19d7fe-bb20-4ab7-b958-7f085d2db9cc req-5e5b866f-ac2e-42ec-bb87-7acde48d6605 service nova] Acquired lock "compute-rpcapi-router" {{(pid=62055) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 13 16:20:30 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-9ae9331d-2370-42b3-8b4a-9629ff8b3790 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:20:30 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-9ae9331d-2370-42b3-8b4a-9629ff8b3790 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:20:30 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-9ae9331d-2370-42b3-8b4a-9629ff8b3790 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:20:30 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-9ae9331d-2370-42b3-8b4a-9629ff8b3790 None None] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:20:30 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-9ae9331d-2370-42b3-8b4a-9629ff8b3790 None None] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:20:30 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-9ae9331d-2370-42b3-8b4a-9629ff8b3790 None None] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:20:30 user devstack@n-api.service[62055]: INFO nova.compute.rpcapi [None req-9ae9331d-2370-42b3-8b4a-9629ff8b3790 None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 13 16:20:30 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-9ae9331d-2370-42b3-8b4a-9629ff8b3790 None None] Releasing lock "compute-rpcapi-router" {{(pid=62055) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 13 16:20:30 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-9ae9331d-2370-42b3-8b4a-9629ff8b3790 None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.179239 Apr 13 16:20:30 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 31/98] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:20:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:20:30 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-f47f5fbd-0c1a-4835-b1fa-cede67930a1b req-4506befa-ff1f-4362-999c-bb2ef31c0bb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7973e93b-6311-44ed-91ff-e861c32d0277", "name": "network-vif-plugged", "status": "completed", "tag": "8ae83a6c-4fc7-4e2c-8f83-7aece5c239cd"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:20:30 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-f47f5fbd-0c1a-4835-b1fa-cede67930a1b req-4506befa-ff1f-4362-999c-bb2ef31c0bb1 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:20:30 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-f47f5fbd-0c1a-4835-b1fa-cede67930a1b req-4506befa-ff1f-4362-999c-bb2ef31c0bb1 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:20:30 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-f47f5fbd-0c1a-4835-b1fa-cede67930a1b req-4506befa-ff1f-4362-999c-bb2ef31c0bb1 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:20:30 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-f47f5fbd-0c1a-4835-b1fa-cede67930a1b req-4506befa-ff1f-4362-999c-bb2ef31c0bb1 service nova] Creating event network-vif-plugged:8ae83a6c-4fc7-4e2c-8f83-7aece5c239cd for instance 7973e93b-6311-44ed-91ff-e861c32d0277 on user Apr 13 16:20:30 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-f47f5fbd-0c1a-4835-b1fa-cede67930a1b req-4506befa-ff1f-4362-999c-bb2ef31c0bb1 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=62054) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 13 16:20:30 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-f47f5fbd-0c1a-4835-b1fa-cede67930a1b req-4506befa-ff1f-4362-999c-bb2ef31c0bb1 service nova] Acquired lock "compute-rpcapi-router" {{(pid=62054) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 13 16:20:30 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-f0de375e-522d-4183-82b5-fb65ef641399 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:20:30 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-f0de375e-522d-4183-82b5-fb65ef641399 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:20:30 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-f0de375e-522d-4183-82b5-fb65ef641399 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:20:30 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-f0de375e-522d-4183-82b5-fb65ef641399 None None] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:20:30 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-f0de375e-522d-4183-82b5-fb65ef641399 None None] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:20:30 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-f0de375e-522d-4183-82b5-fb65ef641399 None None] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:20:30 user devstack@n-api.service[62054]: INFO nova.compute.rpcapi [None req-f0de375e-522d-4183-82b5-fb65ef641399 None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 13 16:20:30 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-f0de375e-522d-4183-82b5-fb65ef641399 None None] Releasing lock "compute-rpcapi-router" {{(pid=62054) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 13 16:20:30 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-f0de375e-522d-4183-82b5-fb65ef641399 None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.436964 Apr 13 16:20:30 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 38/99] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:20:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:20:30 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-c2d6dff8-7759-4339-bc73-f5188ac40187 req-9876ec92-ca52-434f-936b-d24d2257b97d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "823749e1-56ca-44f9-be83-a36b4851c28f", "tag": "f4e8f99d-1c8f-44b8-84f1-0f43a156e8b0"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:20:30 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-c2d6dff8-7759-4339-bc73-f5188ac40187 req-9876ec92-ca52-434f-936b-d24d2257b97d service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:20:30 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-c2d6dff8-7759-4339-bc73-f5188ac40187 req-9876ec92-ca52-434f-936b-d24d2257b97d service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:20:30 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-c2d6dff8-7759-4339-bc73-f5188ac40187 req-9876ec92-ca52-434f-936b-d24d2257b97d service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:20:31 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-c2d6dff8-7759-4339-bc73-f5188ac40187 req-9876ec92-ca52-434f-936b-d24d2257b97d service nova] Creating event network-changed:f4e8f99d-1c8f-44b8-84f1-0f43a156e8b0 for instance 823749e1-56ca-44f9-be83-a36b4851c28f on user Apr 13 16:20:31 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [req-c2d6dff8-7759-4339-bc73-f5188ac40187 req-9876ec92-ca52-434f-936b-d24d2257b97d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077099 Apr 13 16:20:31 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 31/100] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:20:30 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:20:32 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [req-f5c08ff1-2494-4318-ae31-4279812f3d6a req-bc85f41e-3bf4-48d9-aedf-1b6f1bc8b5b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f66553f5-5e1b-4f1d-8c5a-63bc340f7586", "name": "network-vif-plugged", "status": "completed", "tag": "27d05b76-8556-4365-9050-6bf871e85502"}]} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:20:32 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-f5c08ff1-2494-4318-ae31-4279812f3d6a req-bc85f41e-3bf4-48d9-aedf-1b6f1bc8b5b1 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:20:32 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-f5c08ff1-2494-4318-ae31-4279812f3d6a req-bc85f41e-3bf4-48d9-aedf-1b6f1bc8b5b1 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:20:32 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-f5c08ff1-2494-4318-ae31-4279812f3d6a req-bc85f41e-3bf4-48d9-aedf-1b6f1bc8b5b1 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:20:32 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-f5c08ff1-2494-4318-ae31-4279812f3d6a req-bc85f41e-3bf4-48d9-aedf-1b6f1bc8b5b1 service nova] Creating event network-vif-plugged:27d05b76-8556-4365-9050-6bf871e85502 for instance f66553f5-5e1b-4f1d-8c5a-63bc340f7586 on user Apr 13 16:20:32 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [req-f5c08ff1-2494-4318-ae31-4279812f3d6a req-bc85f41e-3bf4-48d9-aedf-1b6f1bc8b5b1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058444 Apr 13 16:20:32 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 32/101] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:20:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:20:32 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-31a8b9d9-ee3a-43f1-8468-37bf1b5f6d03 req-7d3fa54c-1543-414a-84ec-e183fd87e46a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7973e93b-6311-44ed-91ff-e861c32d0277", "name": "network-vif-plugged", "status": "completed", "tag": "8ae83a6c-4fc7-4e2c-8f83-7aece5c239cd"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:20:33 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-31a8b9d9-ee3a-43f1-8468-37bf1b5f6d03 req-7d3fa54c-1543-414a-84ec-e183fd87e46a service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:20:33 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-31a8b9d9-ee3a-43f1-8468-37bf1b5f6d03 req-7d3fa54c-1543-414a-84ec-e183fd87e46a service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:20:33 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-31a8b9d9-ee3a-43f1-8468-37bf1b5f6d03 req-7d3fa54c-1543-414a-84ec-e183fd87e46a service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:20:33 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-31a8b9d9-ee3a-43f1-8468-37bf1b5f6d03 req-7d3fa54c-1543-414a-84ec-e183fd87e46a service nova] Creating event network-vif-plugged:8ae83a6c-4fc7-4e2c-8f83-7aece5c239cd for instance 7973e93b-6311-44ed-91ff-e861c32d0277 on user Apr 13 16:20:33 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [req-31a8b9d9-ee3a-43f1-8468-37bf1b5f6d03 req-7d3fa54c-1543-414a-84ec-e183fd87e46a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103480 Apr 13 16:20:33 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 39/102] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:20:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:20:34 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_cell0:SELECT=4 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:20:34 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-e7b701b2-040f-41df-9627-9c3e5c458ce6 req-18997b35-edd8-43fd-9a66-8f9600e80d89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbcccf4b-e861-4254-9be3-a491776214e9", "tag": "dbb2bf27-5de3-499c-ba4d-87867912a143"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:20:34 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-e7b701b2-040f-41df-9627-9c3e5c458ce6 req-18997b35-edd8-43fd-9a66-8f9600e80d89 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:20:34 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-e7b701b2-040f-41df-9627-9c3e5c458ce6 req-18997b35-edd8-43fd-9a66-8f9600e80d89 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:20:34 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-e7b701b2-040f-41df-9627-9c3e5c458ce6 req-18997b35-edd8-43fd-9a66-8f9600e80d89 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:20:34 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-e7b701b2-040f-41df-9627-9c3e5c458ce6 req-18997b35-edd8-43fd-9a66-8f9600e80d89 service nova] Creating event network-changed:dbb2bf27-5de3-499c-ba4d-87867912a143 for instance bbcccf4b-e861-4254-9be3-a491776214e9 on user Apr 13 16:20:34 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [req-e7b701b2-040f-41df-9627-9c3e5c458ce6 req-18997b35-edd8-43fd-9a66-8f9600e80d89 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055502 Apr 13 16:20:34 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 32/103] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:20:34 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:20:35 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [req-735b8e94-2cb8-46b8-8c9a-a396cf0c7c89 req-613521ab-f80c-4fc6-92d8-39f03a7995ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "823749e1-56ca-44f9-be83-a36b4851c28f", "name": "network-vif-plugged", "status": "completed", "tag": "f4e8f99d-1c8f-44b8-84f1-0f43a156e8b0"}]} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:20:35 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-735b8e94-2cb8-46b8-8c9a-a396cf0c7c89 req-613521ab-f80c-4fc6-92d8-39f03a7995ce service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:20:35 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-735b8e94-2cb8-46b8-8c9a-a396cf0c7c89 req-613521ab-f80c-4fc6-92d8-39f03a7995ce service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:20:35 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-735b8e94-2cb8-46b8-8c9a-a396cf0c7c89 req-613521ab-f80c-4fc6-92d8-39f03a7995ce service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:20:35 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-735b8e94-2cb8-46b8-8c9a-a396cf0c7c89 req-613521ab-f80c-4fc6-92d8-39f03a7995ce service nova] Creating event network-vif-plugged:f4e8f99d-1c8f-44b8-84f1-0f43a156e8b0 for instance 823749e1-56ca-44f9-be83-a36b4851c28f on user Apr 13 16:20:35 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [req-735b8e94-2cb8-46b8-8c9a-a396cf0c7c89 req-613521ab-f80c-4fc6-92d8-39f03a7995ce service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052290 Apr 13 16:20:35 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 33/104] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:20:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:20:37 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-49e43534-e76c-42e4-a04e-5665a0461b68 req-605ca1da-eb20-4031-977b-53ebaeedef5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "823749e1-56ca-44f9-be83-a36b4851c28f", "name": "network-vif-plugged", "status": "completed", "tag": "f4e8f99d-1c8f-44b8-84f1-0f43a156e8b0"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:20:37 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-49e43534-e76c-42e4-a04e-5665a0461b68 req-605ca1da-eb20-4031-977b-53ebaeedef5f service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:20:37 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-49e43534-e76c-42e4-a04e-5665a0461b68 req-605ca1da-eb20-4031-977b-53ebaeedef5f service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:20:37 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-49e43534-e76c-42e4-a04e-5665a0461b68 req-605ca1da-eb20-4031-977b-53ebaeedef5f service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:20:37 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-49e43534-e76c-42e4-a04e-5665a0461b68 req-605ca1da-eb20-4031-977b-53ebaeedef5f service nova] Creating event network-vif-plugged:f4e8f99d-1c8f-44b8-84f1-0f43a156e8b0 for instance 823749e1-56ca-44f9-be83-a36b4851c28f on user Apr 13 16:20:37 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [req-49e43534-e76c-42e4-a04e-5665a0461b68 req-605ca1da-eb20-4031-977b-53ebaeedef5f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079036 Apr 13 16:20:37 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 40/105] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:20:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:20:37 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-59e8e03a-366d-482d-b5c3-cb26296981c9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1388049835", "imageRef": "708622a9-7465-4492-ade8-b827198f7e30", "flavorRef": "42", "networks": [{"uuid": "fc7f5f86-d676-4a45-b0f4-c93f3eae043e"}], "security_groups": [{"name": "tempest-securitygroup--1633138825"}], "key_name": "tempest-keypair-16668737", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:20:37 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=4 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:20:38 user devstack@n-api.service[62053]: DEBUG nova.network.neutron [None req-59e8e03a-366d-482d-b5c3-cb26296981c9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] validate_networks() for [('fc7f5f86-d676-4a45-b0f4-c93f3eae043e', None, None, None, None, None)] {{(pid=62053) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 16:20:39 user devstack@n-api.service[62053]: DEBUG nova.virt.hardware [None req-59e8e03a-366d-482d-b5c3-cb26296981c9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Flavor limits 0:0:0 {{(pid=62053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 16:20:39 user devstack@n-api.service[62053]: DEBUG nova.virt.hardware [None req-59e8e03a-366d-482d-b5c3-cb26296981c9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Image limits 0:0:0 {{(pid=62053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 16:20:39 user devstack@n-api.service[62053]: DEBUG nova.virt.hardware [None req-59e8e03a-366d-482d-b5c3-cb26296981c9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Flavor pref 0:0:0 {{(pid=62053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 16:20:39 user devstack@n-api.service[62053]: DEBUG nova.virt.hardware [None req-59e8e03a-366d-482d-b5c3-cb26296981c9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Image pref 0:0:0 {{(pid=62053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 16:20:39 user devstack@n-api.service[62053]: DEBUG nova.virt.hardware [None req-59e8e03a-366d-482d-b5c3-cb26296981c9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 16:20:39 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-59e8e03a-366d-482d-b5c3-cb26296981c9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:20:39 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-59e8e03a-366d-482d-b5c3-cb26296981c9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:20:39 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-59e8e03a-366d-482d-b5c3-cb26296981c9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:20:39 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-59e8e03a-366d-482d-b5c3-cb26296981c9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:20:39 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-59e8e03a-366d-482d-b5c3-cb26296981c9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:20:39 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-59e8e03a-366d-482d-b5c3-cb26296981c9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:20:39 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_cell1:SELECT=13 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:20:39 user devstack@n-api.service[62053]: DEBUG nova.quota [None req-59e8e03a-366d-482d-b5c3-cb26296981c9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Getting quotas for project 5ded8a69b7e941f9bcdc502cfeed79db. Resources: {'instances', 'cores', 'ram'} {{(pid=62053) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 16:20:39 user devstack@n-api.service[62053]: DEBUG nova.quota [None req-59e8e03a-366d-482d-b5c3-cb26296981c9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Getting quotas for user 62cf399757f544649fed18ee5a31d50c and project 5ded8a69b7e941f9bcdc502cfeed79db. Resources: {'instances', 'cores', 'ram'} {{(pid=62053) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 16:20:39 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-59e8e03a-366d-482d-b5c3-cb26296981c9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Going to run 1 instances... {{(pid=62053) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 16:20:39 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-59e8e03a-366d-482d-b5c3-cb26296981c9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] [instance: 5db1cb51-2e5a-46c9-8914-cba759a96a65] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='708622a9-7465-4492-ade8-b827198f7e30',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=62053) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 16:20:39 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_cell0:SELECT=12 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:20:39 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [req-096486f4-dc82-47a3-979f-055e6b278f7e req-1aa40b41-0c19-4730-8bdd-045d617a883c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbcccf4b-e861-4254-9be3-a491776214e9", "name": "network-vif-plugged", "status": "completed", "tag": "dbb2bf27-5de3-499c-ba4d-87867912a143"}]} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:20:39 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-096486f4-dc82-47a3-979f-055e6b278f7e req-1aa40b41-0c19-4730-8bdd-045d617a883c service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:20:39 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-096486f4-dc82-47a3-979f-055e6b278f7e req-1aa40b41-0c19-4730-8bdd-045d617a883c service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:20:39 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-096486f4-dc82-47a3-979f-055e6b278f7e req-1aa40b41-0c19-4730-8bdd-045d617a883c service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:20:39 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-096486f4-dc82-47a3-979f-055e6b278f7e req-1aa40b41-0c19-4730-8bdd-045d617a883c service nova] Creating event network-vif-plugged:dbb2bf27-5de3-499c-ba4d-87867912a143 for instance bbcccf4b-e861-4254-9be3-a491776214e9 on user Apr 13 16:20:39 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-59e8e03a-366d-482d-b5c3-cb26296981c9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.525913 Apr 13 16:20:39 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 33/106] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 16:20:37 2023] POST /compute/v2.1/servers => generated 404 bytes in 1530 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 16:20:39 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [req-096486f4-dc82-47a3-979f-055e6b278f7e req-1aa40b41-0c19-4730-8bdd-045d617a883c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059085 Apr 13 16:20:39 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 34/107] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:20:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:20:39 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-90fb8602-6702-439d-9177-335be3da103e tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:20:39 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-90fb8602-6702-439d-9177-335be3da103e tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] [instance: 5db1cb51-2e5a-46c9-8914-cba759a96a65] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:20:39 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_cell0:SELECT=10 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:20:39 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:20:39 user devstack@n-api.service[62054]: DEBUG nova.policy [None req-90fb8602-6702-439d-9177-335be3da103e tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cf399757f544649fed18ee5a31d50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ded8a69b7e941f9bcdc502cfeed79db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62054) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:20:39 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-90fb8602-6702-439d-9177-335be3da103e tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5db1cb51-2e5a-46c9-8914-cba759a96a65" status: 200 len: 1234 microversion: 2.1 time: 0.230368 Apr 13 16:20:39 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 41/108] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:20:39 2023] GET /compute/v2.1/servers/5db1cb51-2e5a-46c9-8914-cba759a96a65 => generated 1234 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 13 16:20:41 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-e96b62c7-4452-4a14-83c0-0f2544e0be1d req-ffbe72d9-b7bd-4b40-90a8-857a73edeb26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbcccf4b-e861-4254-9be3-a491776214e9", "name": "network-vif-plugged", "status": "completed", "tag": "dbb2bf27-5de3-499c-ba4d-87867912a143"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:20:41 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-e96b62c7-4452-4a14-83c0-0f2544e0be1d req-ffbe72d9-b7bd-4b40-90a8-857a73edeb26 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:20:41 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-e96b62c7-4452-4a14-83c0-0f2544e0be1d req-ffbe72d9-b7bd-4b40-90a8-857a73edeb26 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:20:41 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-e96b62c7-4452-4a14-83c0-0f2544e0be1d req-ffbe72d9-b7bd-4b40-90a8-857a73edeb26 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:20:41 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-e96b62c7-4452-4a14-83c0-0f2544e0be1d req-ffbe72d9-b7bd-4b40-90a8-857a73edeb26 service nova] Creating event network-vif-plugged:dbb2bf27-5de3-499c-ba4d-87867912a143 for instance bbcccf4b-e861-4254-9be3-a491776214e9 on user Apr 13 16:20:41 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [req-e96b62c7-4452-4a14-83c0-0f2544e0be1d req-ffbe72d9-b7bd-4b40-90a8-857a73edeb26 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068247 Apr 13 16:20:41 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 34/109] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:20:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:20:44 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_cell0:SELECT=6 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:20:44 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [req-7ddbeb00-d0cc-4602-899d-d459732c299d req-d1ca2e59-da9e-4729-9d2b-88be883294c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5db1cb51-2e5a-46c9-8914-cba759a96a65", "tag": "628a1eb7-e3f1-4158-9f9e-1ae752c91c0b"}]} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:20:44 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=9 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:20:44 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-7ddbeb00-d0cc-4602-899d-d459732c299d req-d1ca2e59-da9e-4729-9d2b-88be883294c0 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:20:44 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-7ddbeb00-d0cc-4602-899d-d459732c299d req-d1ca2e59-da9e-4729-9d2b-88be883294c0 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:20:44 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-7ddbeb00-d0cc-4602-899d-d459732c299d req-d1ca2e59-da9e-4729-9d2b-88be883294c0 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:20:44 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-7ddbeb00-d0cc-4602-899d-d459732c299d req-d1ca2e59-da9e-4729-9d2b-88be883294c0 service nova] Creating event network-changed:628a1eb7-e3f1-4158-9f9e-1ae752c91c0b for instance 5db1cb51-2e5a-46c9-8914-cba759a96a65 on user Apr 13 16:20:44 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [req-7ddbeb00-d0cc-4602-899d-d459732c299d req-d1ca2e59-da9e-4729-9d2b-88be883294c0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060472 Apr 13 16:20:44 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 35/110] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:20:44 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:20:48 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-d355a0d2-c005-41b8-9bff-8147c86a5436 req-584ad706-ca05-4fae-a759-4e7f0d517176 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5db1cb51-2e5a-46c9-8914-cba759a96a65", "name": "network-vif-plugged", "status": "completed", "tag": "628a1eb7-e3f1-4158-9f9e-1ae752c91c0b"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:20:48 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_cell0:SELECT=2 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:20:48 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_cell1:SELECT=8 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:20:48 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-d355a0d2-c005-41b8-9bff-8147c86a5436 req-584ad706-ca05-4fae-a759-4e7f0d517176 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:20:48 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-d355a0d2-c005-41b8-9bff-8147c86a5436 req-584ad706-ca05-4fae-a759-4e7f0d517176 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:20:48 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-d355a0d2-c005-41b8-9bff-8147c86a5436 req-584ad706-ca05-4fae-a759-4e7f0d517176 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:20:48 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-d355a0d2-c005-41b8-9bff-8147c86a5436 req-584ad706-ca05-4fae-a759-4e7f0d517176 service nova] Creating event network-vif-plugged:628a1eb7-e3f1-4158-9f9e-1ae752c91c0b for instance 5db1cb51-2e5a-46c9-8914-cba759a96a65 on user Apr 13 16:20:48 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [req-d355a0d2-c005-41b8-9bff-8147c86a5436 req-584ad706-ca05-4fae-a759-4e7f0d517176 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053588 Apr 13 16:20:48 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 42/111] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:20:48 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:20:49 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_cell0:SELECT=2 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:20:49 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_cell0:SELECT=10 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:20:49 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-fb70eadc-68bf-4f7b-a8ca-5f53611bcdd8 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Action: 'create', calling method: .version_select at 0x7f96e56d9990>, body: {"keypair": {"name": "tempest-keypair-420366585", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKRbzNSMC33JpjfFNT2r74GnYkef8HT04SCtROQjyE6kxj3jEL5OVrLCY3/Vs9414NnlDaybdZ+OiSgBfWjJgF0eyNdGY+70v0keT0GP3beXZnMvCbkO5Jb+eWMj3MAj/g=="}} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:20:49 user devstack@n-api.service[62053]: DEBUG nova.quota [None req-fb70eadc-68bf-4f7b-a8ca-5f53611bcdd8 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Getting quotas for project a6365a1e8d6c48499d4b8921244d92a9. Resources: {'key_pairs'} {{(pid=62053) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 16:20:49 user devstack@n-api.service[62053]: DEBUG nova.quota [None req-fb70eadc-68bf-4f7b-a8ca-5f53611bcdd8 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Getting quotas for user 0b143a8db8a3410eb09b21ced7bd883e and project a6365a1e8d6c48499d4b8921244d92a9. Resources: {'key_pairs'} {{(pid=62053) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 16:20:49 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-fb70eadc-68bf-4f7b-a8ca-5f53611bcdd8 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.294456 Apr 13 16:20:49 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 35/112] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 13 16:20:49 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:20:50 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [req-71336ca3-b3f5-4fa9-b2c9-396034986d35 req-95004ee8-ed2f-454b-92bd-004d71612e54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5db1cb51-2e5a-46c9-8914-cba759a96a65", "name": "network-vif-plugged", "status": "completed", "tag": "628a1eb7-e3f1-4158-9f9e-1ae752c91c0b"}]} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:20:50 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-71336ca3-b3f5-4fa9-b2c9-396034986d35 req-95004ee8-ed2f-454b-92bd-004d71612e54 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:20:50 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-71336ca3-b3f5-4fa9-b2c9-396034986d35 req-95004ee8-ed2f-454b-92bd-004d71612e54 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:20:50 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-71336ca3-b3f5-4fa9-b2c9-396034986d35 req-95004ee8-ed2f-454b-92bd-004d71612e54 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:20:50 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-71336ca3-b3f5-4fa9-b2c9-396034986d35 req-95004ee8-ed2f-454b-92bd-004d71612e54 service nova] Creating event network-vif-plugged:628a1eb7-e3f1-4158-9f9e-1ae752c91c0b for instance 5db1cb51-2e5a-46c9-8914-cba759a96a65 on user Apr 13 16:20:50 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [req-71336ca3-b3f5-4fa9-b2c9-396034986d35 req-95004ee8-ed2f-454b-92bd-004d71612e54 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060441 Apr 13 16:20:50 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 36/113] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:20:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:20:51 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-7c6f31e7-806d-4b11-9302-4bddd57294b7 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-388983342", "imageRef": "01cb01f7-9c27-41ff-9feb-78a78b8b56e5", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "a2a5ab65-4be4-4535-b98e-a8eeaedddee8"}], "security_groups": [{"name": "tempest-securitygroup--1463847644"}], "key_name": "tempest-keypair-420366585", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:20:51 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_cell0:SELECT=2 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:20:52 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_cell1:SELECT=3 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:20:52 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-6b5d2b6f-e448-4c5c-83d3-0e3ca14420cf tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Action: 'create', calling method: .version_select at 0x7f96e4d1d870>, body: {"keypair": {"name": "tempest-keypair-1417187439", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBWY8/7V40qoMYXykoaVvCoJjrpmcKaWXZmsd/8+Lb8oyd/Yg0tsO1LpDqufWXWHL1gAGa6iD4duZNpIqxl7Bq6NQSSW0wh5DQqKcPrR1DjWUD1wKrr8S3Bqu6djvLW5dQ=="}} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:20:52 user devstack@n-api.service[62053]: DEBUG nova.quota [None req-6b5d2b6f-e448-4c5c-83d3-0e3ca14420cf tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Getting quotas for project dc3e2169a6c44d05b2a2eedbe3a063cb. Resources: {'key_pairs'} {{(pid=62053) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 16:20:52 user devstack@n-api.service[62053]: DEBUG nova.quota [None req-6b5d2b6f-e448-4c5c-83d3-0e3ca14420cf tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Getting quotas for user 25b5e87b35e0471cafe541fdf224b5bd and project dc3e2169a6c44d05b2a2eedbe3a063cb. Resources: {'key_pairs'} {{(pid=62053) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 16:20:52 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-6b5d2b6f-e448-4c5c-83d3-0e3ca14420cf tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.083971 Apr 13 16:20:52 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 36/114] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 13 16:20:52 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:20:52 user devstack@n-api.service[62054]: DEBUG nova.network.neutron [None req-7c6f31e7-806d-4b11-9302-4bddd57294b7 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] validate_networks() for [('a2a5ab65-4be4-4535-b98e-a8eeaedddee8', None, None, None, None, None)] {{(pid=62054) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 16:20:53 user devstack@n-api.service[62054]: DEBUG nova.virt.hardware [None req-7c6f31e7-806d-4b11-9302-4bddd57294b7 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Flavor limits 0:0:0 {{(pid=62054) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 16:20:53 user devstack@n-api.service[62054]: DEBUG nova.virt.hardware [None req-7c6f31e7-806d-4b11-9302-4bddd57294b7 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Image limits 0:0:0 {{(pid=62054) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 16:20:53 user devstack@n-api.service[62054]: DEBUG nova.virt.hardware [None req-7c6f31e7-806d-4b11-9302-4bddd57294b7 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Flavor pref 0:0:0 {{(pid=62054) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 16:20:53 user devstack@n-api.service[62054]: DEBUG nova.virt.hardware [None req-7c6f31e7-806d-4b11-9302-4bddd57294b7 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Image pref 0:0:0 {{(pid=62054) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 16:20:53 user devstack@n-api.service[62054]: DEBUG nova.virt.hardware [None req-7c6f31e7-806d-4b11-9302-4bddd57294b7 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62054) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 16:20:53 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-7c6f31e7-806d-4b11-9302-4bddd57294b7 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:20:53 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-7c6f31e7-806d-4b11-9302-4bddd57294b7 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:20:53 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-7c6f31e7-806d-4b11-9302-4bddd57294b7 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:20:53 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-7c6f31e7-806d-4b11-9302-4bddd57294b7 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:20:53 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-7c6f31e7-806d-4b11-9302-4bddd57294b7 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:20:53 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-7c6f31e7-806d-4b11-9302-4bddd57294b7 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:20:53 user devstack@n-api.service[62054]: DEBUG nova.quota [None req-7c6f31e7-806d-4b11-9302-4bddd57294b7 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Getting quotas for project a6365a1e8d6c48499d4b8921244d92a9. Resources: {'instances', 'cores', 'ram'} {{(pid=62054) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 16:20:53 user devstack@n-api.service[62054]: DEBUG nova.quota [None req-7c6f31e7-806d-4b11-9302-4bddd57294b7 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Getting quotas for user 0b143a8db8a3410eb09b21ced7bd883e and project a6365a1e8d6c48499d4b8921244d92a9. Resources: {'instances', 'cores', 'ram'} {{(pid=62054) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 16:20:53 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-7c6f31e7-806d-4b11-9302-4bddd57294b7 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Going to run 1 instances... {{(pid=62054) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 16:20:53 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-7c6f31e7-806d-4b11-9302-4bddd57294b7 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] [instance: cf54be22-2a5d-40c4-8a1a-0060c77f83f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='01cb01f7-9c27-41ff-9feb-78a78b8b56e5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=62054) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 16:20:53 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-7c6f31e7-806d-4b11-9302-4bddd57294b7 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.250971 Apr 13 16:20:53 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 43/115] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 16:20:51 2023] POST /compute/v2.1/servers => generated 404 bytes in 1253 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 16:20:53 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-d3f5bc9f-6baf-4751-9b72-b46988942b95 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:20:53 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-d3f5bc9f-6baf-4751-9b72-b46988942b95 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] [instance: cf54be22-2a5d-40c4-8a1a-0060c77f83f6] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:20:53 user devstack@n-api.service[62055]: DEBUG nova.policy [None req-d3f5bc9f-6baf-4751-9b72-b46988942b95 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b143a8db8a3410eb09b21ced7bd883e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6365a1e8d6c48499d4b8921244d92a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62055) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:20:53 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-d3f5bc9f-6baf-4751-9b72-b46988942b95 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cf54be22-2a5d-40c4-8a1a-0060c77f83f6" status: 200 len: 1238 microversion: 2.1 time: 0.132264 Apr 13 16:20:53 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 37/116] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:20:53 2023] GET /compute/v2.1/servers/cf54be22-2a5d-40c4-8a1a-0060c77f83f6 => generated 1238 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:20:53 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-c288f58e-9ce6-4120-b7ca-12a8bbdd7b2e tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeSwap-server-1610258271", "imageRef": "708622a9-7465-4492-ade8-b827198f7e30", "flavorRef": "42", "networks": [{"uuid": "dcb487d2-a611-4040-903e-8e1c9c496e02"}], "security_groups": [{"name": "tempest-securitygroup--2107893489"}], "key_name": "tempest-keypair-1417187439", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:20:54 user devstack@n-api.service[62053]: DEBUG nova.network.neutron [None req-c288f58e-9ce6-4120-b7ca-12a8bbdd7b2e tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] validate_networks() for [('dcb487d2-a611-4040-903e-8e1c9c496e02', None, None, None, None, None)] {{(pid=62053) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 16:20:54 user devstack@n-api.service[62053]: DEBUG nova.virt.hardware [None req-c288f58e-9ce6-4120-b7ca-12a8bbdd7b2e tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Flavor limits 0:0:0 {{(pid=62053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 16:20:54 user devstack@n-api.service[62053]: DEBUG nova.virt.hardware [None req-c288f58e-9ce6-4120-b7ca-12a8bbdd7b2e tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Image limits 0:0:0 {{(pid=62053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 16:20:54 user devstack@n-api.service[62053]: DEBUG nova.virt.hardware [None req-c288f58e-9ce6-4120-b7ca-12a8bbdd7b2e tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Flavor pref 0:0:0 {{(pid=62053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 16:20:54 user devstack@n-api.service[62053]: DEBUG nova.virt.hardware [None req-c288f58e-9ce6-4120-b7ca-12a8bbdd7b2e tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Image pref 0:0:0 {{(pid=62053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 16:20:54 user devstack@n-api.service[62053]: DEBUG nova.virt.hardware [None req-c288f58e-9ce6-4120-b7ca-12a8bbdd7b2e tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 16:20:54 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-c288f58e-9ce6-4120-b7ca-12a8bbdd7b2e tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:20:54 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-c288f58e-9ce6-4120-b7ca-12a8bbdd7b2e tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:20:54 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-c288f58e-9ce6-4120-b7ca-12a8bbdd7b2e tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:20:54 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-c288f58e-9ce6-4120-b7ca-12a8bbdd7b2e tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:20:54 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-c288f58e-9ce6-4120-b7ca-12a8bbdd7b2e tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:20:54 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-c288f58e-9ce6-4120-b7ca-12a8bbdd7b2e tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:20:54 user devstack@n-api.service[62053]: DEBUG nova.quota [None req-c288f58e-9ce6-4120-b7ca-12a8bbdd7b2e tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Getting quotas for project dc3e2169a6c44d05b2a2eedbe3a063cb. Resources: {'instances', 'cores', 'ram'} {{(pid=62053) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 16:20:54 user devstack@n-api.service[62053]: DEBUG nova.quota [None req-c288f58e-9ce6-4120-b7ca-12a8bbdd7b2e tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Getting quotas for user 25b5e87b35e0471cafe541fdf224b5bd and project dc3e2169a6c44d05b2a2eedbe3a063cb. Resources: {'instances', 'cores', 'ram'} {{(pid=62053) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 16:20:54 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-c288f58e-9ce6-4120-b7ca-12a8bbdd7b2e tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Going to run 1 instances... {{(pid=62053) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 16:20:54 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-c288f58e-9ce6-4120-b7ca-12a8bbdd7b2e tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] [instance: 8c6d8096-853b-4091-ad82-6faf8ffc85fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='708622a9-7465-4492-ade8-b827198f7e30',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=62053) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 16:20:54 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-c288f58e-9ce6-4120-b7ca-12a8bbdd7b2e tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.878175 Apr 13 16:20:54 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 37/117] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 16:20:53 2023] POST /compute/v2.1/servers => generated 404 bytes in 880 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 16:20:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-9f720834-57d7-489c-9c59-f4ac8728901b tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:20:54 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-9f720834-57d7-489c-9c59-f4ac8728901b tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] [instance: 8c6d8096-853b-4091-ad82-6faf8ffc85fa] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:20:54 user devstack@n-api.service[62054]: DEBUG nova.policy [None req-9f720834-57d7-489c-9c59-f4ac8728901b tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b5e87b35e0471cafe541fdf224b5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc3e2169a6c44d05b2a2eedbe3a063cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62054) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:20:54 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-9f720834-57d7-489c-9c59-f4ac8728901b tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8c6d8096-853b-4091-ad82-6faf8ffc85fa" status: 200 len: 1226 microversion: 2.1 time: 0.102743 Apr 13 16:20:54 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 44/118] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:20:54 2023] GET /compute/v2.1/servers/8c6d8096-853b-4091-ad82-6faf8ffc85fa => generated 1226 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:20:57 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [req-74b62c21-90ca-4e05-9c9e-19edf820553e req-97f9dd81-5052-40ae-a1ab-41962ac4f0a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf54be22-2a5d-40c4-8a1a-0060c77f83f6", "tag": "3e9128bc-6e2e-4c5e-bf37-1142304eff26"}]} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:20:57 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-74b62c21-90ca-4e05-9c9e-19edf820553e req-97f9dd81-5052-40ae-a1ab-41962ac4f0a6 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:20:57 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-74b62c21-90ca-4e05-9c9e-19edf820553e req-97f9dd81-5052-40ae-a1ab-41962ac4f0a6 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:20:57 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-74b62c21-90ca-4e05-9c9e-19edf820553e req-97f9dd81-5052-40ae-a1ab-41962ac4f0a6 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:20:57 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_cell1:SELECT=19 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:20:57 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-74b62c21-90ca-4e05-9c9e-19edf820553e req-97f9dd81-5052-40ae-a1ab-41962ac4f0a6 service nova] Creating event network-changed:3e9128bc-6e2e-4c5e-bf37-1142304eff26 for instance cf54be22-2a5d-40c4-8a1a-0060c77f83f6 on user Apr 13 16:20:57 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [req-74b62c21-90ca-4e05-9c9e-19edf820553e req-97f9dd81-5052-40ae-a1ab-41962ac4f0a6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039373 Apr 13 16:20:57 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 38/119] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:20:57 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:20:59 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-6a5556dd-d9f6-4654-bff8-cac6a8cb4da9 req-6c86355e-124d-41f3-ae30-a70755478fab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c6d8096-853b-4091-ad82-6faf8ffc85fa", "tag": "385dec44-4145-4606-b0af-30fbc721eb2c"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:21:00 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-6a5556dd-d9f6-4654-bff8-cac6a8cb4da9 req-6c86355e-124d-41f3-ae30-a70755478fab service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:21:00 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-6a5556dd-d9f6-4654-bff8-cac6a8cb4da9 req-6c86355e-124d-41f3-ae30-a70755478fab service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:21:00 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-6a5556dd-d9f6-4654-bff8-cac6a8cb4da9 req-6c86355e-124d-41f3-ae30-a70755478fab service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:21:00 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-6a5556dd-d9f6-4654-bff8-cac6a8cb4da9 req-6c86355e-124d-41f3-ae30-a70755478fab service nova] Creating event network-changed:385dec44-4145-4606-b0af-30fbc721eb2c for instance 8c6d8096-853b-4091-ad82-6faf8ffc85fa on user Apr 13 16:21:00 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [req-6a5556dd-d9f6-4654-bff8-cac6a8cb4da9 req-6c86355e-124d-41f3-ae30-a70755478fab service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049677 Apr 13 16:21:00 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 38/120] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:20:59 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:21:03 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-4d2564a2-5a3a-4123-9df6-b97da2d529d0 req-d4445dc7-ea50-485c-8d1f-e4cf76d03661 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c6d8096-853b-4091-ad82-6faf8ffc85fa", "name": "network-vif-plugged", "status": "completed", "tag": "385dec44-4145-4606-b0af-30fbc721eb2c"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:21:03 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-4d2564a2-5a3a-4123-9df6-b97da2d529d0 req-d4445dc7-ea50-485c-8d1f-e4cf76d03661 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:21:03 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-4d2564a2-5a3a-4123-9df6-b97da2d529d0 req-d4445dc7-ea50-485c-8d1f-e4cf76d03661 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:21:03 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-4d2564a2-5a3a-4123-9df6-b97da2d529d0 req-d4445dc7-ea50-485c-8d1f-e4cf76d03661 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:21:03 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_cell0:SELECT=2 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:21:03 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-4d2564a2-5a3a-4123-9df6-b97da2d529d0 req-d4445dc7-ea50-485c-8d1f-e4cf76d03661 service nova] Creating event network-vif-plugged:385dec44-4145-4606-b0af-30fbc721eb2c for instance 8c6d8096-853b-4091-ad82-6faf8ffc85fa on user Apr 13 16:21:03 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [req-4d2564a2-5a3a-4123-9df6-b97da2d529d0 req-d4445dc7-ea50-485c-8d1f-e4cf76d03661 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057829 Apr 13 16:21:03 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 45/121] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:21:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:21:03 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_cell0:SELECT=2 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:21:03 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-3a607fdb-0165-4beb-8044-7bdc279d568d tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:21:03 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-3a607fdb-0165-4beb-8044-7bdc279d568d tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] [instance: 7973e93b-6311-44ed-91ff-e861c32d0277] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:21:03 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-3a607fdb-0165-4beb-8044-7bdc279d568d tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:21:03 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-3a607fdb-0165-4beb-8044-7bdc279d568d tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:21:03 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-3a607fdb-0165-4beb-8044-7bdc279d568d tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:21:03 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-3a607fdb-0165-4beb-8044-7bdc279d568d tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:21:03 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-3a607fdb-0165-4beb-8044-7bdc279d568d tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:21:03 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-3a607fdb-0165-4beb-8044-7bdc279d568d tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:21:04 user devstack@n-api.service[62055]: DEBUG nova.policy [None req-3a607fdb-0165-4beb-8044-7bdc279d568d tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ddd547d240b43ccb213e9d459082309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5554aa7f1b4d471b8807a845ab1ea33f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62055) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:21:04 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-3a607fdb-0165-4beb-8044-7bdc279d568d tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7973e93b-6311-44ed-91ff-e861c32d0277" status: 200 len: 1493 microversion: 2.1 time: 0.330459 Apr 13 16:21:04 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 39/122] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:21:03 2023] GET /compute/v2.1/servers/7973e93b-6311-44ed-91ff-e861c32d0277 => generated 1493 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:21:04 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-02a29b5a-e910-4508-b920-f6a9c020e663 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:21:04 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-02a29b5a-e910-4508-b920-f6a9c020e663 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: f66553f5-5e1b-4f1d-8c5a-63bc340f7586] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:21:04 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-02a29b5a-e910-4508-b920-f6a9c020e663 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:21:04 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-02a29b5a-e910-4508-b920-f6a9c020e663 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:21:04 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-02a29b5a-e910-4508-b920-f6a9c020e663 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:21:04 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-02a29b5a-e910-4508-b920-f6a9c020e663 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:21:04 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-02a29b5a-e910-4508-b920-f6a9c020e663 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:21:04 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-02a29b5a-e910-4508-b920-f6a9c020e663 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:21:04 user devstack@n-api.service[62053]: DEBUG nova.policy [None req-02a29b5a-e910-4508-b920-f6a9c020e663 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45a882dbafb4ea4976e4f45289eb2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d09a74bf684a9fb1dd1e95d6c23f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62053) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:21:04 user devstack@n-api.service[62053]: DEBUG nova.policy [None req-02a29b5a-e910-4508-b920-f6a9c020e663 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e45a882dbafb4ea4976e4f45289eb2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d09a74bf684a9fb1dd1e95d6c23f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62053) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:21:04 user devstack@n-api.service[62053]: DEBUG nova.policy [None req-02a29b5a-e910-4508-b920-f6a9c020e663 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e45a882dbafb4ea4976e4f45289eb2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d09a74bf684a9fb1dd1e95d6c23f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62053) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:21:04 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-02a29b5a-e910-4508-b920-f6a9c020e663 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f66553f5-5e1b-4f1d-8c5a-63bc340f7586" status: 200 len: 1691 microversion: 2.87 time: 0.287281 Apr 13 16:21:04 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 39/123] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 16:21:04 2023] GET /compute/v2.1/servers/f66553f5-5e1b-4f1d-8c5a-63bc340f7586 => generated 1691 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 16:21:05 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_cell0:SELECT=8 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:21:05 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-1e80780c-329c-4d02-b4e8-d4a0d57425e3 req-6661567e-8f19-4ff9-b40a-2da80fcd12fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c6d8096-853b-4091-ad82-6faf8ffc85fa", "name": "network-vif-plugged", "status": "completed", "tag": "385dec44-4145-4606-b0af-30fbc721eb2c"}, {"server_uuid": "cf54be22-2a5d-40c4-8a1a-0060c77f83f6", "name": "network-vif-plugged", "status": "completed", "tag": "3e9128bc-6e2e-4c5e-bf37-1142304eff26"}, {"server_uuid": "cf54be22-2a5d-40c4-8a1a-0060c77f83f6", "name": "network-vif-plugged", "status": "completed", "tag": "3e9128bc-6e2e-4c5e-bf37-1142304eff26"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:21:05 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-1e80780c-329c-4d02-b4e8-d4a0d57425e3 req-6661567e-8f19-4ff9-b40a-2da80fcd12fd service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:21:05 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-1e80780c-329c-4d02-b4e8-d4a0d57425e3 req-6661567e-8f19-4ff9-b40a-2da80fcd12fd service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:21:05 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-1e80780c-329c-4d02-b4e8-d4a0d57425e3 req-6661567e-8f19-4ff9-b40a-2da80fcd12fd service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:21:05 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-1e80780c-329c-4d02-b4e8-d4a0d57425e3 req-6661567e-8f19-4ff9-b40a-2da80fcd12fd service nova] Creating event network-vif-plugged:385dec44-4145-4606-b0af-30fbc721eb2c for instance 8c6d8096-853b-4091-ad82-6faf8ffc85fa on user Apr 13 16:21:05 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-1e80780c-329c-4d02-b4e8-d4a0d57425e3 req-6661567e-8f19-4ff9-b40a-2da80fcd12fd service nova] Creating event network-vif-plugged:3e9128bc-6e2e-4c5e-bf37-1142304eff26 for instance cf54be22-2a5d-40c4-8a1a-0060c77f83f6 on user Apr 13 16:21:05 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-1e80780c-329c-4d02-b4e8-d4a0d57425e3 req-6661567e-8f19-4ff9-b40a-2da80fcd12fd service nova] Creating event network-vif-plugged:3e9128bc-6e2e-4c5e-bf37-1142304eff26 for instance cf54be22-2a5d-40c4-8a1a-0060c77f83f6 on user Apr 13 16:21:05 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [req-1e80780c-329c-4d02-b4e8-d4a0d57425e3 req-6661567e-8f19-4ff9-b40a-2da80fcd12fd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.046456 Apr 13 16:21:05 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 46/124] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:21:05 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:21:14 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_api:SELECT=11 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:21:14 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_cell1:SELECT=7 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:21:14 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-fd28b707-2614-4d40-9363-cb5b60bb8ab3 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:21:14 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-fd28b707-2614-4d40-9363-cb5b60bb8ab3 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] [instance: 823749e1-56ca-44f9-be83-a36b4851c28f] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:21:14 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-fd28b707-2614-4d40-9363-cb5b60bb8ab3 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:21:14 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-fd28b707-2614-4d40-9363-cb5b60bb8ab3 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:21:14 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-fd28b707-2614-4d40-9363-cb5b60bb8ab3 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:21:14 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-fd28b707-2614-4d40-9363-cb5b60bb8ab3 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:21:14 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-fd28b707-2614-4d40-9363-cb5b60bb8ab3 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:21:14 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-fd28b707-2614-4d40-9363-cb5b60bb8ab3 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:21:15 user devstack@n-api.service[62055]: DEBUG nova.policy [None req-fd28b707-2614-4d40-9363-cb5b60bb8ab3 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d232911f5742aa83146f19f13dd198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608ff87aadc7408e9010212fd5f482b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62055) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:21:15 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-fd28b707-2614-4d40-9363-cb5b60bb8ab3 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] 10.0.0.210 "GET /compute/v2.1/servers/823749e1-56ca-44f9-be83-a36b4851c28f" status: 200 len: 1488 microversion: 2.1 time: 0.333997 Apr 13 16:21:15 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 40/125] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:21:14 2023] GET /compute/v2.1/servers/823749e1-56ca-44f9-be83-a36b4851c28f => generated 1488 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:21:17 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-3d01d60a-dfbf-4a0a-a477-d5f1ff84316e tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:21:17 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-3d01d60a-dfbf-4a0a-a477-d5f1ff84316e tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:21:17 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_cell0:SELECT=2 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:21:17 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_cell0:SELECT=14 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:21:17 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_cell1:SELECT=10 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:21:17 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=8 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:21:17 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-3d01d60a-dfbf-4a0a-a477-d5f1ff84316e tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:21:17 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-3d01d60a-dfbf-4a0a-a477-d5f1ff84316e tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:21:17 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-3d01d60a-dfbf-4a0a-a477-d5f1ff84316e tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:21:17 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-3d01d60a-dfbf-4a0a-a477-d5f1ff84316e tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:21:17 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-3d01d60a-dfbf-4a0a-a477-d5f1ff84316e tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:21:17 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-3d01d60a-dfbf-4a0a-a477-d5f1ff84316e tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:21:18 user devstack@n-api.service[62053]: DEBUG nova.policy [None req-3d01d60a-dfbf-4a0a-a477-d5f1ff84316e tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf19848229f45baad45c490cf539508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7061f2f041954ffe90b0c87b422890e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62053) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:21:18 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-3d01d60a-dfbf-4a0a-a477-d5f1ff84316e tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bbcccf4b-e861-4254-9be3-a491776214e9" status: 200 len: 1552 microversion: 2.1 time: 0.268413 Apr 13 16:21:18 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 40/126] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:21:17 2023] GET /compute/v2.1/servers/bbcccf4b-e861-4254-9be3-a491776214e9 => generated 1552 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:21:18 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=3 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:21:18 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_cell1:SELECT=8 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:21:18 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-df6fe9b9-340a-4d7b-8166-34df80ea8c0f tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Action: 'create', calling method: .version_select at 0x7f96e56b3c70>, body: {"keypair": {"name": "tempest-keypair-135831071", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI5YQpLaGCSGL4ntWt11BFFgnGrQ3fItNIdB138VboyJqclL9H8Ulyx/xxT8IGEQfueXv2SL9+Q3QwgV/gEuhZSJPXCS54honN2kOhqtEWQCcit240y/RW04xC4ADo4EdQ=="}} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:21:18 user devstack@n-api.service[62054]: DEBUG nova.quota [None req-df6fe9b9-340a-4d7b-8166-34df80ea8c0f tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Getting quotas for project 7649e366b0164e2fa5b3faa0830b6ea6. Resources: {'key_pairs'} {{(pid=62054) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 16:21:18 user devstack@n-api.service[62054]: DEBUG nova.quota [None req-df6fe9b9-340a-4d7b-8166-34df80ea8c0f tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Getting quotas for user 7e50bd9d540549a194f706dac48ce93d and project 7649e366b0164e2fa5b3faa0830b6ea6. Resources: {'key_pairs'} {{(pid=62054) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 16:21:18 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-df6fe9b9-340a-4d7b-8166-34df80ea8c0f tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.42 time: 0.060037 Apr 13 16:21:18 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 47/127] 10.0.0.210 () {66 vars in 1277 bytes} [Thu Apr 13 16:21:18 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 62 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 13 16:21:19 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-38a26f7f-fa3e-4581-b3d4-21ddb545fa9b tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Action: 'create', calling method: .version_select at 0x7f96e56e2440>, body: {"keypair": {"name": "tempest-keypair-756136845", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCmDAWwVmv7Q34Pz29t07av6aMRdzm3EgCQrfLBn83RkLO81Y7UjJ2zO/1nlrHzXzESZuCtlZxhzD9V6rEN/0ixQxrUu0ZuX2RNLf7aGDMjaY4XAH+0pTu29dKUMlHtNng=="}} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:21:19 user devstack@n-api.service[62055]: DEBUG nova.quota [None req-38a26f7f-fa3e-4581-b3d4-21ddb545fa9b tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Getting quotas for project bbe4e9fb786d4015b035b4d00f75a1ba. Resources: {'key_pairs'} {{(pid=62055) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 16:21:19 user devstack@n-api.service[62055]: DEBUG nova.quota [None req-38a26f7f-fa3e-4581-b3d4-21ddb545fa9b tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Getting quotas for user 14566b85d0424c08999726ff72a67634 and project bbe4e9fb786d4015b035b4d00f75a1ba. Resources: {'key_pairs'} {{(pid=62055) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 16:21:19 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-38a26f7f-fa3e-4581-b3d4-21ddb545fa9b tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.32 time: 0.104967 Apr 13 16:21:19 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 41/128] 10.0.0.210 () {66 vars in 1277 bytes} [Thu Apr 13 16:21:19 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 107 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 13 16:21:20 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-425684793", "imageRef": "708622a9-7465-4492-ade8-b827198f7e30", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "06e8519d-91e2-4c6a-8b74-6f55609e1764"}, {"port": "ac94464f-32dc-4cd1-a270-ec8934e77c21", "tag": "port-1"}, {"port": "0125a8df-e91c-4d65-be74-fda2f2d93938", "tag": "port-2"}, {"uuid": "4b153def-aec7-4f9e-9604-f1e0afb247f3", "tag": "net-1"}, {"uuid": "4b153def-aec7-4f9e-9604-f1e0afb247f3"}, {"uuid": "310c919b-177f-4fb1-956a-1423f7397f77", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "310c919b-177f-4fb1-956a-1423f7397f77", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "84c7f6ad-d2c2-465a-b39e-47347aa85be0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "c20e80fa-58de-431a-8901-2535657aaadf", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "cc639d00-ef6b-4121-bcb0-c65ec0347abd", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--155743416"}], "key_name": "tempest-keypair-135831071", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:21:21 user devstack@n-api.service[62053]: DEBUG nova.network.neutron [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] validate_networks() for [('06e8519d-91e2-4c6a-8b74-6f55609e1764', None, None, None, None, None), (None, None, 'ac94464f-32dc-4cd1-a270-ec8934e77c21', None, None, None), (None, None, '0125a8df-e91c-4d65-be74-fda2f2d93938', None, None, None), ('4b153def-aec7-4f9e-9604-f1e0afb247f3', None, None, None, None, None), ('4b153def-aec7-4f9e-9604-f1e0afb247f3', None, None, None, None, None), ('310c919b-177f-4fb1-956a-1423f7397f77', '10.2.2.100', None, None, None, None), ('310c919b-177f-4fb1-956a-1423f7397f77', '10.2.2.200', None, None, None, None)] {{(pid=62053) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 16:21:21 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1688495933", "imageRef": "708622a9-7465-4492-ade8-b827198f7e30", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "f11266a1-4740-4cb3-8467-e0e95870ac22"}, {"port": "d7155dcf-9e83-4579-b81a-7277d4a9eeaf", "tag": "port-1"}, {"port": "4c481745-6342-43f8-9040-3ea1d8c5c572", "tag": "port-2"}, {"uuid": "5d158a82-de85-48b5-9f17-40e61e9b0df8", "tag": "net-1"}, {"uuid": "5d158a82-de85-48b5-9f17-40e61e9b0df8"}, {"uuid": "4224b04f-23ed-464e-9b2c-df8c843f9287", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "4224b04f-23ed-464e-9b2c-df8c843f9287", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "48af37b0-6938-432e-b374-d992c4dd9ae9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "27919afc-8990-4ed5-af9e-9d6b3d7b231e", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1691581012"}], "key_name": "tempest-keypair-756136845", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:21:21 user devstack@n-api.service[62054]: DEBUG nova.network.neutron [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] validate_networks() for [('f11266a1-4740-4cb3-8467-e0e95870ac22', None, None, None, None, None), (None, None, 'd7155dcf-9e83-4579-b81a-7277d4a9eeaf', None, None, None), (None, None, '4c481745-6342-43f8-9040-3ea1d8c5c572', None, None, None), ('5d158a82-de85-48b5-9f17-40e61e9b0df8', None, None, None, None, None), ('5d158a82-de85-48b5-9f17-40e61e9b0df8', None, None, None, None, None), ('4224b04f-23ed-464e-9b2c-df8c843f9287', '10.2.2.100', None, None, None, None), ('4224b04f-23ed-464e-9b2c-df8c843f9287', '10.2.2.200', None, None, None, None)] {{(pid=62054) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 16:21:22 user devstack@n-api.service[62053]: DEBUG nova.virt.hardware [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Flavor limits 0:0:0 {{(pid=62053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 16:21:22 user devstack@n-api.service[62053]: DEBUG nova.virt.hardware [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Image limits 0:0:0 {{(pid=62053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 16:21:22 user devstack@n-api.service[62053]: DEBUG nova.virt.hardware [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Flavor pref 0:0:0 {{(pid=62053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 16:21:22 user devstack@n-api.service[62053]: DEBUG nova.virt.hardware [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Image pref 0:0:0 {{(pid=62053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 16:21:22 user devstack@n-api.service[62053]: DEBUG nova.virt.hardware [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 16:21:23 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:21:23 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:21:23 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:21:23 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:21:23 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:21:23 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:21:23 user devstack@n-api.service[62053]: DEBUG nova.quota [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Getting quotas for project 7649e366b0164e2fa5b3faa0830b6ea6. Resources: {'instances', 'cores', 'ram'} {{(pid=62053) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 16:21:23 user devstack@n-api.service[62053]: DEBUG nova.quota [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Getting quotas for user 7e50bd9d540549a194f706dac48ce93d and project 7649e366b0164e2fa5b3faa0830b6ea6. Resources: {'instances', 'cores', 'ram'} {{(pid=62053) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 16:21:23 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Going to run 1 instances... {{(pid=62053) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 16:21:23 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='84c7f6ad-d2c2-465a-b39e-47347aa85be0',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='c20e80fa-58de-431a-8901-2535657aaadf',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='cc639d00-ef6b-4121-bcb0-c65ec0347abd',volume_size=None,volume_type=None)] {{(pid=62053) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 16:21:23 user devstack@n-api.service[62054]: DEBUG nova.virt.hardware [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Flavor limits 0:0:0 {{(pid=62054) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 16:21:23 user devstack@n-api.service[62054]: DEBUG nova.virt.hardware [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Image limits 0:0:0 {{(pid=62054) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 16:21:23 user devstack@n-api.service[62054]: DEBUG nova.virt.hardware [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Flavor pref 0:0:0 {{(pid=62054) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 16:21:23 user devstack@n-api.service[62054]: DEBUG nova.virt.hardware [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Image pref 0:0:0 {{(pid=62054) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 16:21:23 user devstack@n-api.service[62054]: DEBUG nova.virt.hardware [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62054) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 16:21:23 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:21:23 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:21:23 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:21:23 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:21:23 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:21:23 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:21:23 user devstack@n-api.service[62054]: DEBUG nova.quota [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Getting quotas for project bbe4e9fb786d4015b035b4d00f75a1ba. Resources: {'instances', 'cores', 'ram'} {{(pid=62054) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 16:21:23 user devstack@n-api.service[62054]: DEBUG nova.quota [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Getting quotas for user 14566b85d0424c08999726ff72a67634 and project bbe4e9fb786d4015b035b4d00f75a1ba. Resources: {'instances', 'cores', 'ram'} {{(pid=62054) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 16:21:23 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.42 time: 3.240553 Apr 13 16:21:23 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 41/129] 10.0.0.210 () {66 vars in 1266 bytes} [Thu Apr 13 16:21:20 2023] POST /compute/v2.1/servers => generated 403 bytes in 3242 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Apr 13 16:21:23 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-e1b6c724-c55b-4374-952e-5faa778d972b tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:21:23 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-e1b6c724-c55b-4374-952e-5faa778d972b tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:21:23 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Going to run 1 instances... {{(pid=62054) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 16:21:23 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='48af37b0-6938-432e-b374-d992c4dd9ae9',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='27919afc-8990-4ed5-af9e-9d6b3d7b231e',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d',volume_size=None,volume_type=None)] {{(pid=62054) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 16:21:24 user devstack@n-api.service[62055]: DEBUG nova.policy [None req-e1b6c724-c55b-4374-952e-5faa778d972b tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e50bd9d540549a194f706dac48ce93d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649e366b0164e2fa5b3faa0830b6ea6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62055) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:21:24 user devstack@n-api.service[62055]: DEBUG nova.policy [None req-e1b6c724-c55b-4374-952e-5faa778d972b tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e50bd9d540549a194f706dac48ce93d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649e366b0164e2fa5b3faa0830b6ea6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62055) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:21:24 user devstack@n-api.service[62055]: DEBUG nova.policy [None req-e1b6c724-c55b-4374-952e-5faa778d972b tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e50bd9d540549a194f706dac48ce93d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649e366b0164e2fa5b3faa0830b6ea6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62055) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:21:24 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-e1b6c724-c55b-4374-952e-5faa778d972b tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e4ada2d7-7ace-4ed4-86a6-ed121c95e80f" status: 200 len: 1278 microversion: 2.42 time: 0.073222 Apr 13 16:21:24 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 42/130] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 16:21:23 2023] GET /compute/v2.1/servers/e4ada2d7-7ace-4ed4-86a6-ed121c95e80f => generated 1278 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 16:21:24 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.32 time: 3.238830 Apr 13 16:21:24 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 48/131] 10.0.0.210 () {66 vars in 1266 bytes} [Thu Apr 13 16:21:21 2023] POST /compute/v2.1/servers => generated 404 bytes in 3241 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 13 16:21:24 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-a8ef42ee-39fe-4357-a36a-b9849fb365ca tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:21:24 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-a8ef42ee-39fe-4357-a36a-b9849fb365ca tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:21:24 user devstack@n-api.service[62053]: DEBUG nova.policy [None req-a8ef42ee-39fe-4357-a36a-b9849fb365ca tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14566b85d0424c08999726ff72a67634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe4e9fb786d4015b035b4d00f75a1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62053) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:21:24 user devstack@n-api.service[62053]: DEBUG nova.policy [None req-a8ef42ee-39fe-4357-a36a-b9849fb365ca tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14566b85d0424c08999726ff72a67634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe4e9fb786d4015b035b4d00f75a1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62053) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:21:24 user devstack@n-api.service[62053]: DEBUG nova.policy [None req-a8ef42ee-39fe-4357-a36a-b9849fb365ca tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14566b85d0424c08999726ff72a67634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe4e9fb786d4015b035b4d00f75a1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62053) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:21:24 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-a8ef42ee-39fe-4357-a36a-b9849fb365ca tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2549ba85-4e0a-420e-b711-07cafa8c60e9" status: 200 len: 1279 microversion: 2.32 time: 0.084735 Apr 13 16:21:24 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 42/132] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 16:21:24 2023] GET /compute/v2.1/servers/2549ba85-4e0a-420e-b711-07cafa8c60e9 => generated 1279 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 16:21:29 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-31582f98-c5c6-4449-b3c1-0b786e807407 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:21:29 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-31582f98-c5c6-4449-b3c1-0b786e807407 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] [instance: 5db1cb51-2e5a-46c9-8914-cba759a96a65] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:21:29 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_cell1:SELECT=6 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:21:29 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-31582f98-c5c6-4449-b3c1-0b786e807407 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:21:29 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-31582f98-c5c6-4449-b3c1-0b786e807407 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:21:29 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-31582f98-c5c6-4449-b3c1-0b786e807407 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:21:29 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-31582f98-c5c6-4449-b3c1-0b786e807407 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:21:29 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-31582f98-c5c6-4449-b3c1-0b786e807407 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:21:29 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-31582f98-c5c6-4449-b3c1-0b786e807407 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:21:29 user devstack@n-api.service[62055]: DEBUG nova.policy [None req-31582f98-c5c6-4449-b3c1-0b786e807407 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cf399757f544649fed18ee5a31d50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ded8a69b7e941f9bcdc502cfeed79db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62055) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:21:29 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-31582f98-c5c6-4449-b3c1-0b786e807407 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5db1cb51-2e5a-46c9-8914-cba759a96a65" status: 200 len: 1544 microversion: 2.1 time: 0.193613 Apr 13 16:21:29 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 43/133] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:21:29 2023] GET /compute/v2.1/servers/5db1cb51-2e5a-46c9-8914-cba759a96a65 => generated 1544 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:21:30 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-6db87678-30b3-4672-86cf-aa030fd22b0d tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Action: 'create', calling method: .version_select at 0x7f96e56b2f80>, body: {"keypair": {"name": "tempest-TestShelveInstance-2029240993", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDyAJlgxv64OYVoDx7VUkbgPL/6uJGmronkd0R5CCODRVVo/i2lNlZVafBS/KDfrnkMj0B1mexq0GfoaJ06IYh54z6OmormUG7yLrIuZRcmrCeKwYmEEqzhVcYWIYdAQ0Q=="}} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:21:30 user devstack@n-api.service[62054]: DEBUG nova.quota [None req-6db87678-30b3-4672-86cf-aa030fd22b0d tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Getting quotas for project ed94fa5d89c2486b8e2951e608e6630f. Resources: {'key_pairs'} {{(pid=62054) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 16:21:30 user devstack@n-api.service[62054]: DEBUG nova.quota [None req-6db87678-30b3-4672-86cf-aa030fd22b0d tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Getting quotas for user fe6a4bf1a7794af2958c3d53ea1e19c6 and project ed94fa5d89c2486b8e2951e608e6630f. Resources: {'key_pairs'} {{(pid=62054) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 16:21:30 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-6db87678-30b3-4672-86cf-aa030fd22b0d tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.416555 Apr 13 16:21:30 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 49/134] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 13 16:21:30 2023] POST /compute/v2.1/os-keypairs => generated 397 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:21:34 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-9ee02ae8-a4e6-4a99-abe2-322a33b7990b tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1108271225", "imageRef": "708622a9-7465-4492-ade8-b827198f7e30", "flavorRef": "42", "networks": [{"uuid": "aa17b8d5-dffb-42ba-bb7e-8909e5894bfb"}]}} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:21:34 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_cell0:SELECT=2 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:21:34 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_cell1:SELECT=8 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:21:34 user devstack@n-api.service[62053]: DEBUG nova.network.neutron [None req-9ee02ae8-a4e6-4a99-abe2-322a33b7990b tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] validate_networks() for [('aa17b8d5-dffb-42ba-bb7e-8909e5894bfb', None, None, None, None, None)] {{(pid=62053) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 16:21:34 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_cell0:SELECT=8 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:21:35 user devstack@n-api.service[62053]: DEBUG nova.virt.hardware [None req-9ee02ae8-a4e6-4a99-abe2-322a33b7990b tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Flavor limits 0:0:0 {{(pid=62053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 16:21:35 user devstack@n-api.service[62053]: DEBUG nova.virt.hardware [None req-9ee02ae8-a4e6-4a99-abe2-322a33b7990b tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Image limits 0:0:0 {{(pid=62053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 16:21:35 user devstack@n-api.service[62053]: DEBUG nova.virt.hardware [None req-9ee02ae8-a4e6-4a99-abe2-322a33b7990b tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Flavor pref 0:0:0 {{(pid=62053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 16:21:35 user devstack@n-api.service[62053]: DEBUG nova.virt.hardware [None req-9ee02ae8-a4e6-4a99-abe2-322a33b7990b tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Image pref 0:0:0 {{(pid=62053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 16:21:35 user devstack@n-api.service[62053]: DEBUG nova.virt.hardware [None req-9ee02ae8-a4e6-4a99-abe2-322a33b7990b tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 16:21:35 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-9ee02ae8-a4e6-4a99-abe2-322a33b7990b tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:21:35 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-9ee02ae8-a4e6-4a99-abe2-322a33b7990b tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:21:35 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-9ee02ae8-a4e6-4a99-abe2-322a33b7990b tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:21:35 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-9ee02ae8-a4e6-4a99-abe2-322a33b7990b tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:21:35 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-9ee02ae8-a4e6-4a99-abe2-322a33b7990b tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:21:35 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-9ee02ae8-a4e6-4a99-abe2-322a33b7990b tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:21:35 user devstack@n-api.service[62053]: DEBUG nova.quota [None req-9ee02ae8-a4e6-4a99-abe2-322a33b7990b tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Getting quotas for project e7395d2408a44cc88cf88eb49d5f8503. Resources: {'instances', 'cores', 'ram'} {{(pid=62053) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 16:21:35 user devstack@n-api.service[62053]: DEBUG nova.quota [None req-9ee02ae8-a4e6-4a99-abe2-322a33b7990b tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Getting quotas for user 9223a3efe4bc4e37946c8ed718100de4 and project e7395d2408a44cc88cf88eb49d5f8503. Resources: {'instances', 'cores', 'ram'} {{(pid=62053) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 16:21:35 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-9ee02ae8-a4e6-4a99-abe2-322a33b7990b tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Going to run 1 instances... {{(pid=62053) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 16:21:35 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-9ee02ae8-a4e6-4a99-abe2-322a33b7990b tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] [instance: 031c7939-a53c-4f7d-9f36-4ec1d06e2717] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='708622a9-7465-4492-ade8-b827198f7e30',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=62053) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 16:21:35 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-9ee02ae8-a4e6-4a99-abe2-322a33b7990b tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 1.321162 Apr 13 16:21:35 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 43/135] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 16:21:34 2023] POST /compute/v2.1/servers => generated 378 bytes in 1323 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 16:21:35 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-9f78c528-24da-4aef-9fb8-5eb1a9a81c58 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:21:35 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-9f78c528-24da-4aef-9fb8-5eb1a9a81c58 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] [instance: 031c7939-a53c-4f7d-9f36-4ec1d06e2717] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:21:35 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_cell0:SELECT=6 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:21:35 user devstack@n-api.service[62055]: DEBUG nova.policy [None req-9f78c528-24da-4aef-9fb8-5eb1a9a81c58 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9223a3efe4bc4e37946c8ed718100de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7395d2408a44cc88cf88eb49d5f8503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62055) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:21:35 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-9f78c528-24da-4aef-9fb8-5eb1a9a81c58 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] 10.0.0.210 "GET /compute/v2.1/servers/031c7939-a53c-4f7d-9f36-4ec1d06e2717" status: 200 len: 1213 microversion: 2.1 time: 0.078071 Apr 13 16:21:35 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 44/136] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:21:35 2023] GET /compute/v2.1/servers/031c7939-a53c-4f7d-9f36-4ec1d06e2717 => generated 1213 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:21:35 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_cell0:SELECT=2 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:21:35 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_cell1:SELECT=2 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:21:35 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-ce4cfc33-fa3f-4959-a2b8-ca3f91801c9b tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1925968525", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestShelveInstance-2029240993", "security_groups": [{"name": "tempest-secgroup-smoke-910269310"}], "networks": [{"uuid": "c06f107f-4fa0-46dc-8766-3c882c401851"}], "block_device_mapping_v2": [{"uuid": "1ac31388-2626-48e4-a711-54683ef66984", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:21:36 user devstack@n-api.service[62054]: DEBUG nova.network.neutron [None req-ce4cfc33-fa3f-4959-a2b8-ca3f91801c9b tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] validate_networks() for [('c06f107f-4fa0-46dc-8766-3c882c401851', None, None, None, None, None)] {{(pid=62054) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 16:21:36 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-3d3821b5-7431-4521-9d98-b519b05bc0d8 req-4cd26647-3d6e-4c42-92b9-baf98e997226 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4ada2d7-7ace-4ed4-86a6-ed121c95e80f", "tag": "a409f60c-6c6a-49f8-8520-04614e804002"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:21:36 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-3d3821b5-7431-4521-9d98-b519b05bc0d8 req-4cd26647-3d6e-4c42-92b9-baf98e997226 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:21:36 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-3d3821b5-7431-4521-9d98-b519b05bc0d8 req-4cd26647-3d6e-4c42-92b9-baf98e997226 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:21:36 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-3d3821b5-7431-4521-9d98-b519b05bc0d8 req-4cd26647-3d6e-4c42-92b9-baf98e997226 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:21:36 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-3d3821b5-7431-4521-9d98-b519b05bc0d8 req-4cd26647-3d6e-4c42-92b9-baf98e997226 service nova] Creating event network-changed:a409f60c-6c6a-49f8-8520-04614e804002 for instance e4ada2d7-7ace-4ed4-86a6-ed121c95e80f on user Apr 13 16:21:36 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [req-3d3821b5-7431-4521-9d98-b519b05bc0d8 req-4cd26647-3d6e-4c42-92b9-baf98e997226 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042533 Apr 13 16:21:36 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 44/137] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:21:36 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:21:36 user devstack@n-api.service[62054]: DEBUG nova.virt.hardware [None req-ce4cfc33-fa3f-4959-a2b8-ca3f91801c9b tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Flavor limits 0:0:0 {{(pid=62054) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 16:21:36 user devstack@n-api.service[62054]: DEBUG nova.virt.hardware [None req-ce4cfc33-fa3f-4959-a2b8-ca3f91801c9b tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Image limits 0:0:0 {{(pid=62054) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 16:21:36 user devstack@n-api.service[62054]: DEBUG nova.virt.hardware [None req-ce4cfc33-fa3f-4959-a2b8-ca3f91801c9b tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Flavor pref 0:0:0 {{(pid=62054) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 16:21:36 user devstack@n-api.service[62054]: DEBUG nova.virt.hardware [None req-ce4cfc33-fa3f-4959-a2b8-ca3f91801c9b tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Image pref 0:0:0 {{(pid=62054) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 16:21:36 user devstack@n-api.service[62054]: DEBUG nova.virt.hardware [None req-ce4cfc33-fa3f-4959-a2b8-ca3f91801c9b tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62054) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 16:21:36 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-ce4cfc33-fa3f-4959-a2b8-ca3f91801c9b tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:21:36 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-ce4cfc33-fa3f-4959-a2b8-ca3f91801c9b tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:21:36 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-ce4cfc33-fa3f-4959-a2b8-ca3f91801c9b tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:21:36 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-ce4cfc33-fa3f-4959-a2b8-ca3f91801c9b tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:21:36 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-ce4cfc33-fa3f-4959-a2b8-ca3f91801c9b tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:21:36 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-ce4cfc33-fa3f-4959-a2b8-ca3f91801c9b tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:21:36 user devstack@n-api.service[62054]: DEBUG nova.quota [None req-ce4cfc33-fa3f-4959-a2b8-ca3f91801c9b tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Getting quotas for project ed94fa5d89c2486b8e2951e608e6630f. Resources: {'instances', 'cores', 'ram'} {{(pid=62054) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 16:21:36 user devstack@n-api.service[62054]: DEBUG nova.quota [None req-ce4cfc33-fa3f-4959-a2b8-ca3f91801c9b tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Getting quotas for user fe6a4bf1a7794af2958c3d53ea1e19c6 and project ed94fa5d89c2486b8e2951e608e6630f. Resources: {'instances', 'cores', 'ram'} {{(pid=62054) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 16:21:36 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-ce4cfc33-fa3f-4959-a2b8-ca3f91801c9b tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Going to run 1 instances... {{(pid=62054) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 16:21:36 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-ce4cfc33-fa3f-4959-a2b8-ca3f91801c9b tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1ac31388-2626-48e4-a711-54683ef66984',volume_size=None,volume_type=None)] {{(pid=62054) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 16:21:37 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-ce4cfc33-fa3f-4959-a2b8-ca3f91801c9b tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 1.068678 Apr 13 16:21:37 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 50/138] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 16:21:35 2023] POST /compute/v2.1/servers => generated 403 bytes in 1070 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 16:21:37 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-34ddd93e-9e4a-4567-9fba-704218084baf tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:21:37 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-34ddd93e-9e4a-4567-9fba-704218084baf tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:21:37 user devstack@n-api.service[62055]: DEBUG nova.policy [None req-34ddd93e-9e4a-4567-9fba-704218084baf tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6a4bf1a7794af2958c3d53ea1e19c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed94fa5d89c2486b8e2951e608e6630f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62055) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:21:37 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-34ddd93e-9e4a-4567-9fba-704218084baf tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bf350da4-9cc2-4900-adf0-506e44984b42" status: 200 len: 1084 microversion: 2.1 time: 0.098050 Apr 13 16:21:37 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 45/139] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:21:37 2023] GET /compute/v2.1/servers/bf350da4-9cc2-4900-adf0-506e44984b42 => generated 1084 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:21:38 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-6df9d0f9-2332-4df0-be5d-879bbc100b7f req-a00112c2-c54e-4d3d-902f-13c30ef93157 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2549ba85-4e0a-420e-b711-07cafa8c60e9", "tag": "36152688-366c-40a2-8bf9-88f69925594a"}, {"name": "network-changed", "server_uuid": "e4ada2d7-7ace-4ed4-86a6-ed121c95e80f", "tag": "ac94464f-32dc-4cd1-a270-ec8934e77c21"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:21:38 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-6df9d0f9-2332-4df0-be5d-879bbc100b7f req-a00112c2-c54e-4d3d-902f-13c30ef93157 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:21:38 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-6df9d0f9-2332-4df0-be5d-879bbc100b7f req-a00112c2-c54e-4d3d-902f-13c30ef93157 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:21:38 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-6df9d0f9-2332-4df0-be5d-879bbc100b7f req-a00112c2-c54e-4d3d-902f-13c30ef93157 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:21:38 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-6df9d0f9-2332-4df0-be5d-879bbc100b7f req-a00112c2-c54e-4d3d-902f-13c30ef93157 service nova] Creating event network-changed:36152688-366c-40a2-8bf9-88f69925594a for instance 2549ba85-4e0a-420e-b711-07cafa8c60e9 on user Apr 13 16:21:38 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-6df9d0f9-2332-4df0-be5d-879bbc100b7f req-a00112c2-c54e-4d3d-902f-13c30ef93157 service nova] Creating event network-changed:ac94464f-32dc-4cd1-a270-ec8934e77c21 for instance e4ada2d7-7ace-4ed4-86a6-ed121c95e80f on user Apr 13 16:21:38 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [req-6df9d0f9-2332-4df0-be5d-879bbc100b7f req-a00112c2-c54e-4d3d-902f-13c30ef93157 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.068337 Apr 13 16:21:38 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 45/140] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:21:38 2023] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:21:39 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-57dbaaf9-03fb-4a52-9bac-6a4fa25cebf2 req-364f6138-54f6-4f56-8dce-cfb38065cd35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "031c7939-a53c-4f7d-9f36-4ec1d06e2717", "tag": "a99b01f1-3495-45d6-a802-a1f740719c17"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:21:39 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-57dbaaf9-03fb-4a52-9bac-6a4fa25cebf2 req-364f6138-54f6-4f56-8dce-cfb38065cd35 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:21:39 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-57dbaaf9-03fb-4a52-9bac-6a4fa25cebf2 req-364f6138-54f6-4f56-8dce-cfb38065cd35 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:21:39 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-57dbaaf9-03fb-4a52-9bac-6a4fa25cebf2 req-364f6138-54f6-4f56-8dce-cfb38065cd35 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:21:39 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-57dbaaf9-03fb-4a52-9bac-6a4fa25cebf2 req-364f6138-54f6-4f56-8dce-cfb38065cd35 service nova] Creating event network-changed:a99b01f1-3495-45d6-a802-a1f740719c17 for instance 031c7939-a53c-4f7d-9f36-4ec1d06e2717 on user Apr 13 16:21:39 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [req-57dbaaf9-03fb-4a52-9bac-6a4fa25cebf2 req-364f6138-54f6-4f56-8dce-cfb38065cd35 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043636 Apr 13 16:21:39 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 51/141] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:21:39 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 16:21:40 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [req-76c3e22e-6643-4fbb-8798-9b6c381ecdf8 req-1b45d51e-67a3-4fe8-b854-7e6470e98f80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2549ba85-4e0a-420e-b711-07cafa8c60e9", "tag": "d7155dcf-9e83-4579-b81a-7277d4a9eeaf"}, {"name": "network-changed", "server_uuid": "e4ada2d7-7ace-4ed4-86a6-ed121c95e80f", "tag": "0125a8df-e91c-4d65-be74-fda2f2d93938"}, {"name": "network-changed", "server_uuid": "2549ba85-4e0a-420e-b711-07cafa8c60e9", "tag": "4c481745-6342-43f8-9040-3ea1d8c5c572"}]} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:21:40 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_cell1:SELECT=6 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:21:40 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-76c3e22e-6643-4fbb-8798-9b6c381ecdf8 req-1b45d51e-67a3-4fe8-b854-7e6470e98f80 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:21:40 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-76c3e22e-6643-4fbb-8798-9b6c381ecdf8 req-1b45d51e-67a3-4fe8-b854-7e6470e98f80 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:21:40 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-76c3e22e-6643-4fbb-8798-9b6c381ecdf8 req-1b45d51e-67a3-4fe8-b854-7e6470e98f80 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:21:40 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-76c3e22e-6643-4fbb-8798-9b6c381ecdf8 req-1b45d51e-67a3-4fe8-b854-7e6470e98f80 service nova] Creating event network-changed:d7155dcf-9e83-4579-b81a-7277d4a9eeaf for instance 2549ba85-4e0a-420e-b711-07cafa8c60e9 on user Apr 13 16:21:40 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-76c3e22e-6643-4fbb-8798-9b6c381ecdf8 req-1b45d51e-67a3-4fe8-b854-7e6470e98f80 service nova] Creating event network-changed:0125a8df-e91c-4d65-be74-fda2f2d93938 for instance e4ada2d7-7ace-4ed4-86a6-ed121c95e80f on user Apr 13 16:21:40 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-76c3e22e-6643-4fbb-8798-9b6c381ecdf8 req-1b45d51e-67a3-4fe8-b854-7e6470e98f80 service nova] Creating event network-changed:4c481745-6342-43f8-9040-3ea1d8c5c572 for instance 2549ba85-4e0a-420e-b711-07cafa8c60e9 on user Apr 13 16:21:40 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [req-76c3e22e-6643-4fbb-8798-9b6c381ecdf8 req-1b45d51e-67a3-4fe8-b854-7e6470e98f80 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.043081 Apr 13 16:21:40 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 46/142] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:21:40 2023] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:21:42 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-8c795c30-781f-4113-bc64-e29f6c4541a8 req-5e35de7f-c3c6-4b1e-86be-76214a94c803 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf350da4-9cc2-4900-adf0-506e44984b42", "tag": "1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:21:42 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-8c795c30-781f-4113-bc64-e29f6c4541a8 req-5e35de7f-c3c6-4b1e-86be-76214a94c803 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:21:42 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-8c795c30-781f-4113-bc64-e29f6c4541a8 req-5e35de7f-c3c6-4b1e-86be-76214a94c803 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:21:42 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-8c795c30-781f-4113-bc64-e29f6c4541a8 req-5e35de7f-c3c6-4b1e-86be-76214a94c803 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:21:42 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-8c795c30-781f-4113-bc64-e29f6c4541a8 req-5e35de7f-c3c6-4b1e-86be-76214a94c803 service nova] Creating event network-changed:1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8 for instance bf350da4-9cc2-4900-adf0-506e44984b42 on user Apr 13 16:21:42 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [req-8c795c30-781f-4113-bc64-e29f6c4541a8 req-5e35de7f-c3c6-4b1e-86be-76214a94c803 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043934 Apr 13 16:21:42 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 46/143] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:21:42 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:21:42 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-2dab2a41-f572-49de-8027-174040823084 req-88aa59ca-9c30-4fc7-91f4-a39c3edd709d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "031c7939-a53c-4f7d-9f36-4ec1d06e2717", "name": "network-vif-plugged", "status": "completed", "tag": "a99b01f1-3495-45d6-a802-a1f740719c17"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:21:42 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-2dab2a41-f572-49de-8027-174040823084 req-88aa59ca-9c30-4fc7-91f4-a39c3edd709d service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:21:42 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-2dab2a41-f572-49de-8027-174040823084 req-88aa59ca-9c30-4fc7-91f4-a39c3edd709d service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:21:42 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-2dab2a41-f572-49de-8027-174040823084 req-88aa59ca-9c30-4fc7-91f4-a39c3edd709d service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:21:42 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [req-a5b1854c-604a-4a79-bfac-24e859f8cab2 req-642034bd-b591-4f4d-967d-05dfbf846282 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4ada2d7-7ace-4ed4-86a6-ed121c95e80f", "tag": "8f3a3011-e474-4538-812b-9df3968fd629"}, {"name": "network-changed", "server_uuid": "2549ba85-4e0a-420e-b711-07cafa8c60e9", "tag": "0152bbb9-d50d-4e58-8a2b-727c4675ea2f"}, {"name": "network-changed", "server_uuid": "e4ada2d7-7ace-4ed4-86a6-ed121c95e80f", "tag": "2430beb8-b2e4-4493-bdc5-df6b4c1181c6"}]} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:21:42 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-2dab2a41-f572-49de-8027-174040823084 req-88aa59ca-9c30-4fc7-91f4-a39c3edd709d service nova] Creating event network-vif-plugged:a99b01f1-3495-45d6-a802-a1f740719c17 for instance 031c7939-a53c-4f7d-9f36-4ec1d06e2717 on user Apr 13 16:21:42 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-a5b1854c-604a-4a79-bfac-24e859f8cab2 req-642034bd-b591-4f4d-967d-05dfbf846282 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:21:42 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-a5b1854c-604a-4a79-bfac-24e859f8cab2 req-642034bd-b591-4f4d-967d-05dfbf846282 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:21:42 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-a5b1854c-604a-4a79-bfac-24e859f8cab2 req-642034bd-b591-4f4d-967d-05dfbf846282 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:21:42 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [req-2dab2a41-f572-49de-8027-174040823084 req-88aa59ca-9c30-4fc7-91f4-a39c3edd709d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044754 Apr 13 16:21:42 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 52/144] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:21:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:21:42 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-a5b1854c-604a-4a79-bfac-24e859f8cab2 req-642034bd-b591-4f4d-967d-05dfbf846282 service nova] Creating event network-changed:8f3a3011-e474-4538-812b-9df3968fd629 for instance e4ada2d7-7ace-4ed4-86a6-ed121c95e80f on user Apr 13 16:21:42 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-a5b1854c-604a-4a79-bfac-24e859f8cab2 req-642034bd-b591-4f4d-967d-05dfbf846282 service nova] Creating event network-changed:0152bbb9-d50d-4e58-8a2b-727c4675ea2f for instance 2549ba85-4e0a-420e-b711-07cafa8c60e9 on user Apr 13 16:21:42 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-a5b1854c-604a-4a79-bfac-24e859f8cab2 req-642034bd-b591-4f4d-967d-05dfbf846282 service nova] Creating event network-changed:2430beb8-b2e4-4493-bdc5-df6b4c1181c6 for instance e4ada2d7-7ace-4ed4-86a6-ed121c95e80f on user Apr 13 16:21:42 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [req-a5b1854c-604a-4a79-bfac-24e859f8cab2 req-642034bd-b591-4f4d-967d-05dfbf846282 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.038387 Apr 13 16:21:42 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 47/145] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:21:42 2023] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 16:21:43 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-b5e4aa8e-4ca7-4e15-8bc1-88bde868c65e tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:21:43 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-b5e4aa8e-4ca7-4e15-8bc1-88bde868c65e tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] [instance: cf54be22-2a5d-40c4-8a1a-0060c77f83f6] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:21:43 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-b5e4aa8e-4ca7-4e15-8bc1-88bde868c65e tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:21:43 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-b5e4aa8e-4ca7-4e15-8bc1-88bde868c65e tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:21:43 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-b5e4aa8e-4ca7-4e15-8bc1-88bde868c65e tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:21:43 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-b5e4aa8e-4ca7-4e15-8bc1-88bde868c65e tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:21:43 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-b5e4aa8e-4ca7-4e15-8bc1-88bde868c65e tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:21:43 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-b5e4aa8e-4ca7-4e15-8bc1-88bde868c65e tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:21:43 user devstack@n-api.service[62053]: DEBUG nova.policy [None req-b5e4aa8e-4ca7-4e15-8bc1-88bde868c65e tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b143a8db8a3410eb09b21ced7bd883e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6365a1e8d6c48499d4b8921244d92a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62053) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:21:43 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-b5e4aa8e-4ca7-4e15-8bc1-88bde868c65e tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cf54be22-2a5d-40c4-8a1a-0060c77f83f6" status: 200 len: 1547 microversion: 2.1 time: 0.354315 Apr 13 16:21:43 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 47/146] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:21:43 2023] GET /compute/v2.1/servers/cf54be22-2a5d-40c4-8a1a-0060c77f83f6 => generated 1547 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:21:44 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-15377a1a-ef2d-44ab-8221-a8ba3a8ea11f req-52374293-4314-4e2d-aec3-7b229d8de8b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "031c7939-a53c-4f7d-9f36-4ec1d06e2717", "name": "network-vif-plugged", "status": "completed", "tag": "a99b01f1-3495-45d6-a802-a1f740719c17"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:21:44 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-15377a1a-ef2d-44ab-8221-a8ba3a8ea11f req-52374293-4314-4e2d-aec3-7b229d8de8b2 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:21:44 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-15377a1a-ef2d-44ab-8221-a8ba3a8ea11f req-52374293-4314-4e2d-aec3-7b229d8de8b2 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:21:44 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-15377a1a-ef2d-44ab-8221-a8ba3a8ea11f req-52374293-4314-4e2d-aec3-7b229d8de8b2 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:21:44 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [req-17b181ac-e444-4f1e-9006-30e4c3fa241e req-537233c7-7d9d-4a20-b151-b92b2fc9c926 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2549ba85-4e0a-420e-b711-07cafa8c60e9", "tag": "3730ed6e-b093-4232-800b-b064d650e9e8"}, {"name": "network-changed", "server_uuid": "e4ada2d7-7ace-4ed4-86a6-ed121c95e80f", "tag": "15dca2c3-5048-4e80-8008-c19400ea34e4"}]} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:21:44 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-15377a1a-ef2d-44ab-8221-a8ba3a8ea11f req-52374293-4314-4e2d-aec3-7b229d8de8b2 service nova] Creating event network-vif-plugged:a99b01f1-3495-45d6-a802-a1f740719c17 for instance 031c7939-a53c-4f7d-9f36-4ec1d06e2717 on user Apr 13 16:21:44 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=1 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:21:44 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [req-15377a1a-ef2d-44ab-8221-a8ba3a8ea11f req-52374293-4314-4e2d-aec3-7b229d8de8b2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032105 Apr 13 16:21:44 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 53/147] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:21:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:21:44 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-17b181ac-e444-4f1e-9006-30e4c3fa241e req-537233c7-7d9d-4a20-b151-b92b2fc9c926 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:21:44 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-17b181ac-e444-4f1e-9006-30e4c3fa241e req-537233c7-7d9d-4a20-b151-b92b2fc9c926 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:21:44 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-17b181ac-e444-4f1e-9006-30e4c3fa241e req-537233c7-7d9d-4a20-b151-b92b2fc9c926 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:21:44 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-a9b75352-bad0-4de5-b2fd-c5bce00a8b65 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:21:44 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-a9b75352-bad0-4de5-b2fd-c5bce00a8b65 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] [instance: 8c6d8096-853b-4091-ad82-6faf8ffc85fa] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:21:44 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-a9b75352-bad0-4de5-b2fd-c5bce00a8b65 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:21:44 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-a9b75352-bad0-4de5-b2fd-c5bce00a8b65 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:21:44 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-a9b75352-bad0-4de5-b2fd-c5bce00a8b65 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:21:44 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-a9b75352-bad0-4de5-b2fd-c5bce00a8b65 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:21:44 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-a9b75352-bad0-4de5-b2fd-c5bce00a8b65 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:21:44 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-a9b75352-bad0-4de5-b2fd-c5bce00a8b65 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:21:44 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-17b181ac-e444-4f1e-9006-30e4c3fa241e req-537233c7-7d9d-4a20-b151-b92b2fc9c926 service nova] Creating event network-changed:3730ed6e-b093-4232-800b-b064d650e9e8 for instance 2549ba85-4e0a-420e-b711-07cafa8c60e9 on user Apr 13 16:21:44 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-17b181ac-e444-4f1e-9006-30e4c3fa241e req-537233c7-7d9d-4a20-b151-b92b2fc9c926 service nova] Creating event network-changed:15dca2c3-5048-4e80-8008-c19400ea34e4 for instance e4ada2d7-7ace-4ed4-86a6-ed121c95e80f on user Apr 13 16:21:45 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [req-17b181ac-e444-4f1e-9006-30e4c3fa241e req-537233c7-7d9d-4a20-b151-b92b2fc9c926 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.070158 Apr 13 16:21:45 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 48/148] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:21:44 2023] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:21:45 user devstack@n-api.service[62053]: DEBUG nova.policy [None req-a9b75352-bad0-4de5-b2fd-c5bce00a8b65 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b5e87b35e0471cafe541fdf224b5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc3e2169a6c44d05b2a2eedbe3a063cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62053) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:21:45 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-a9b75352-bad0-4de5-b2fd-c5bce00a8b65 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8c6d8096-853b-4091-ad82-6faf8ffc85fa" status: 200 len: 1525 microversion: 2.1 time: 0.435940 Apr 13 16:21:45 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 48/149] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:21:44 2023] GET /compute/v2.1/servers/8c6d8096-853b-4091-ad82-6faf8ffc85fa => generated 1525 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:21:47 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_cell0:SELECT=2 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:21:47 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_cell0:SELECT=20 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:21:47 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-09438164-3a12-45af-826e-218eb91b1f6f req-14e94222-211e-4aae-a405-3e995626ca27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2549ba85-4e0a-420e-b711-07cafa8c60e9", "tag": "0fbdf291-df5d-41c5-a765-7145a87da272"}, {"name": "network-changed", "server_uuid": "e4ada2d7-7ace-4ed4-86a6-ed121c95e80f", "tag": "d41765b6-0d5b-43c1-bf58-a82a7bbe3137"}, {"name": "network-changed", "server_uuid": "2549ba85-4e0a-420e-b711-07cafa8c60e9", "tag": "38e92b7c-b7c1-4137-a1db-21bc1d24f3ee"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:21:47 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-09438164-3a12-45af-826e-218eb91b1f6f req-14e94222-211e-4aae-a405-3e995626ca27 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:21:47 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-09438164-3a12-45af-826e-218eb91b1f6f req-14e94222-211e-4aae-a405-3e995626ca27 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:21:47 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-09438164-3a12-45af-826e-218eb91b1f6f req-14e94222-211e-4aae-a405-3e995626ca27 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:21:47 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-09438164-3a12-45af-826e-218eb91b1f6f req-14e94222-211e-4aae-a405-3e995626ca27 service nova] Creating event network-changed:0fbdf291-df5d-41c5-a765-7145a87da272 for instance 2549ba85-4e0a-420e-b711-07cafa8c60e9 on user Apr 13 16:21:47 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-09438164-3a12-45af-826e-218eb91b1f6f req-14e94222-211e-4aae-a405-3e995626ca27 service nova] Creating event network-changed:d41765b6-0d5b-43c1-bf58-a82a7bbe3137 for instance e4ada2d7-7ace-4ed4-86a6-ed121c95e80f on user Apr 13 16:21:47 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-09438164-3a12-45af-826e-218eb91b1f6f req-14e94222-211e-4aae-a405-3e995626ca27 service nova] Creating event network-changed:38e92b7c-b7c1-4137-a1db-21bc1d24f3ee for instance 2549ba85-4e0a-420e-b711-07cafa8c60e9 on user Apr 13 16:21:47 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [req-09438164-3a12-45af-826e-218eb91b1f6f req-14e94222-211e-4aae-a405-3e995626ca27 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.046631 Apr 13 16:21:47 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 54/150] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:21:47 2023] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:21:47 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [req-6fc07712-eb49-48e3-a6af-fc1ca057f788 req-56e7898b-25c2-44ae-8e55-ec4b25ce8a6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf350da4-9cc2-4900-adf0-506e44984b42", "name": "network-vif-plugged", "status": "completed", "tag": "1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8"}]} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:21:47 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_cell0:SELECT=4 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:21:47 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-6fc07712-eb49-48e3-a6af-fc1ca057f788 req-56e7898b-25c2-44ae-8e55-ec4b25ce8a6c service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:21:47 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-6fc07712-eb49-48e3-a6af-fc1ca057f788 req-56e7898b-25c2-44ae-8e55-ec4b25ce8a6c service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:21:47 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-6fc07712-eb49-48e3-a6af-fc1ca057f788 req-56e7898b-25c2-44ae-8e55-ec4b25ce8a6c service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:21:47 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-6fc07712-eb49-48e3-a6af-fc1ca057f788 req-56e7898b-25c2-44ae-8e55-ec4b25ce8a6c service nova] Creating event network-vif-plugged:1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8 for instance bf350da4-9cc2-4900-adf0-506e44984b42 on user Apr 13 16:21:47 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [req-6fc07712-eb49-48e3-a6af-fc1ca057f788 req-56e7898b-25c2-44ae-8e55-ec4b25ce8a6c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048802 Apr 13 16:21:47 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 49/151] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:21:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:21:49 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-7947b582-fa65-4753-b50c-a8d2eb8a54f7 req-6a58486e-a3c1-486f-9490-73caf216503a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf350da4-9cc2-4900-adf0-506e44984b42", "name": "network-vif-plugged", "status": "completed", "tag": "1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:21:49 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_cell0:SELECT=2 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:21:49 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_cell0:SELECT=6 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:21:49 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=6 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:21:49 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-7947b582-fa65-4753-b50c-a8d2eb8a54f7 req-6a58486e-a3c1-486f-9490-73caf216503a service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:21:49 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-7947b582-fa65-4753-b50c-a8d2eb8a54f7 req-6a58486e-a3c1-486f-9490-73caf216503a service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:21:49 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-7947b582-fa65-4753-b50c-a8d2eb8a54f7 req-6a58486e-a3c1-486f-9490-73caf216503a service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:21:49 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-7947b582-fa65-4753-b50c-a8d2eb8a54f7 req-6a58486e-a3c1-486f-9490-73caf216503a service nova] Creating event network-vif-plugged:1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8 for instance bf350da4-9cc2-4900-adf0-506e44984b42 on user Apr 13 16:21:49 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [req-7947b582-fa65-4753-b50c-a8d2eb8a54f7 req-6a58486e-a3c1-486f-9490-73caf216503a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037288 Apr 13 16:21:49 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 49/152] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:21:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:21:58 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=8 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:21:58 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_cell1:SELECT=10 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:21:58 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-910b0cbb-494a-413a-91fd-99286aaa3bf4 req-fc0ed231-81b8-4cac-983b-cc1a4cf23fa9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4ada2d7-7ace-4ed4-86a6-ed121c95e80f", "name": "network-vif-plugged", "status": "completed", "tag": "a409f60c-6c6a-49f8-8520-04614e804002"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:21:58 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-910b0cbb-494a-413a-91fd-99286aaa3bf4 req-fc0ed231-81b8-4cac-983b-cc1a4cf23fa9 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:21:58 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-910b0cbb-494a-413a-91fd-99286aaa3bf4 req-fc0ed231-81b8-4cac-983b-cc1a4cf23fa9 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:21:58 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-910b0cbb-494a-413a-91fd-99286aaa3bf4 req-fc0ed231-81b8-4cac-983b-cc1a4cf23fa9 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:21:58 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-910b0cbb-494a-413a-91fd-99286aaa3bf4 req-fc0ed231-81b8-4cac-983b-cc1a4cf23fa9 service nova] Creating event network-vif-plugged:a409f60c-6c6a-49f8-8520-04614e804002 for instance e4ada2d7-7ace-4ed4-86a6-ed121c95e80f on user Apr 13 16:21:58 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [req-910b0cbb-494a-413a-91fd-99286aaa3bf4 req-fc0ed231-81b8-4cac-983b-cc1a4cf23fa9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035209 Apr 13 16:21:58 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 55/153] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:21:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:21:58 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_api:SELECT=3 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:21:58 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_cell1:SELECT=8 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:21:58 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [req-9ecdd70c-a2a2-456c-befe-e65e2e13f4a0 req-117f0312-27c5-4a06-9b85-1acedfaf8c39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4ada2d7-7ace-4ed4-86a6-ed121c95e80f", "name": "network-vif-plugged", "status": "completed", "tag": "ac94464f-32dc-4cd1-a270-ec8934e77c21"}]} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:21:58 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-9ecdd70c-a2a2-456c-befe-e65e2e13f4a0 req-117f0312-27c5-4a06-9b85-1acedfaf8c39 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:21:58 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-9ecdd70c-a2a2-456c-befe-e65e2e13f4a0 req-117f0312-27c5-4a06-9b85-1acedfaf8c39 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:21:58 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-9ecdd70c-a2a2-456c-befe-e65e2e13f4a0 req-117f0312-27c5-4a06-9b85-1acedfaf8c39 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:21:58 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-9ecdd70c-a2a2-456c-befe-e65e2e13f4a0 req-117f0312-27c5-4a06-9b85-1acedfaf8c39 service nova] Creating event network-vif-plugged:ac94464f-32dc-4cd1-a270-ec8934e77c21 for instance e4ada2d7-7ace-4ed4-86a6-ed121c95e80f on user Apr 13 16:21:58 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [req-9ecdd70c-a2a2-456c-befe-e65e2e13f4a0 req-117f0312-27c5-4a06-9b85-1acedfaf8c39 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055229 Apr 13 16:21:58 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 50/154] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:21:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:21:59 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-269b56a5-05fa-4f13-8eb4-a6c442695de4 req-029ce4dd-9515-4634-8c10-4ab8a19887d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4ada2d7-7ace-4ed4-86a6-ed121c95e80f", "name": "network-vif-plugged", "status": "completed", "tag": "8f3a3011-e474-4538-812b-9df3968fd629"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:21:59 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-269b56a5-05fa-4f13-8eb4-a6c442695de4 req-029ce4dd-9515-4634-8c10-4ab8a19887d4 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:21:59 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-269b56a5-05fa-4f13-8eb4-a6c442695de4 req-029ce4dd-9515-4634-8c10-4ab8a19887d4 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:21:59 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-269b56a5-05fa-4f13-8eb4-a6c442695de4 req-029ce4dd-9515-4634-8c10-4ab8a19887d4 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:21:59 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-269b56a5-05fa-4f13-8eb4-a6c442695de4 req-029ce4dd-9515-4634-8c10-4ab8a19887d4 service nova] Creating event network-vif-plugged:8f3a3011-e474-4538-812b-9df3968fd629 for instance e4ada2d7-7ace-4ed4-86a6-ed121c95e80f on user Apr 13 16:21:59 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [req-269b56a5-05fa-4f13-8eb4-a6c442695de4 req-029ce4dd-9515-4634-8c10-4ab8a19887d4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046332 Apr 13 16:21:59 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 50/155] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:21:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:22:00 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-ecd99fb2-9e92-454f-93a1-c133f3c5cbbf req-570b6027-b30d-42ea-bf22-3912a187d78d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4ada2d7-7ace-4ed4-86a6-ed121c95e80f", "name": "network-vif-plugged", "status": "completed", "tag": "a409f60c-6c6a-49f8-8520-04614e804002"}, {"server_uuid": "e4ada2d7-7ace-4ed4-86a6-ed121c95e80f", "name": "network-vif-plugged", "status": "completed", "tag": "0125a8df-e91c-4d65-be74-fda2f2d93938"}, {"server_uuid": "e4ada2d7-7ace-4ed4-86a6-ed121c95e80f", "name": "network-vif-plugged", "status": "completed", "tag": "0125a8df-e91c-4d65-be74-fda2f2d93938"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:22:00 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-ecd99fb2-9e92-454f-93a1-c133f3c5cbbf req-570b6027-b30d-42ea-bf22-3912a187d78d service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:22:00 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-ecd99fb2-9e92-454f-93a1-c133f3c5cbbf req-570b6027-b30d-42ea-bf22-3912a187d78d service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:22:00 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-ecd99fb2-9e92-454f-93a1-c133f3c5cbbf req-570b6027-b30d-42ea-bf22-3912a187d78d service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:22:00 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-ecd99fb2-9e92-454f-93a1-c133f3c5cbbf req-570b6027-b30d-42ea-bf22-3912a187d78d service nova] Creating event network-vif-plugged:a409f60c-6c6a-49f8-8520-04614e804002 for instance e4ada2d7-7ace-4ed4-86a6-ed121c95e80f on user Apr 13 16:22:00 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-ecd99fb2-9e92-454f-93a1-c133f3c5cbbf req-570b6027-b30d-42ea-bf22-3912a187d78d service nova] Creating event network-vif-plugged:0125a8df-e91c-4d65-be74-fda2f2d93938 for instance e4ada2d7-7ace-4ed4-86a6-ed121c95e80f on user Apr 13 16:22:00 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-ecd99fb2-9e92-454f-93a1-c133f3c5cbbf req-570b6027-b30d-42ea-bf22-3912a187d78d service nova] Creating event network-vif-plugged:0125a8df-e91c-4d65-be74-fda2f2d93938 for instance e4ada2d7-7ace-4ed4-86a6-ed121c95e80f on user Apr 13 16:22:00 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [req-ecd99fb2-9e92-454f-93a1-c133f3c5cbbf req-570b6027-b30d-42ea-bf22-3912a187d78d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.032942 Apr 13 16:22:00 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 56/156] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:22:00 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:22:01 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [req-f6880c77-0200-4033-a4c4-f0eb34235cd1 req-dbbe0b91-fc5e-4f34-83ab-dcb7a9a6e4b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4ada2d7-7ace-4ed4-86a6-ed121c95e80f", "name": "network-vif-plugged", "status": "completed", "tag": "ac94464f-32dc-4cd1-a270-ec8934e77c21"}, {"server_uuid": "e4ada2d7-7ace-4ed4-86a6-ed121c95e80f", "name": "network-vif-plugged", "status": "completed", "tag": "2430beb8-b2e4-4493-bdc5-df6b4c1181c6"}, {"server_uuid": "e4ada2d7-7ace-4ed4-86a6-ed121c95e80f", "name": "network-vif-plugged", "status": "completed", "tag": "2430beb8-b2e4-4493-bdc5-df6b4c1181c6"}]} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:22:01 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-f6880c77-0200-4033-a4c4-f0eb34235cd1 req-dbbe0b91-fc5e-4f34-83ab-dcb7a9a6e4b3 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:22:01 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-f6880c77-0200-4033-a4c4-f0eb34235cd1 req-dbbe0b91-fc5e-4f34-83ab-dcb7a9a6e4b3 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:22:01 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-f6880c77-0200-4033-a4c4-f0eb34235cd1 req-dbbe0b91-fc5e-4f34-83ab-dcb7a9a6e4b3 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:22:01 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-f6880c77-0200-4033-a4c4-f0eb34235cd1 req-dbbe0b91-fc5e-4f34-83ab-dcb7a9a6e4b3 service nova] Creating event network-vif-plugged:ac94464f-32dc-4cd1-a270-ec8934e77c21 for instance e4ada2d7-7ace-4ed4-86a6-ed121c95e80f on user Apr 13 16:22:01 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-f6880c77-0200-4033-a4c4-f0eb34235cd1 req-dbbe0b91-fc5e-4f34-83ab-dcb7a9a6e4b3 service nova] Creating event network-vif-plugged:2430beb8-b2e4-4493-bdc5-df6b4c1181c6 for instance e4ada2d7-7ace-4ed4-86a6-ed121c95e80f on user Apr 13 16:22:01 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-f6880c77-0200-4033-a4c4-f0eb34235cd1 req-dbbe0b91-fc5e-4f34-83ab-dcb7a9a6e4b3 service nova] Creating event network-vif-plugged:2430beb8-b2e4-4493-bdc5-df6b4c1181c6 for instance e4ada2d7-7ace-4ed4-86a6-ed121c95e80f on user Apr 13 16:22:01 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [req-f6880c77-0200-4033-a4c4-f0eb34235cd1 req-dbbe0b91-fc5e-4f34-83ab-dcb7a9a6e4b3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.051659 Apr 13 16:22:01 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 51/157] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:22:00 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:22:01 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-c7ee1de2-e71a-42a9-a19b-5ad0cd2dbc1d req-b5ad3e10-83af-489d-8704-7df58abeeb23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4ada2d7-7ace-4ed4-86a6-ed121c95e80f", "name": "network-vif-plugged", "status": "completed", "tag": "8f3a3011-e474-4538-812b-9df3968fd629"}, {"server_uuid": "e4ada2d7-7ace-4ed4-86a6-ed121c95e80f", "name": "network-vif-plugged", "status": "completed", "tag": "15dca2c3-5048-4e80-8008-c19400ea34e4"}, {"server_uuid": "e4ada2d7-7ace-4ed4-86a6-ed121c95e80f", "name": "network-vif-plugged", "status": "completed", "tag": "15dca2c3-5048-4e80-8008-c19400ea34e4"}, {"server_uuid": "2549ba85-4e0a-420e-b711-07cafa8c60e9", "name": "network-vif-plugged", "status": "completed", "tag": "36152688-366c-40a2-8bf9-88f69925594a"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:22:01 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-c7ee1de2-e71a-42a9-a19b-5ad0cd2dbc1d req-b5ad3e10-83af-489d-8704-7df58abeeb23 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:22:01 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-c7ee1de2-e71a-42a9-a19b-5ad0cd2dbc1d req-b5ad3e10-83af-489d-8704-7df58abeeb23 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:22:01 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-c7ee1de2-e71a-42a9-a19b-5ad0cd2dbc1d req-b5ad3e10-83af-489d-8704-7df58abeeb23 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:22:01 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-c7ee1de2-e71a-42a9-a19b-5ad0cd2dbc1d req-b5ad3e10-83af-489d-8704-7df58abeeb23 service nova] Creating event network-vif-plugged:8f3a3011-e474-4538-812b-9df3968fd629 for instance e4ada2d7-7ace-4ed4-86a6-ed121c95e80f on user Apr 13 16:22:01 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-c7ee1de2-e71a-42a9-a19b-5ad0cd2dbc1d req-b5ad3e10-83af-489d-8704-7df58abeeb23 service nova] Creating event network-vif-plugged:15dca2c3-5048-4e80-8008-c19400ea34e4 for instance e4ada2d7-7ace-4ed4-86a6-ed121c95e80f on user Apr 13 16:22:01 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-c7ee1de2-e71a-42a9-a19b-5ad0cd2dbc1d req-b5ad3e10-83af-489d-8704-7df58abeeb23 service nova] Creating event network-vif-plugged:15dca2c3-5048-4e80-8008-c19400ea34e4 for instance e4ada2d7-7ace-4ed4-86a6-ed121c95e80f on user Apr 13 16:22:01 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-c7ee1de2-e71a-42a9-a19b-5ad0cd2dbc1d req-b5ad3e10-83af-489d-8704-7df58abeeb23 service nova] Creating event network-vif-plugged:36152688-366c-40a2-8bf9-88f69925594a for instance 2549ba85-4e0a-420e-b711-07cafa8c60e9 on user Apr 13 16:22:01 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [req-c7ee1de2-e71a-42a9-a19b-5ad0cd2dbc1d req-b5ad3e10-83af-489d-8704-7df58abeeb23 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.067873 Apr 13 16:22:01 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 51/158] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:22:01 2023] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:22:02 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-d218762f-690a-4580-b22e-3b0509d0eb43 req-3b3e4e3d-be75-478c-889b-114d77af6f8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2549ba85-4e0a-420e-b711-07cafa8c60e9", "name": "network-vif-plugged", "status": "completed", "tag": "d7155dcf-9e83-4579-b81a-7277d4a9eeaf"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:22:02 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-d218762f-690a-4580-b22e-3b0509d0eb43 req-3b3e4e3d-be75-478c-889b-114d77af6f8f service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:22:02 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-d218762f-690a-4580-b22e-3b0509d0eb43 req-3b3e4e3d-be75-478c-889b-114d77af6f8f service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:22:02 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-d218762f-690a-4580-b22e-3b0509d0eb43 req-3b3e4e3d-be75-478c-889b-114d77af6f8f service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:22:02 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-d218762f-690a-4580-b22e-3b0509d0eb43 req-3b3e4e3d-be75-478c-889b-114d77af6f8f service nova] Creating event network-vif-plugged:d7155dcf-9e83-4579-b81a-7277d4a9eeaf for instance 2549ba85-4e0a-420e-b711-07cafa8c60e9 on user Apr 13 16:22:02 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [req-d218762f-690a-4580-b22e-3b0509d0eb43 req-3b3e4e3d-be75-478c-889b-114d77af6f8f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045326 Apr 13 16:22:02 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 57/159] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:22:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:22:03 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [req-f2de8b81-5235-4de8-b0de-9f451199cedb req-66cee680-aa6b-40f0-b20f-aaeaac6b782e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4ada2d7-7ace-4ed4-86a6-ed121c95e80f", "name": "network-vif-plugged", "status": "completed", "tag": "d41765b6-0d5b-43c1-bf58-a82a7bbe3137"}, {"server_uuid": "e4ada2d7-7ace-4ed4-86a6-ed121c95e80f", "name": "network-vif-plugged", "status": "completed", "tag": "d41765b6-0d5b-43c1-bf58-a82a7bbe3137"}]} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:22:03 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-f2de8b81-5235-4de8-b0de-9f451199cedb req-66cee680-aa6b-40f0-b20f-aaeaac6b782e service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:22:03 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-f2de8b81-5235-4de8-b0de-9f451199cedb req-66cee680-aa6b-40f0-b20f-aaeaac6b782e service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:22:03 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-f2de8b81-5235-4de8-b0de-9f451199cedb req-66cee680-aa6b-40f0-b20f-aaeaac6b782e service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:22:03 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-f2de8b81-5235-4de8-b0de-9f451199cedb req-66cee680-aa6b-40f0-b20f-aaeaac6b782e service nova] Creating event network-vif-plugged:d41765b6-0d5b-43c1-bf58-a82a7bbe3137 for instance e4ada2d7-7ace-4ed4-86a6-ed121c95e80f on user Apr 13 16:22:03 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-f2de8b81-5235-4de8-b0de-9f451199cedb req-66cee680-aa6b-40f0-b20f-aaeaac6b782e service nova] Creating event network-vif-plugged:d41765b6-0d5b-43c1-bf58-a82a7bbe3137 for instance e4ada2d7-7ace-4ed4-86a6-ed121c95e80f on user Apr 13 16:22:03 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [req-f2de8b81-5235-4de8-b0de-9f451199cedb req-66cee680-aa6b-40f0-b20f-aaeaac6b782e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.031536 Apr 13 16:22:03 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 52/160] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:22:03 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:22:03 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-05711468-f1f4-410d-9e86-5e3faea12a95 req-baeebedc-aa80-4ec1-a532-7008194e1354 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2549ba85-4e0a-420e-b711-07cafa8c60e9", "name": "network-vif-plugged", "status": "completed", "tag": "36152688-366c-40a2-8bf9-88f69925594a"}, {"server_uuid": "2549ba85-4e0a-420e-b711-07cafa8c60e9", "name": "network-vif-plugged", "status": "completed", "tag": "4c481745-6342-43f8-9040-3ea1d8c5c572"}, {"server_uuid": "2549ba85-4e0a-420e-b711-07cafa8c60e9", "name": "network-vif-plugged", "status": "completed", "tag": "4c481745-6342-43f8-9040-3ea1d8c5c572"}, {"server_uuid": "2549ba85-4e0a-420e-b711-07cafa8c60e9", "name": "network-vif-plugged", "status": "completed", "tag": "0152bbb9-d50d-4e58-8a2b-727c4675ea2f"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:22:03 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-05711468-f1f4-410d-9e86-5e3faea12a95 req-baeebedc-aa80-4ec1-a532-7008194e1354 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:22:03 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-05711468-f1f4-410d-9e86-5e3faea12a95 req-baeebedc-aa80-4ec1-a532-7008194e1354 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:22:03 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-05711468-f1f4-410d-9e86-5e3faea12a95 req-baeebedc-aa80-4ec1-a532-7008194e1354 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:22:03 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-05711468-f1f4-410d-9e86-5e3faea12a95 req-baeebedc-aa80-4ec1-a532-7008194e1354 service nova] Creating event network-vif-plugged:36152688-366c-40a2-8bf9-88f69925594a for instance 2549ba85-4e0a-420e-b711-07cafa8c60e9 on user Apr 13 16:22:03 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-05711468-f1f4-410d-9e86-5e3faea12a95 req-baeebedc-aa80-4ec1-a532-7008194e1354 service nova] Creating event network-vif-plugged:4c481745-6342-43f8-9040-3ea1d8c5c572 for instance 2549ba85-4e0a-420e-b711-07cafa8c60e9 on user Apr 13 16:22:03 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-05711468-f1f4-410d-9e86-5e3faea12a95 req-baeebedc-aa80-4ec1-a532-7008194e1354 service nova] Creating event network-vif-plugged:4c481745-6342-43f8-9040-3ea1d8c5c572 for instance 2549ba85-4e0a-420e-b711-07cafa8c60e9 on user Apr 13 16:22:03 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-05711468-f1f4-410d-9e86-5e3faea12a95 req-baeebedc-aa80-4ec1-a532-7008194e1354 service nova] Creating event network-vif-plugged:0152bbb9-d50d-4e58-8a2b-727c4675ea2f for instance 2549ba85-4e0a-420e-b711-07cafa8c60e9 on user Apr 13 16:22:03 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [req-05711468-f1f4-410d-9e86-5e3faea12a95 req-baeebedc-aa80-4ec1-a532-7008194e1354 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.049890 Apr 13 16:22:03 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 52/161] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:22:03 2023] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:22:04 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-f5921e11-4030-4131-9efc-8f1f53ecae84 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1280800160", "imageRef": "708622a9-7465-4492-ade8-b827198f7e30", "flavorRef": "42", "networks": [{"uuid": "ae7f770e-a460-4297-91b5-ed0b908a895a"}]}} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:22:04 user devstack@n-api.service[62054]: DEBUG nova.network.neutron [None req-f5921e11-4030-4131-9efc-8f1f53ecae84 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] validate_networks() for [('ae7f770e-a460-4297-91b5-ed0b908a895a', None, None, None, None, None)] {{(pid=62054) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 16:22:04 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [req-4538fb68-2d89-42e7-8ba4-ba9f8fca92c3 req-3714faa3-a25d-4da3-80a4-b375b69dbf7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2549ba85-4e0a-420e-b711-07cafa8c60e9", "name": "network-vif-plugged", "status": "completed", "tag": "d7155dcf-9e83-4579-b81a-7277d4a9eeaf"}]} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:22:04 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-4538fb68-2d89-42e7-8ba4-ba9f8fca92c3 req-3714faa3-a25d-4da3-80a4-b375b69dbf7c service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:22:04 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-4538fb68-2d89-42e7-8ba4-ba9f8fca92c3 req-3714faa3-a25d-4da3-80a4-b375b69dbf7c service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:22:04 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-4538fb68-2d89-42e7-8ba4-ba9f8fca92c3 req-3714faa3-a25d-4da3-80a4-b375b69dbf7c service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:22:04 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-4538fb68-2d89-42e7-8ba4-ba9f8fca92c3 req-3714faa3-a25d-4da3-80a4-b375b69dbf7c service nova] Creating event network-vif-plugged:d7155dcf-9e83-4579-b81a-7277d4a9eeaf for instance 2549ba85-4e0a-420e-b711-07cafa8c60e9 on user Apr 13 16:22:04 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [req-4538fb68-2d89-42e7-8ba4-ba9f8fca92c3 req-3714faa3-a25d-4da3-80a4-b375b69dbf7c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032942 Apr 13 16:22:04 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 53/162] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:22:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:22:04 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-843e772f-18b8-40de-8f3a-53aaedd6c697 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-1315023828"}} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:22:04 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-843e772f-18b8-40de-8f3a-53aaedd6c697 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: f66553f5-5e1b-4f1d-8c5a-63bc340f7586] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:22:04 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-843e772f-18b8-40de-8f3a-53aaedd6c697 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:22:04 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-843e772f-18b8-40de-8f3a-53aaedd6c697 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:22:04 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-843e772f-18b8-40de-8f3a-53aaedd6c697 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:22:04 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-843e772f-18b8-40de-8f3a-53aaedd6c697 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:22:04 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-843e772f-18b8-40de-8f3a-53aaedd6c697 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:22:04 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-843e772f-18b8-40de-8f3a-53aaedd6c697 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:22:04 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_cell1:SELECT=29 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:22:05 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [req-eaff66f5-1465-4b56-bb5f-e5d848b551cb req-61e5c9b2-2b25-4a22-9c78-55327a2c8efd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2549ba85-4e0a-420e-b711-07cafa8c60e9", "name": "network-vif-plugged", "status": "completed", "tag": "0fbdf291-df5d-41c5-a765-7145a87da272"}, {"server_uuid": "2549ba85-4e0a-420e-b711-07cafa8c60e9", "name": "network-vif-plugged", "status": "completed", "tag": "0fbdf291-df5d-41c5-a765-7145a87da272"}, {"server_uuid": "2549ba85-4e0a-420e-b711-07cafa8c60e9", "name": "network-vif-plugged", "status": "completed", "tag": "38e92b7c-b7c1-4137-a1db-21bc1d24f3ee"}]} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:22:05 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-eaff66f5-1465-4b56-bb5f-e5d848b551cb req-61e5c9b2-2b25-4a22-9c78-55327a2c8efd service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:22:05 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-eaff66f5-1465-4b56-bb5f-e5d848b551cb req-61e5c9b2-2b25-4a22-9c78-55327a2c8efd service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:22:05 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-eaff66f5-1465-4b56-bb5f-e5d848b551cb req-61e5c9b2-2b25-4a22-9c78-55327a2c8efd service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:22:05 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-eaff66f5-1465-4b56-bb5f-e5d848b551cb req-61e5c9b2-2b25-4a22-9c78-55327a2c8efd service nova] Creating event network-vif-plugged:0fbdf291-df5d-41c5-a765-7145a87da272 for instance 2549ba85-4e0a-420e-b711-07cafa8c60e9 on user Apr 13 16:22:05 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-eaff66f5-1465-4b56-bb5f-e5d848b551cb req-61e5c9b2-2b25-4a22-9c78-55327a2c8efd service nova] Creating event network-vif-plugged:0fbdf291-df5d-41c5-a765-7145a87da272 for instance 2549ba85-4e0a-420e-b711-07cafa8c60e9 on user Apr 13 16:22:05 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-eaff66f5-1465-4b56-bb5f-e5d848b551cb req-61e5c9b2-2b25-4a22-9c78-55327a2c8efd service nova] Creating event network-vif-plugged:38e92b7c-b7c1-4137-a1db-21bc1d24f3ee for instance 2549ba85-4e0a-420e-b711-07cafa8c60e9 on user Apr 13 16:22:05 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [req-eaff66f5-1465-4b56-bb5f-e5d848b551cb req-61e5c9b2-2b25-4a22-9c78-55327a2c8efd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.036711 Apr 13 16:22:05 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 54/163] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:22:05 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:22:05 user devstack@n-api.service[62054]: DEBUG nova.virt.hardware [None req-f5921e11-4030-4131-9efc-8f1f53ecae84 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Flavor limits 0:0:0 {{(pid=62054) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 16:22:05 user devstack@n-api.service[62054]: DEBUG nova.virt.hardware [None req-f5921e11-4030-4131-9efc-8f1f53ecae84 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Image limits 0:0:0 {{(pid=62054) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 16:22:05 user devstack@n-api.service[62054]: DEBUG nova.virt.hardware [None req-f5921e11-4030-4131-9efc-8f1f53ecae84 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Flavor pref 0:0:0 {{(pid=62054) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 16:22:05 user devstack@n-api.service[62054]: DEBUG nova.virt.hardware [None req-f5921e11-4030-4131-9efc-8f1f53ecae84 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Image pref 0:0:0 {{(pid=62054) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 16:22:05 user devstack@n-api.service[62054]: DEBUG nova.virt.hardware [None req-f5921e11-4030-4131-9efc-8f1f53ecae84 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62054) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 16:22:05 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-f5921e11-4030-4131-9efc-8f1f53ecae84 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:22:05 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-f5921e11-4030-4131-9efc-8f1f53ecae84 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:22:05 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-f5921e11-4030-4131-9efc-8f1f53ecae84 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:22:05 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-f5921e11-4030-4131-9efc-8f1f53ecae84 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:22:05 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-f5921e11-4030-4131-9efc-8f1f53ecae84 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:22:05 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-f5921e11-4030-4131-9efc-8f1f53ecae84 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:22:05 user devstack@n-api.service[62054]: DEBUG nova.quota [None req-f5921e11-4030-4131-9efc-8f1f53ecae84 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Getting quotas for project 5554aa7f1b4d471b8807a845ab1ea33f. Resources: {'instances', 'cores', 'ram'} {{(pid=62054) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 16:22:05 user devstack@n-api.service[62054]: DEBUG nova.quota [None req-f5921e11-4030-4131-9efc-8f1f53ecae84 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Getting quotas for user 4ddd547d240b43ccb213e9d459082309 and project 5554aa7f1b4d471b8807a845ab1ea33f. Resources: {'instances', 'cores', 'ram'} {{(pid=62054) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 16:22:05 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-f5921e11-4030-4131-9efc-8f1f53ecae84 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Going to run 1 instances... {{(pid=62054) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 16:22:05 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-f5921e11-4030-4131-9efc-8f1f53ecae84 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] [instance: 0e731607-fce1-4f19-9e4b-5b892e760179] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='708622a9-7465-4492-ade8-b827198f7e30',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=62054) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 16:22:05 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-f5921e11-4030-4131-9efc-8f1f53ecae84 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 1.304848 Apr 13 16:22:05 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 58/164] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 16:22:04 2023] POST /compute/v2.1/servers => generated 378 bytes in 1306 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 16:22:05 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-8118e6b8-bd0d-43c0-b6c8-e72ed1b39e9c tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:22:05 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-8118e6b8-bd0d-43c0-b6c8-e72ed1b39e9c tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] [instance: 0e731607-fce1-4f19-9e4b-5b892e760179] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:22:05 user devstack@n-api.service[62055]: DEBUG nova.policy [None req-8118e6b8-bd0d-43c0-b6c8-e72ed1b39e9c tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ddd547d240b43ccb213e9d459082309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5554aa7f1b4d471b8807a845ab1ea33f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62055) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:22:05 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-8118e6b8-bd0d-43c0-b6c8-e72ed1b39e9c tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0e731607-fce1-4f19-9e4b-5b892e760179" status: 200 len: 1211 microversion: 2.1 time: 0.098500 Apr 13 16:22:05 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-843e772f-18b8-40de-8f3a-53aaedd6c697 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] 10.0.0.210 "POST /compute/v2.1/servers/f66553f5-5e1b-4f1d-8c5a-63bc340f7586/action" status: 202 len: 52 microversion: 2.87 time: 1.180597 Apr 13 16:22:05 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 53/166] 10.0.0.210 () {66 vars in 1396 bytes} [Thu Apr 13 16:22:04 2023] POST /compute/v2.1/servers/f66553f5-5e1b-4f1d-8c5a-63bc340f7586/action => generated 52 bytes in 1182 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Apr 13 16:22:05 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 55/166] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:22:05 2023] GET /compute/v2.1/servers/0e731607-fce1-4f19-9e4b-5b892e760179 => generated 1211 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:22:05 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-2cb1d2e4-6dba-4d31-9061-725beed7dfe7 req-65f212b2-865c-47f7-9ad5-9bbd84435334 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2549ba85-4e0a-420e-b711-07cafa8c60e9", "name": "network-vif-plugged", "status": "completed", "tag": "0152bbb9-d50d-4e58-8a2b-727c4675ea2f"}, {"server_uuid": "2549ba85-4e0a-420e-b711-07cafa8c60e9", "name": "network-vif-plugged", "status": "completed", "tag": "3730ed6e-b093-4232-800b-b064d650e9e8"}, {"server_uuid": "2549ba85-4e0a-420e-b711-07cafa8c60e9", "name": "network-vif-plugged", "status": "completed", "tag": "3730ed6e-b093-4232-800b-b064d650e9e8"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:22:05 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-2cb1d2e4-6dba-4d31-9061-725beed7dfe7 req-65f212b2-865c-47f7-9ad5-9bbd84435334 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:22:05 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-2cb1d2e4-6dba-4d31-9061-725beed7dfe7 req-65f212b2-865c-47f7-9ad5-9bbd84435334 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:22:05 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-2cb1d2e4-6dba-4d31-9061-725beed7dfe7 req-65f212b2-865c-47f7-9ad5-9bbd84435334 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:22:05 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-2cb1d2e4-6dba-4d31-9061-725beed7dfe7 req-65f212b2-865c-47f7-9ad5-9bbd84435334 service nova] Creating event network-vif-plugged:0152bbb9-d50d-4e58-8a2b-727c4675ea2f for instance 2549ba85-4e0a-420e-b711-07cafa8c60e9 on user Apr 13 16:22:05 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-2cb1d2e4-6dba-4d31-9061-725beed7dfe7 req-65f212b2-865c-47f7-9ad5-9bbd84435334 service nova] Creating event network-vif-plugged:3730ed6e-b093-4232-800b-b064d650e9e8 for instance 2549ba85-4e0a-420e-b711-07cafa8c60e9 on user Apr 13 16:22:05 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-2cb1d2e4-6dba-4d31-9061-725beed7dfe7 req-65f212b2-865c-47f7-9ad5-9bbd84435334 service nova] Creating event network-vif-plugged:3730ed6e-b093-4232-800b-b064d650e9e8 for instance 2549ba85-4e0a-420e-b711-07cafa8c60e9 on user Apr 13 16:22:05 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [req-2cb1d2e4-6dba-4d31-9061-725beed7dfe7 req-65f212b2-865c-47f7-9ad5-9bbd84435334 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.039058 Apr 13 16:22:05 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 59/167] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:22:05 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:22:07 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-c595c58c-808e-449d-81a8-0bbcfb8723c4 req-04568128-076f-420e-b01e-bccd17e3d96a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2549ba85-4e0a-420e-b711-07cafa8c60e9", "name": "network-vif-plugged", "status": "completed", "tag": "38e92b7c-b7c1-4137-a1db-21bc1d24f3ee"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:22:07 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-c595c58c-808e-449d-81a8-0bbcfb8723c4 req-04568128-076f-420e-b01e-bccd17e3d96a service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:22:07 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-c595c58c-808e-449d-81a8-0bbcfb8723c4 req-04568128-076f-420e-b01e-bccd17e3d96a service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:22:07 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-c595c58c-808e-449d-81a8-0bbcfb8723c4 req-04568128-076f-420e-b01e-bccd17e3d96a service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:22:07 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-c595c58c-808e-449d-81a8-0bbcfb8723c4 req-04568128-076f-420e-b01e-bccd17e3d96a service nova] Creating event network-vif-plugged:38e92b7c-b7c1-4137-a1db-21bc1d24f3ee for instance 2549ba85-4e0a-420e-b711-07cafa8c60e9 on user Apr 13 16:22:07 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [req-c595c58c-808e-449d-81a8-0bbcfb8723c4 req-04568128-076f-420e-b01e-bccd17e3d96a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044454 Apr 13 16:22:07 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 54/168] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:22:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:22:10 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [req-81b4c31c-17c3-4b43-9a96-8d0268142283 req-900ef3f0-0b34-4a30-bf00-44821bb99f65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e731607-fce1-4f19-9e4b-5b892e760179", "tag": "62eabc99-73ed-4669-a7ce-6fc646611ff1"}]} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:22:10 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-81b4c31c-17c3-4b43-9a96-8d0268142283 req-900ef3f0-0b34-4a30-bf00-44821bb99f65 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:22:10 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-81b4c31c-17c3-4b43-9a96-8d0268142283 req-900ef3f0-0b34-4a30-bf00-44821bb99f65 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:22:10 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-81b4c31c-17c3-4b43-9a96-8d0268142283 req-900ef3f0-0b34-4a30-bf00-44821bb99f65 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:22:10 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-81b4c31c-17c3-4b43-9a96-8d0268142283 req-900ef3f0-0b34-4a30-bf00-44821bb99f65 service nova] Creating event network-changed:62eabc99-73ed-4669-a7ce-6fc646611ff1 for instance 0e731607-fce1-4f19-9e4b-5b892e760179 on user Apr 13 16:22:10 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [req-81b4c31c-17c3-4b43-9a96-8d0268142283 req-900ef3f0-0b34-4a30-bf00-44821bb99f65 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038692 Apr 13 16:22:10 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 56/169] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:22:10 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:22:12 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-a9e9309a-4a8d-4ece-ad0d-a2ad2657c5d6 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-141352368", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"uuid": "ba3ff5e1-f4df-4fb9-a662-f485cc0949e6", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "d36bc206-f629-4d6e-8a3f-458061d7b525"}]}} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:22:12 user devstack@n-api.service[62054]: DEBUG nova.network.neutron [None req-a9e9309a-4a8d-4ece-ad0d-a2ad2657c5d6 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] validate_networks() for [('d36bc206-f629-4d6e-8a3f-458061d7b525', None, None, None, None, None)] {{(pid=62054) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 16:22:12 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-59be973a-8e9c-4556-a22c-e4228f6bdbe0 req-768dfc16-f433-4729-80b5-f7aca232e563 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e731607-fce1-4f19-9e4b-5b892e760179", "name": "network-vif-plugged", "status": "completed", "tag": "62eabc99-73ed-4669-a7ce-6fc646611ff1"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:22:12 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-59be973a-8e9c-4556-a22c-e4228f6bdbe0 req-768dfc16-f433-4729-80b5-f7aca232e563 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:22:12 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-59be973a-8e9c-4556-a22c-e4228f6bdbe0 req-768dfc16-f433-4729-80b5-f7aca232e563 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:22:12 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-59be973a-8e9c-4556-a22c-e4228f6bdbe0 req-768dfc16-f433-4729-80b5-f7aca232e563 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:22:12 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-59be973a-8e9c-4556-a22c-e4228f6bdbe0 req-768dfc16-f433-4729-80b5-f7aca232e563 service nova] Creating event network-vif-plugged:62eabc99-73ed-4669-a7ce-6fc646611ff1 for instance 0e731607-fce1-4f19-9e4b-5b892e760179 on user Apr 13 16:22:12 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [req-59be973a-8e9c-4556-a22c-e4228f6bdbe0 req-768dfc16-f433-4729-80b5-f7aca232e563 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054614 Apr 13 16:22:12 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 55/170] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:22:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:22:12 user devstack@n-api.service[62054]: DEBUG nova.virt.hardware [None req-a9e9309a-4a8d-4ece-ad0d-a2ad2657c5d6 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Flavor limits 0:0:0 {{(pid=62054) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 16:22:12 user devstack@n-api.service[62054]: DEBUG nova.virt.hardware [None req-a9e9309a-4a8d-4ece-ad0d-a2ad2657c5d6 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Image limits 0:0:0 {{(pid=62054) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 16:22:12 user devstack@n-api.service[62054]: DEBUG nova.virt.hardware [None req-a9e9309a-4a8d-4ece-ad0d-a2ad2657c5d6 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Flavor pref 0:0:0 {{(pid=62054) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 16:22:12 user devstack@n-api.service[62054]: DEBUG nova.virt.hardware [None req-a9e9309a-4a8d-4ece-ad0d-a2ad2657c5d6 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Image pref 0:0:0 {{(pid=62054) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 16:22:12 user devstack@n-api.service[62054]: DEBUG nova.virt.hardware [None req-a9e9309a-4a8d-4ece-ad0d-a2ad2657c5d6 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62054) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 16:22:12 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-a9e9309a-4a8d-4ece-ad0d-a2ad2657c5d6 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:22:12 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-a9e9309a-4a8d-4ece-ad0d-a2ad2657c5d6 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:22:12 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-a9e9309a-4a8d-4ece-ad0d-a2ad2657c5d6 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:22:12 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-a9e9309a-4a8d-4ece-ad0d-a2ad2657c5d6 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:22:12 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-a9e9309a-4a8d-4ece-ad0d-a2ad2657c5d6 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:22:12 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-a9e9309a-4a8d-4ece-ad0d-a2ad2657c5d6 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:22:12 user devstack@n-api.service[62054]: DEBUG nova.quota [None req-a9e9309a-4a8d-4ece-ad0d-a2ad2657c5d6 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Getting quotas for project 8d451e0e239f486aa2b3abe9e273eab3. Resources: {'instances', 'cores', 'ram'} {{(pid=62054) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 16:22:12 user devstack@n-api.service[62054]: DEBUG nova.quota [None req-a9e9309a-4a8d-4ece-ad0d-a2ad2657c5d6 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Getting quotas for user d70e10f63cdd49a9a1ebe1fe4c9de0a2 and project 8d451e0e239f486aa2b3abe9e273eab3. Resources: {'instances', 'cores', 'ram'} {{(pid=62054) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 16:22:12 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-a9e9309a-4a8d-4ece-ad0d-a2ad2657c5d6 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Going to run 1 instances... {{(pid=62054) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 16:22:12 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-a9e9309a-4a8d-4ece-ad0d-a2ad2657c5d6 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: db65920b-7872-44c1-a68a-a696681d9d95] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='ba3ff5e1-f4df-4fb9-a662-f485cc0949e6',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=62054) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 16:22:12 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-a9e9309a-4a8d-4ece-ad0d-a2ad2657c5d6 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.816401 Apr 13 16:22:12 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 60/171] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 16:22:12 2023] POST /compute/v2.1/servers => generated 378 bytes in 818 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Apr 13 16:22:12 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-bdc377d3-0dfc-472e-a580-6de3aa011b7c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:22:12 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-bdc377d3-0dfc-472e-a580-6de3aa011b7c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: db65920b-7872-44c1-a68a-a696681d9d95] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:22:13 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-075366c4-32a9-4b50-8ad4-7bdbc3d14947 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:22:13 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-075366c4-32a9-4b50-8ad4-7bdbc3d14947 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: f66553f5-5e1b-4f1d-8c5a-63bc340f7586] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:22:13 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-075366c4-32a9-4b50-8ad4-7bdbc3d14947 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:22:13 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-075366c4-32a9-4b50-8ad4-7bdbc3d14947 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:22:13 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-075366c4-32a9-4b50-8ad4-7bdbc3d14947 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:22:13 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-075366c4-32a9-4b50-8ad4-7bdbc3d14947 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:22:13 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-075366c4-32a9-4b50-8ad4-7bdbc3d14947 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:22:13 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-075366c4-32a9-4b50-8ad4-7bdbc3d14947 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:22:13 user devstack@n-api.service[62055]: DEBUG nova.policy [None req-bdc377d3-0dfc-472e-a580-6de3aa011b7c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e10f63cdd49a9a1ebe1fe4c9de0a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d451e0e239f486aa2b3abe9e273eab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62055) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:22:13 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-bdc377d3-0dfc-472e-a580-6de3aa011b7c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] 10.0.0.210 "GET /compute/v2.1/servers/db65920b-7872-44c1-a68a-a696681d9d95" status: 200 len: 1051 microversion: 2.1 time: 0.105070 Apr 13 16:22:13 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 57/172] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:22:12 2023] GET /compute/v2.1/servers/db65920b-7872-44c1-a68a-a696681d9d95 => generated 1051 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:22:13 user devstack@n-api.service[62053]: DEBUG nova.policy [None req-075366c4-32a9-4b50-8ad4-7bdbc3d14947 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45a882dbafb4ea4976e4f45289eb2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d09a74bf684a9fb1dd1e95d6c23f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62053) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:22:13 user devstack@n-api.service[62053]: DEBUG nova.policy [None req-075366c4-32a9-4b50-8ad4-7bdbc3d14947 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e45a882dbafb4ea4976e4f45289eb2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d09a74bf684a9fb1dd1e95d6c23f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62053) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:22:13 user devstack@n-api.service[62053]: DEBUG nova.policy [None req-075366c4-32a9-4b50-8ad4-7bdbc3d14947 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e45a882dbafb4ea4976e4f45289eb2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d09a74bf684a9fb1dd1e95d6c23f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62053) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:22:13 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-075366c4-32a9-4b50-8ad4-7bdbc3d14947 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f66553f5-5e1b-4f1d-8c5a-63bc340f7586" status: 200 len: 1691 microversion: 2.87 time: 0.179606 Apr 13 16:22:13 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 56/173] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 16:22:13 2023] GET /compute/v2.1/servers/f66553f5-5e1b-4f1d-8c5a-63bc340f7586 => generated 1691 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 16:22:14 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-9c1094ae-18c2-42d1-a8a7-466f60ab36b3 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:22:14 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-9c1094ae-18c2-42d1-a8a7-466f60ab36b3 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:22:14 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-9c1094ae-18c2-42d1-a8a7-466f60ab36b3 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:22:14 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-9c1094ae-18c2-42d1-a8a7-466f60ab36b3 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:22:14 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-9c1094ae-18c2-42d1-a8a7-466f60ab36b3 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:22:14 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-9c1094ae-18c2-42d1-a8a7-466f60ab36b3 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:22:14 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-9c1094ae-18c2-42d1-a8a7-466f60ab36b3 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:22:14 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-9c1094ae-18c2-42d1-a8a7-466f60ab36b3 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:22:14 user devstack@n-api.service[62054]: DEBUG nova.policy [None req-9c1094ae-18c2-42d1-a8a7-466f60ab36b3 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e50bd9d540549a194f706dac48ce93d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649e366b0164e2fa5b3faa0830b6ea6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62054) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:22:14 user devstack@n-api.service[62054]: DEBUG nova.policy [None req-9c1094ae-18c2-42d1-a8a7-466f60ab36b3 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e50bd9d540549a194f706dac48ce93d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649e366b0164e2fa5b3faa0830b6ea6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62054) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:22:14 user devstack@n-api.service[62054]: DEBUG nova.policy [None req-9c1094ae-18c2-42d1-a8a7-466f60ab36b3 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e50bd9d540549a194f706dac48ce93d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649e366b0164e2fa5b3faa0830b6ea6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62054) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:22:14 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-9c1094ae-18c2-42d1-a8a7-466f60ab36b3 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e4ada2d7-7ace-4ed4-86a6-ed121c95e80f" status: 200 len: 2822 microversion: 2.42 time: 0.345808 Apr 13 16:22:14 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 61/174] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 16:22:14 2023] GET /compute/v2.1/servers/e4ada2d7-7ace-4ed4-86a6-ed121c95e80f => generated 2822 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 16:22:14 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-8b5417d7-31ef-4834-b9d5-517c6a99de62 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:22:14 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-8b5417d7-31ef-4834-b9d5-517c6a99de62 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:22:14 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-8b5417d7-31ef-4834-b9d5-517c6a99de62 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:22:14 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-8b5417d7-31ef-4834-b9d5-517c6a99de62 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:22:14 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-8b5417d7-31ef-4834-b9d5-517c6a99de62 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:22:14 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-8b5417d7-31ef-4834-b9d5-517c6a99de62 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:22:14 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-8b5417d7-31ef-4834-b9d5-517c6a99de62 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:22:14 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-8b5417d7-31ef-4834-b9d5-517c6a99de62 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:22:14 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-5f40c581-2a66-4bc7-abd0-26377ab78104 req-a5ab1357-6800-490f-96cb-e9c164678881 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e731607-fce1-4f19-9e4b-5b892e760179", "name": "network-vif-plugged", "status": "completed", "tag": "62eabc99-73ed-4669-a7ce-6fc646611ff1"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:22:14 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-5f40c581-2a66-4bc7-abd0-26377ab78104 req-a5ab1357-6800-490f-96cb-e9c164678881 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:22:14 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-5f40c581-2a66-4bc7-abd0-26377ab78104 req-a5ab1357-6800-490f-96cb-e9c164678881 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:22:14 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-5f40c581-2a66-4bc7-abd0-26377ab78104 req-a5ab1357-6800-490f-96cb-e9c164678881 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:22:14 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-5f40c581-2a66-4bc7-abd0-26377ab78104 req-a5ab1357-6800-490f-96cb-e9c164678881 service nova] Creating event network-vif-plugged:62eabc99-73ed-4669-a7ce-6fc646611ff1 for instance 0e731607-fce1-4f19-9e4b-5b892e760179 on user Apr 13 16:22:14 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [req-5f40c581-2a66-4bc7-abd0-26377ab78104 req-a5ab1357-6800-490f-96cb-e9c164678881 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048616 Apr 13 16:22:14 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 57/175] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:22:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:22:14 user devstack@n-api.service[62055]: DEBUG nova.policy [None req-8b5417d7-31ef-4834-b9d5-517c6a99de62 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14566b85d0424c08999726ff72a67634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe4e9fb786d4015b035b4d00f75a1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62055) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:22:14 user devstack@n-api.service[62055]: DEBUG nova.policy [None req-8b5417d7-31ef-4834-b9d5-517c6a99de62 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14566b85d0424c08999726ff72a67634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe4e9fb786d4015b035b4d00f75a1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62055) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:22:14 user devstack@n-api.service[62055]: DEBUG nova.policy [None req-8b5417d7-31ef-4834-b9d5-517c6a99de62 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14566b85d0424c08999726ff72a67634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe4e9fb786d4015b035b4d00f75a1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62055) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:22:14 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-8b5417d7-31ef-4834-b9d5-517c6a99de62 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2549ba85-4e0a-420e-b711-07cafa8c60e9" status: 200 len: 2822 microversion: 2.32 time: 0.298840 Apr 13 16:22:14 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 58/176] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 16:22:14 2023] GET /compute/v2.1/servers/2549ba85-4e0a-420e-b711-07cafa8c60e9 => generated 2822 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 16:22:15 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-1e1c0815-e8ed-4b93-8798-53757435d424 req-107b206a-81bc-4a59-9205-3edeb7ae9a41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db65920b-7872-44c1-a68a-a696681d9d95", "tag": "ba686724-ae8a-4e16-9918-d7b2fc64ff62"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:22:15 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-1e1c0815-e8ed-4b93-8798-53757435d424 req-107b206a-81bc-4a59-9205-3edeb7ae9a41 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:22:15 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-1e1c0815-e8ed-4b93-8798-53757435d424 req-107b206a-81bc-4a59-9205-3edeb7ae9a41 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:22:15 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-1e1c0815-e8ed-4b93-8798-53757435d424 req-107b206a-81bc-4a59-9205-3edeb7ae9a41 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:22:15 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-1e1c0815-e8ed-4b93-8798-53757435d424 req-107b206a-81bc-4a59-9205-3edeb7ae9a41 service nova] Creating event network-changed:ba686724-ae8a-4e16-9918-d7b2fc64ff62 for instance db65920b-7872-44c1-a68a-a696681d9d95 on user Apr 13 16:22:15 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [req-1e1c0815-e8ed-4b93-8798-53757435d424 req-107b206a-81bc-4a59-9205-3edeb7ae9a41 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040849 Apr 13 16:22:15 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 62/177] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:22:15 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:22:16 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-8ec9283e-3674-4995-833a-40927141b14d tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "91d1caca-70d0-452f-800d-0073afd5d0c4"}} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:22:16 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-8ec9283e-3674-4995-833a-40927141b14d tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] [instance: 823749e1-56ca-44f9-be83-a36b4851c28f] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:22:16 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-8ec9283e-3674-4995-833a-40927141b14d tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:22:16 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-8ec9283e-3674-4995-833a-40927141b14d tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:22:16 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-8ec9283e-3674-4995-833a-40927141b14d tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:22:16 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-8ec9283e-3674-4995-833a-40927141b14d tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:22:16 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-8ec9283e-3674-4995-833a-40927141b14d tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:22:16 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-8ec9283e-3674-4995-833a-40927141b14d tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:22:17 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-8ec9283e-3674-4995-833a-40927141b14d tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] 10.0.0.210 "POST /compute/v2.1/servers/823749e1-56ca-44f9-be83-a36b4851c28f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.380286 Apr 13 16:22:17 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 58/178] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 16:22:16 2023] POST /compute/v2.1/servers/823749e1-56ca-44f9-be83-a36b4851c28f/os-volume_attachments => generated 194 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:22:18 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-95a1f8e6-00d2-4f0a-9cbc-5995d9e099b3 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:22:18 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-95a1f8e6-00d2-4f0a-9cbc-5995d9e099b3 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:22:18 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-95a1f8e6-00d2-4f0a-9cbc-5995d9e099b3 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:22:18 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-95a1f8e6-00d2-4f0a-9cbc-5995d9e099b3 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:22:18 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-95a1f8e6-00d2-4f0a-9cbc-5995d9e099b3 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:22:18 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-95a1f8e6-00d2-4f0a-9cbc-5995d9e099b3 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:22:18 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-95a1f8e6-00d2-4f0a-9cbc-5995d9e099b3 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:22:18 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-95a1f8e6-00d2-4f0a-9cbc-5995d9e099b3 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:22:18 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-95a1f8e6-00d2-4f0a-9cbc-5995d9e099b3 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bbcccf4b-e861-4254-9be3-a491776214e9/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.126820 Apr 13 16:22:18 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 59/179] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 13 16:22:18 2023] GET /compute/v2.1/servers/bbcccf4b-e861-4254-9be3-a491776214e9/os-interface => generated 282 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:22:19 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-03e62715-3d97-4c5b-835a-423ed6a17004 req-4dd4b52f-cf04-48b6-8a26-59b304870cec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbcccf4b-e861-4254-9be3-a491776214e9", "tag": "dbb2bf27-5de3-499c-ba4d-87867912a143"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:22:19 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-03e62715-3d97-4c5b-835a-423ed6a17004 req-4dd4b52f-cf04-48b6-8a26-59b304870cec service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:22:19 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-03e62715-3d97-4c5b-835a-423ed6a17004 req-4dd4b52f-cf04-48b6-8a26-59b304870cec service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:22:19 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-03e62715-3d97-4c5b-835a-423ed6a17004 req-4dd4b52f-cf04-48b6-8a26-59b304870cec service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:22:19 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-03e62715-3d97-4c5b-835a-423ed6a17004 req-4dd4b52f-cf04-48b6-8a26-59b304870cec service nova] Creating event network-changed:dbb2bf27-5de3-499c-ba4d-87867912a143 for instance bbcccf4b-e861-4254-9be3-a491776214e9 on user Apr 13 16:22:19 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [req-03e62715-3d97-4c5b-835a-423ed6a17004 req-4dd4b52f-cf04-48b6-8a26-59b304870cec service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041116 Apr 13 16:22:19 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 63/180] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:22:19 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:22:19 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-3a0f5dbf-e6a1-4d30-9eab-6cfd8107b17f tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerStableDeviceRescueTest-image-646580807"}} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:22:19 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-3a0f5dbf-e6a1-4d30-9eab-6cfd8107b17f tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:22:19 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_api:SELECT=22 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:22:19 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-3a0f5dbf-e6a1-4d30-9eab-6cfd8107b17f tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:22:19 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-3a0f5dbf-e6a1-4d30-9eab-6cfd8107b17f tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:22:19 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-3a0f5dbf-e6a1-4d30-9eab-6cfd8107b17f tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:22:19 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-3a0f5dbf-e6a1-4d30-9eab-6cfd8107b17f tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:22:19 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-3a0f5dbf-e6a1-4d30-9eab-6cfd8107b17f tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:22:19 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-3a0f5dbf-e6a1-4d30-9eab-6cfd8107b17f tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:22:20 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-3a0f5dbf-e6a1-4d30-9eab-6cfd8107b17f tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] 10.0.0.210 "POST /compute/v2.1/servers/bbcccf4b-e861-4254-9be3-a491776214e9/action" status: 202 len: 0 microversion: 2.1 time: 0.930833 Apr 13 16:22:20 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 59/181] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 16:22:19 2023] POST /compute/v2.1/servers/bbcccf4b-e861-4254-9be3-a491776214e9/action => generated 0 bytes in 933 msecs (HTTP/1.1 202) 10 headers in 449 bytes (2 switches on core 0) Apr 13 16:22:20 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-51ad0ecf-b00f-4c35-9370-3d18827b3e77 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Calling method '.version_select at 0x7f96e4d61cf0>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:22:20 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-51ad0ecf-b00f-4c35-9370-3d18827b3e77 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] 10.0.0.210 "GET /compute/v2.1/images/fe56253b-3d7f-43e5-9008-6d9c17385e97" status: 200 len: 1610 microversion: 2.1 time: 0.079815 Apr 13 16:22:20 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 60/182] 10.0.0.210 () {62 vars in 1310 bytes} [Thu Apr 13 16:22:20 2023] GET /compute/v2.1/images/fe56253b-3d7f-43e5-9008-6d9c17385e97 => generated 1610 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:22:24 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_cell0:SELECT=4 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:22:24 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_cell0:SELECT=12 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:22:24 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-ef61c617-614d-4200-bf83-d162e485a54c tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:22:24 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-ef61c617-614d-4200-bf83-d162e485a54c tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] [instance: 823749e1-56ca-44f9-be83-a36b4851c28f] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:22:24 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-ef61c617-614d-4200-bf83-d162e485a54c tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:22:24 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-ef61c617-614d-4200-bf83-d162e485a54c tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:22:24 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-ef61c617-614d-4200-bf83-d162e485a54c tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:22:24 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-ef61c617-614d-4200-bf83-d162e485a54c tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:22:24 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-ef61c617-614d-4200-bf83-d162e485a54c tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:22:24 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-ef61c617-614d-4200-bf83-d162e485a54c tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:22:24 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-ef61c617-614d-4200-bf83-d162e485a54c tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] [instance: 823749e1-56ca-44f9-be83-a36b4851c28f] Going to try to terminate instance {{(pid=62054) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 16:22:25 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-ef61c617-614d-4200-bf83-d162e485a54c tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/823749e1-56ca-44f9-be83-a36b4851c28f" status: 204 len: 0 microversion: 2.1 time: 0.473419 Apr 13 16:22:25 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 64/183] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 16:22:24 2023] DELETE /compute/v2.1/servers/823749e1-56ca-44f9-be83-a36b4851c28f => generated 0 bytes in 475 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 16:22:25 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-5ee16873-c247-403f-a6fa-ef3cc7ffd1c2 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:22:25 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-5ee16873-c247-403f-a6fa-ef3cc7ffd1c2 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] [instance: 823749e1-56ca-44f9-be83-a36b4851c28f] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:22:25 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-5ee16873-c247-403f-a6fa-ef3cc7ffd1c2 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:22:25 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-5ee16873-c247-403f-a6fa-ef3cc7ffd1c2 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:22:25 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-5ee16873-c247-403f-a6fa-ef3cc7ffd1c2 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:22:25 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-5ee16873-c247-403f-a6fa-ef3cc7ffd1c2 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:22:25 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-5ee16873-c247-403f-a6fa-ef3cc7ffd1c2 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:22:25 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-5ee16873-c247-403f-a6fa-ef3cc7ffd1c2 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:22:25 user devstack@n-api.service[62053]: DEBUG nova.policy [None req-5ee16873-c247-403f-a6fa-ef3cc7ffd1c2 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d232911f5742aa83146f19f13dd198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608ff87aadc7408e9010212fd5f482b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62053) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:22:25 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-5ee16873-c247-403f-a6fa-ef3cc7ffd1c2 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] 10.0.0.210 "GET /compute/v2.1/servers/823749e1-56ca-44f9-be83-a36b4851c28f" status: 200 len: 1540 microversion: 2.1 time: 0.202861 Apr 13 16:22:25 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 60/184] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:22:25 2023] GET /compute/v2.1/servers/823749e1-56ca-44f9-be83-a36b4851c28f => generated 1540 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:22:25 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_cell0:SELECT=4 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:22:25 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [req-0e3765e2-4368-4373-a990-4e96d949c0c2 req-82919a2a-bc5c-4297-a133-892f1afcd638 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "823749e1-56ca-44f9-be83-a36b4851c28f", "name": "network-vif-unplugged", "status": "completed", "tag": "f4e8f99d-1c8f-44b8-84f1-0f43a156e8b0"}]} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:22:25 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-0e3765e2-4368-4373-a990-4e96d949c0c2 req-82919a2a-bc5c-4297-a133-892f1afcd638 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:22:25 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-0e3765e2-4368-4373-a990-4e96d949c0c2 req-82919a2a-bc5c-4297-a133-892f1afcd638 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:22:25 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-0e3765e2-4368-4373-a990-4e96d949c0c2 req-82919a2a-bc5c-4297-a133-892f1afcd638 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:22:25 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-0e3765e2-4368-4373-a990-4e96d949c0c2 req-82919a2a-bc5c-4297-a133-892f1afcd638 service nova] Creating event network-vif-unplugged:f4e8f99d-1c8f-44b8-84f1-0f43a156e8b0 for instance 823749e1-56ca-44f9-be83-a36b4851c28f on user Apr 13 16:22:25 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [req-0e3765e2-4368-4373-a990-4e96d949c0c2 req-82919a2a-bc5c-4297-a133-892f1afcd638 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034721 Apr 13 16:22:25 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 61/185] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:22:25 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:22:25 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-42353fb2-0074-48ed-b47c-4680e9bd9d89 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:22:25 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-42353fb2-0074-48ed-b47c-4680e9bd9d89 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] [instance: 031c7939-a53c-4f7d-9f36-4ec1d06e2717] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:22:25 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-42353fb2-0074-48ed-b47c-4680e9bd9d89 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:22:25 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-42353fb2-0074-48ed-b47c-4680e9bd9d89 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:22:25 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-42353fb2-0074-48ed-b47c-4680e9bd9d89 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:22:25 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-42353fb2-0074-48ed-b47c-4680e9bd9d89 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:22:25 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-42353fb2-0074-48ed-b47c-4680e9bd9d89 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:22:25 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-42353fb2-0074-48ed-b47c-4680e9bd9d89 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:22:25 user devstack@n-api.service[62054]: DEBUG nova.policy [None req-42353fb2-0074-48ed-b47c-4680e9bd9d89 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9223a3efe4bc4e37946c8ed718100de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7395d2408a44cc88cf88eb49d5f8503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62054) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:22:25 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-42353fb2-0074-48ed-b47c-4680e9bd9d89 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] 10.0.0.210 "GET /compute/v2.1/servers/031c7939-a53c-4f7d-9f36-4ec1d06e2717" status: 200 len: 1495 microversion: 2.1 time: 0.249896 Apr 13 16:22:25 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 65/186] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:22:25 2023] GET /compute/v2.1/servers/031c7939-a53c-4f7d-9f36-4ec1d06e2717 => generated 1495 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:22:27 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-a562527d-7d7e-4bb0-a5e3-2f6feb4471ef tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:22:27 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-a562527d-7d7e-4bb0-a5e3-2f6feb4471ef tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:22:27 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-a562527d-7d7e-4bb0-a5e3-2f6feb4471ef tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:22:27 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-a562527d-7d7e-4bb0-a5e3-2f6feb4471ef tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:22:27 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-a562527d-7d7e-4bb0-a5e3-2f6feb4471ef tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:22:27 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-a562527d-7d7e-4bb0-a5e3-2f6feb4471ef tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:22:27 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-a562527d-7d7e-4bb0-a5e3-2f6feb4471ef tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:22:27 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-a562527d-7d7e-4bb0-a5e3-2f6feb4471ef tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:22:27 user devstack@n-api.service[62053]: DEBUG nova.policy [None req-a562527d-7d7e-4bb0-a5e3-2f6feb4471ef tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6a4bf1a7794af2958c3d53ea1e19c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed94fa5d89c2486b8e2951e608e6630f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62053) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:22:27 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-a562527d-7d7e-4bb0-a5e3-2f6feb4471ef tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bf350da4-9cc2-4900-adf0-506e44984b42" status: 200 len: 1433 microversion: 2.1 time: 0.151899 Apr 13 16:22:27 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 61/187] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:22:27 2023] GET /compute/v2.1/servers/bf350da4-9cc2-4900-adf0-506e44984b42 => generated 1433 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:22:27 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [req-e5b2bff3-7d45-4927-9814-d4228c4c685a req-6f21922a-635b-4906-b4a4-c5c35933f9e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "823749e1-56ca-44f9-be83-a36b4851c28f", "name": "network-vif-plugged", "status": "completed", "tag": "f4e8f99d-1c8f-44b8-84f1-0f43a156e8b0"}]} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:22:27 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-e5b2bff3-7d45-4927-9814-d4228c4c685a req-6f21922a-635b-4906-b4a4-c5c35933f9e2 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:22:27 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-e5b2bff3-7d45-4927-9814-d4228c4c685a req-6f21922a-635b-4906-b4a4-c5c35933f9e2 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:22:27 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-e5b2bff3-7d45-4927-9814-d4228c4c685a req-6f21922a-635b-4906-b4a4-c5c35933f9e2 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:22:27 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-37df6981-08ab-40ac-980a-2cffa9ab330c req-b2b73db1-91c3-4faf-b635-f1867e43a290 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "823749e1-56ca-44f9-be83-a36b4851c28f", "name": "network-vif-deleted", "tag": "f4e8f99d-1c8f-44b8-84f1-0f43a156e8b0"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:22:27 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-37df6981-08ab-40ac-980a-2cffa9ab330c req-b2b73db1-91c3-4faf-b635-f1867e43a290 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:22:27 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-37df6981-08ab-40ac-980a-2cffa9ab330c req-b2b73db1-91c3-4faf-b635-f1867e43a290 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:22:27 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-37df6981-08ab-40ac-980a-2cffa9ab330c req-b2b73db1-91c3-4faf-b635-f1867e43a290 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:22:27 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-e5b2bff3-7d45-4927-9814-d4228c4c685a req-6f21922a-635b-4906-b4a4-c5c35933f9e2 service nova] Creating event network-vif-plugged:f4e8f99d-1c8f-44b8-84f1-0f43a156e8b0 for instance 823749e1-56ca-44f9-be83-a36b4851c28f on user Apr 13 16:22:27 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-37df6981-08ab-40ac-980a-2cffa9ab330c req-b2b73db1-91c3-4faf-b635-f1867e43a290 service nova] Creating event network-vif-deleted:f4e8f99d-1c8f-44b8-84f1-0f43a156e8b0 for instance 823749e1-56ca-44f9-be83-a36b4851c28f on user Apr 13 16:22:27 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [req-e5b2bff3-7d45-4927-9814-d4228c4c685a req-6f21922a-635b-4906-b4a4-c5c35933f9e2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.210422 Apr 13 16:22:27 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 62/188] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:22:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:22:27 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [req-37df6981-08ab-40ac-980a-2cffa9ab330c req-b2b73db1-91c3-4faf-b635-f1867e43a290 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035412 Apr 13 16:22:27 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 66/189] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:22:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:22:29 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-b8fd4d37-a7e9-4f67-a2ca-ff61ca2bc3ee req-35fa3993-decc-4d7d-8a9b-ab0106f6db4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db65920b-7872-44c1-a68a-a696681d9d95", "name": "network-vif-plugged", "status": "completed", "tag": "ba686724-ae8a-4e16-9918-d7b2fc64ff62"}, {"server_uuid": "db65920b-7872-44c1-a68a-a696681d9d95", "name": "network-vif-plugged", "status": "completed", "tag": "ba686724-ae8a-4e16-9918-d7b2fc64ff62"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:22:29 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-b8fd4d37-a7e9-4f67-a2ca-ff61ca2bc3ee req-35fa3993-decc-4d7d-8a9b-ab0106f6db4a service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:22:29 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-b8fd4d37-a7e9-4f67-a2ca-ff61ca2bc3ee req-35fa3993-decc-4d7d-8a9b-ab0106f6db4a service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:22:29 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-b8fd4d37-a7e9-4f67-a2ca-ff61ca2bc3ee req-35fa3993-decc-4d7d-8a9b-ab0106f6db4a service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:22:29 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-b8fd4d37-a7e9-4f67-a2ca-ff61ca2bc3ee req-35fa3993-decc-4d7d-8a9b-ab0106f6db4a service nova] Creating event network-vif-plugged:ba686724-ae8a-4e16-9918-d7b2fc64ff62 for instance db65920b-7872-44c1-a68a-a696681d9d95 on user Apr 13 16:22:29 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-b8fd4d37-a7e9-4f67-a2ca-ff61ca2bc3ee req-35fa3993-decc-4d7d-8a9b-ab0106f6db4a service nova] Creating event network-vif-plugged:ba686724-ae8a-4e16-9918-d7b2fc64ff62 for instance db65920b-7872-44c1-a68a-a696681d9d95 on user Apr 13 16:22:29 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [req-b8fd4d37-a7e9-4f67-a2ca-ff61ca2bc3ee req-35fa3993-decc-4d7d-8a9b-ab0106f6db4a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.030828 Apr 13 16:22:29 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 62/190] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:22:29 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:22:30 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-a0ee2e6f-6383-4595-964d-eb3c5e0d3089 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:22:30 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-a0ee2e6f-6383-4595-964d-eb3c5e0d3089 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] [instance: 5db1cb51-2e5a-46c9-8914-cba759a96a65] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:22:30 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_api:SELECT=29 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:22:30 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-a0ee2e6f-6383-4595-964d-eb3c5e0d3089 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:22:30 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-a0ee2e6f-6383-4595-964d-eb3c5e0d3089 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:22:30 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-a0ee2e6f-6383-4595-964d-eb3c5e0d3089 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:22:30 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-a0ee2e6f-6383-4595-964d-eb3c5e0d3089 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:22:30 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-a0ee2e6f-6383-4595-964d-eb3c5e0d3089 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:22:30 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-a0ee2e6f-6383-4595-964d-eb3c5e0d3089 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:22:30 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_cell1:SELECT=27 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:22:30 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-a0ee2e6f-6383-4595-964d-eb3c5e0d3089 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5db1cb51-2e5a-46c9-8914-cba759a96a65/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.097825 Apr 13 16:22:30 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 63/191] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 13 16:22:30 2023] GET /compute/v2.1/servers/5db1cb51-2e5a-46c9-8914-cba759a96a65/os-interface => generated 282 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:22:31 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-d4ec3845-8bc1-4ae0-a3bc-9def28116ab8 req-3445758d-7ba2-4238-8c14-b69005922a60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5db1cb51-2e5a-46c9-8914-cba759a96a65", "tag": "628a1eb7-e3f1-4158-9f9e-1ae752c91c0b"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:22:31 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:22:31 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-d4ec3845-8bc1-4ae0-a3bc-9def28116ab8 req-3445758d-7ba2-4238-8c14-b69005922a60 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:22:31 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-d4ec3845-8bc1-4ae0-a3bc-9def28116ab8 req-3445758d-7ba2-4238-8c14-b69005922a60 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:22:31 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-d4ec3845-8bc1-4ae0-a3bc-9def28116ab8 req-3445758d-7ba2-4238-8c14-b69005922a60 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:22:31 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:22:31 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-d4ec3845-8bc1-4ae0-a3bc-9def28116ab8 req-3445758d-7ba2-4238-8c14-b69005922a60 service nova] Creating event network-changed:628a1eb7-e3f1-4158-9f9e-1ae752c91c0b for instance 5db1cb51-2e5a-46c9-8914-cba759a96a65 on user Apr 13 16:22:31 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [req-d4ec3845-8bc1-4ae0-a3bc-9def28116ab8 req-3445758d-7ba2-4238-8c14-b69005922a60 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070554 Apr 13 16:22:31 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 67/192] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:22:31 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:22:33 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-d67230b8-45f9-4a97-a9d4-1a3fb0962b1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a30cce7b-6caa-4d42-92a5-d1d6892edf6e"}} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:22:33 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-d67230b8-45f9-4a97-a9d4-1a3fb0962b1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] [instance: 5db1cb51-2e5a-46c9-8914-cba759a96a65] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:22:33 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-d67230b8-45f9-4a97-a9d4-1a3fb0962b1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:22:33 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-d67230b8-45f9-4a97-a9d4-1a3fb0962b1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:22:33 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-d67230b8-45f9-4a97-a9d4-1a3fb0962b1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:22:33 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-d67230b8-45f9-4a97-a9d4-1a3fb0962b1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:22:33 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-d67230b8-45f9-4a97-a9d4-1a3fb0962b1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:22:33 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-d67230b8-45f9-4a97-a9d4-1a3fb0962b1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:22:34 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-d67230b8-45f9-4a97-a9d4-1a3fb0962b1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] 10.0.0.210 "POST /compute/v2.1/servers/5db1cb51-2e5a-46c9-8914-cba759a96a65/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.294678 Apr 13 16:22:34 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 63/193] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 16:22:33 2023] POST /compute/v2.1/servers/5db1cb51-2e5a-46c9-8914-cba759a96a65/os-volume_attachments => generated 194 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:22:41 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_api:SELECT=1 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:22:41 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_cell1:SELECT=3 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:22:41 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-2a123766-fe90-45a5-912d-8626319364a7 tempest-VolumesAdminNegativeTest-371232260 tempest-VolumesAdminNegativeTest-371232260-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "2355596e-62fb-46d0-a38b-ab092344c8d0"}} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:22:41 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-2a123766-fe90-45a5-912d-8626319364a7 tempest-VolumesAdminNegativeTest-371232260 tempest-VolumesAdminNegativeTest-371232260-project-admin] [instance: 5db1cb51-2e5a-46c9-8914-cba759a96a65] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:22:41 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-2a123766-fe90-45a5-912d-8626319364a7 tempest-VolumesAdminNegativeTest-371232260 tempest-VolumesAdminNegativeTest-371232260-project-admin] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:22:41 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-2a123766-fe90-45a5-912d-8626319364a7 tempest-VolumesAdminNegativeTest-371232260 tempest-VolumesAdminNegativeTest-371232260-project-admin] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:22:41 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-2a123766-fe90-45a5-912d-8626319364a7 tempest-VolumesAdminNegativeTest-371232260 tempest-VolumesAdminNegativeTest-371232260-project-admin] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:22:41 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-2a123766-fe90-45a5-912d-8626319364a7 tempest-VolumesAdminNegativeTest-371232260 tempest-VolumesAdminNegativeTest-371232260-project-admin] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:22:41 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-2a123766-fe90-45a5-912d-8626319364a7 tempest-VolumesAdminNegativeTest-371232260 tempest-VolumesAdminNegativeTest-371232260-project-admin] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:22:41 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-2a123766-fe90-45a5-912d-8626319364a7 tempest-VolumesAdminNegativeTest-371232260 tempest-VolumesAdminNegativeTest-371232260-project-admin] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:22:41 user devstack@n-api.service[62055]: INFO nova.api.openstack.wsgi [None req-2a123766-fe90-45a5-912d-8626319364a7 tempest-VolumesAdminNegativeTest-371232260 tempest-VolumesAdminNegativeTest-371232260-project-admin] HTTP exception thrown: Volume 2355596e-62fb-46d0-a38b-ab092344c8d0 could not be found. Apr 13 16:22:41 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-2a123766-fe90-45a5-912d-8626319364a7 tempest-VolumesAdminNegativeTest-371232260 tempest-VolumesAdminNegativeTest-371232260-project-admin] Request method failure captured: Apr 13 16:22:41 user devstack@n-api.service[62055]: request: PUT /compute/v2.1/servers/5db1cb51-2e5a-46c9-8914-cba759a96a65/os-volume_attachments/a30cce7b-6caa-4d42-92a5-d1d6892edf6e HTTP/1.1 Apr 13 16:22:41 user devstack@n-api.service[62055]: Accept: application/json Apr 13 16:22:41 user devstack@n-api.service[62055]: Accept-Encoding: identity Apr 13 16:22:41 user devstack@n-api.service[62055]: Connection: close Apr 13 16:22:41 user devstack@n-api.service[62055]: Content-Length: 74 Apr 13 16:22:41 user devstack@n-api.service[62055]: Content-Type: application/json Apr 13 16:22:41 user devstack@n-api.service[62055]: Host: 10.0.0.210 Apr 13 16:22:41 user devstack@n-api.service[62055]: Openstack-System-Scope: None Apr 13 16:22:41 user devstack@n-api.service[62055]: User-Agent: python-urllib3/1.26.15 Apr 13 16:22:41 user devstack@n-api.service[62055]: X-Auth-Token: gAAAAABkOCvN8XrrYeVNU4ED1X-t-jRAFqQBhFFAI5XIb5hgR6whGTaf9dXEXMb0safy0YIAgLp5F7vhlhjhCfeffrb_NEoZmX6ouxJWvHgtbLRTqv4l2G5THpx9eKqEKF8BgYk3InJmXf90oikRawJKklVVVbHp6w19eR1OOzW59x5k-5MYp6M Apr 13 16:22:41 user devstack@n-api.service[62055]: X-Domain-Id: None Apr 13 16:22:41 user devstack@n-api.service[62055]: X-Domain-Name: None Apr 13 16:22:41 user devstack@n-api.service[62055]: X-Identity-Status: Confirmed Apr 13 16:22:41 user devstack@n-api.service[62055]: X-Is-Admin-Project: True Apr 13 16:22:41 user devstack@n-api.service[62055]: X-Project-Domain-Id: default Apr 13 16:22:41 user devstack@n-api.service[62055]: X-Project-Domain-Name: Default Apr 13 16:22:41 user devstack@n-api.service[62055]: X-Project-Id: 21b4556b2ac64f729fca060c702570d4 Apr 13 16:22:41 user devstack@n-api.service[62055]: X-Project-Name: tempest-VolumesAdminNegativeTest-371232260 Apr 13 16:22:41 user devstack@n-api.service[62055]: X-Role: reader,member,admin Apr 13 16:22:41 user devstack@n-api.service[62055]: X-Roles: reader,member,admin Apr 13 16:22:41 user devstack@n-api.service[62055]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/21b4556b2ac64f729fca060c702570d4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/21b4556b2ac64f729fca060c702570d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/21b4556b2ac64f729fca060c702570d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 13 16:22:41 user devstack@n-api.service[62055]: X-Tenant: tempest-VolumesAdminNegativeTest-371232260 Apr 13 16:22:41 user devstack@n-api.service[62055]: X-Tenant-Id: 21b4556b2ac64f729fca060c702570d4 Apr 13 16:22:41 user devstack@n-api.service[62055]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-371232260 Apr 13 16:22:41 user devstack@n-api.service[62055]: X-User: tempest-VolumesAdminNegativeTest-371232260-project-admin Apr 13 16:22:41 user devstack@n-api.service[62055]: X-User-Domain-Id: default Apr 13 16:22:41 user devstack@n-api.service[62055]: X-User-Domain-Name: Default Apr 13 16:22:41 user devstack@n-api.service[62055]: X-User-Id: c3ca68fdc9844678a5307317df63c6cc Apr 13 16:22:41 user devstack@n-api.service[62055]: X-User-Name: tempest-VolumesAdminNegativeTest-371232260-project-admin Apr 13 16:22:41 user devstack@n-api.service[62055]: Apr 13 16:22:41 user devstack@n-api.service[62055]: {"volumeAttachment": {"volumeId": "2355596e-62fb-46d0-a38b-ab092344c8d0"}} Apr 13 16:22:41 user devstack@n-api.service[62055]: method: > Apr 13 16:22:41 user devstack@n-api.service[62055]: exception: Volume 2355596e-62fb-46d0-a38b-ab092344c8d0 could not be found. Apr 13 16:22:41 user devstack@n-api.service[62055]: action_args: {'server_id': '5db1cb51-2e5a-46c9-8914-cba759a96a65', 'id': 'a30cce7b-6caa-4d42-92a5-d1d6892edf6e', 'body': {'volumeAttachment': {'volumeId': '2355596e-62fb-46d0-a38b-ab092344c8d0'}}} Apr 13 16:22:41 user devstack@n-api.service[62055]: {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 16:22:41 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:22:41 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 13 16:22:41 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 13 16:22:41 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 13 16:22:41 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 13 16:22:41 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 13 16:22:41 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 13 16:22:41 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 13 16:22:41 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 13 16:22:41 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 13 16:22:41 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 13 16:22:41 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 16:22:41 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 16:22:41 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 16:22:41 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 16:22:41 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2355596e-62fb-46d0-a38b-ab092344c8d0 could not be found. (HTTP 404) (Request-ID: req-aec34702-df72-41d6-ac74-01ae0bdaa5ad) Apr 13 16:22:41 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:22:41 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:22:41 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:22:41 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:22:41 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Apr 13 16:22:41 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Apr 13 16:22:41 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 13 16:22:41 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 13 16:22:41 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 13 16:22:41 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 13 16:22:41 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 13 16:22:41 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 13 16:22:41 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 13 16:22:41 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 13 16:22:41 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 13 16:22:41 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 13 16:22:41 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 13 16:22:41 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 13 16:22:41 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 13 16:22:41 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 13 16:22:41 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 13 16:22:41 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 13 16:22:41 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 16:22:41 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 16:22:41 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 16:22:41 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 16:22:41 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2355596e-62fb-46d0-a38b-ab092344c8d0 could not be found. Apr 13 16:22:41 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:22:41 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:22:41 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:22:41 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:22:41 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 16:22:41 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 16:22:41 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 16:22:41 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 16:22:41 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 16:22:41 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 16:22:41 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 13 16:22:41 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 16:22:41 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 13 16:22:41 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 16:22:41 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Apr 13 16:22:41 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Apr 13 16:22:41 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Apr 13 16:22:41 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Apr 13 16:22:41 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 2355596e-62fb-46d0-a38b-ab092344c8d0 could not be found. Apr 13 16:22:41 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:22:41 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:22:41 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:22:41 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:22:41 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 16:22:41 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 16:22:41 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 16:22:41 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 16:22:41 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2355596e-62fb-46d0-a38b-ab092344c8d0 could not be found. Apr 13 16:22:41 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:22:41 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-2a123766-fe90-45a5-912d-8626319364a7 tempest-VolumesAdminNegativeTest-371232260 tempest-VolumesAdminNegativeTest-371232260-project-admin] Returning 400 to user: Volume 2355596e-62fb-46d0-a38b-ab092344c8d0 could not be found. {{(pid=62055) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 16:22:41 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-2a123766-fe90-45a5-912d-8626319364a7 tempest-VolumesAdminNegativeTest-371232260 tempest-VolumesAdminNegativeTest-371232260-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/5db1cb51-2e5a-46c9-8914-cba759a96a65/os-volume_attachments/a30cce7b-6caa-4d42-92a5-d1d6892edf6e" status: 400 len: 107 microversion: 2.1 time: 0.345455 Apr 13 16:22:41 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 64/194] 10.0.0.210 () {64 vars in 1510 bytes} [Thu Apr 13 16:22:41 2023] PUT /compute/v2.1/servers/5db1cb51-2e5a-46c9-8914-cba759a96a65/os-volume_attachments/a30cce7b-6caa-4d42-92a5-d1d6892edf6e => generated 107 bytes in 347 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 13 16:22:41 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_api:SELECT=1 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:22:41 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-5457d13f-0ba3-4e09-8eaf-3f1315fb6695 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:22:41 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-5457d13f-0ba3-4e09-8eaf-3f1315fb6695 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] [instance: 5db1cb51-2e5a-46c9-8914-cba759a96a65] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:22:41 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-5457d13f-0ba3-4e09-8eaf-3f1315fb6695 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:22:41 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-5457d13f-0ba3-4e09-8eaf-3f1315fb6695 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:22:41 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-5457d13f-0ba3-4e09-8eaf-3f1315fb6695 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:22:41 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-5457d13f-0ba3-4e09-8eaf-3f1315fb6695 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:22:41 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-5457d13f-0ba3-4e09-8eaf-3f1315fb6695 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:22:41 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-5457d13f-0ba3-4e09-8eaf-3f1315fb6695 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:22:42 user devstack@n-api.service[62054]: DEBUG nova.objects.instance [None req-5457d13f-0ba3-4e09-8eaf-3f1315fb6695 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Lazy-loading 'services' on Instance uuid 5db1cb51-2e5a-46c9-8914-cba759a96a65 {{(pid=62054) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 16:22:42 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-5457d13f-0ba3-4e09-8eaf-3f1315fb6695 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5db1cb51-2e5a-46c9-8914-cba759a96a65/os-volume_attachments/a30cce7b-6caa-4d42-92a5-d1d6892edf6e" status: 202 len: 0 microversion: 2.1 time: 0.261995 Apr 13 16:22:42 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 68/195] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 16:22:41 2023] DELETE /compute/v2.1/servers/5db1cb51-2e5a-46c9-8914-cba759a96a65/os-volume_attachments/a30cce7b-6caa-4d42-92a5-d1d6892edf6e => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 16:22:42 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-de1acb1b-9747-4d4c-8ed3-bd84f4228b92 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:22:42 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-de1acb1b-9747-4d4c-8ed3-bd84f4228b92 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] [instance: 5db1cb51-2e5a-46c9-8914-cba759a96a65] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:22:42 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-de1acb1b-9747-4d4c-8ed3-bd84f4228b92 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:22:42 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-de1acb1b-9747-4d4c-8ed3-bd84f4228b92 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:22:42 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-de1acb1b-9747-4d4c-8ed3-bd84f4228b92 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:22:42 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-de1acb1b-9747-4d4c-8ed3-bd84f4228b92 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:22:42 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-de1acb1b-9747-4d4c-8ed3-bd84f4228b92 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:22:42 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-de1acb1b-9747-4d4c-8ed3-bd84f4228b92 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:22:42 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=8,nova_cell1:INSERT=4 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:22:42 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-de1acb1b-9747-4d4c-8ed3-bd84f4228b92 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5db1cb51-2e5a-46c9-8914-cba759a96a65/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054872 Apr 13 16:22:42 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 64/196] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 16:22:42 2023] GET /compute/v2.1/servers/5db1cb51-2e5a-46c9-8914-cba759a96a65/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:22:43 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-afed83ca-a128-4116-bceb-393826b72d79 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:22:43 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-afed83ca-a128-4116-bceb-393826b72d79 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] [instance: cf54be22-2a5d-40c4-8a1a-0060c77f83f6] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:22:43 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-afed83ca-a128-4116-bceb-393826b72d79 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:22:43 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-afed83ca-a128-4116-bceb-393826b72d79 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:22:43 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-afed83ca-a128-4116-bceb-393826b72d79 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:22:43 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-afed83ca-a128-4116-bceb-393826b72d79 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:22:43 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-afed83ca-a128-4116-bceb-393826b72d79 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:22:43 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-afed83ca-a128-4116-bceb-393826b72d79 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:22:43 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-afed83ca-a128-4116-bceb-393826b72d79 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cf54be22-2a5d-40c4-8a1a-0060c77f83f6/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.091920 Apr 13 16:22:43 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 65/197] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 13 16:22:43 2023] GET /compute/v2.1/servers/cf54be22-2a5d-40c4-8a1a-0060c77f83f6/os-interface => generated 282 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:22:44 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-b5dca4f0-4d98-4c02-82fb-fb1d0b9c8d93 req-961d6c71-2f2f-44b5-82b1-7f47de89eaea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf54be22-2a5d-40c4-8a1a-0060c77f83f6", "tag": "3e9128bc-6e2e-4c5e-bf37-1142304eff26"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:22:44 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-b5dca4f0-4d98-4c02-82fb-fb1d0b9c8d93 req-961d6c71-2f2f-44b5-82b1-7f47de89eaea service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:22:44 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-b5dca4f0-4d98-4c02-82fb-fb1d0b9c8d93 req-961d6c71-2f2f-44b5-82b1-7f47de89eaea service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:22:44 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-b5dca4f0-4d98-4c02-82fb-fb1d0b9c8d93 req-961d6c71-2f2f-44b5-82b1-7f47de89eaea service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:22:44 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-b5dca4f0-4d98-4c02-82fb-fb1d0b9c8d93 req-961d6c71-2f2f-44b5-82b1-7f47de89eaea service nova] Creating event network-changed:3e9128bc-6e2e-4c5e-bf37-1142304eff26 for instance cf54be22-2a5d-40c4-8a1a-0060c77f83f6 on user Apr 13 16:22:44 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [req-b5dca4f0-4d98-4c02-82fb-fb1d0b9c8d93 req-961d6c71-2f2f-44b5-82b1-7f47de89eaea service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035741 Apr 13 16:22:44 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 69/198] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:22:44 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:22:45 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-d6517ac5-b3b9-479c-af60-b6cba0f37636 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:22:45 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-d6517ac5-b3b9-479c-af60-b6cba0f37636 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] [instance: 8c6d8096-853b-4091-ad82-6faf8ffc85fa] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:22:45 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-d6517ac5-b3b9-479c-af60-b6cba0f37636 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:22:45 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-d6517ac5-b3b9-479c-af60-b6cba0f37636 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:22:45 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-d6517ac5-b3b9-479c-af60-b6cba0f37636 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:22:45 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-d6517ac5-b3b9-479c-af60-b6cba0f37636 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:22:45 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-d6517ac5-b3b9-479c-af60-b6cba0f37636 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:22:45 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-d6517ac5-b3b9-479c-af60-b6cba0f37636 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:22:45 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-d6517ac5-b3b9-479c-af60-b6cba0f37636 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8c6d8096-853b-4091-ad82-6faf8ffc85fa/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.094771 Apr 13 16:22:45 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 65/199] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 13 16:22:45 2023] GET /compute/v2.1/servers/8c6d8096-853b-4091-ad82-6faf8ffc85fa/os-interface => generated 282 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:22:46 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-8308d00e-7207-4925-a623-f7d124684656 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "62e7747a-651a-4d0a-a763-bfce9c4a3cff"}} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:22:46 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-8308d00e-7207-4925-a623-f7d124684656 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] [instance: 8c6d8096-853b-4091-ad82-6faf8ffc85fa] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:22:46 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-8308d00e-7207-4925-a623-f7d124684656 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:22:46 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-8308d00e-7207-4925-a623-f7d124684656 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:22:46 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-8308d00e-7207-4925-a623-f7d124684656 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:22:46 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-8308d00e-7207-4925-a623-f7d124684656 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:22:46 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-8308d00e-7207-4925-a623-f7d124684656 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:22:46 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-8308d00e-7207-4925-a623-f7d124684656 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:22:46 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-8308d00e-7207-4925-a623-f7d124684656 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] 10.0.0.210 "POST /compute/v2.1/servers/8c6d8096-853b-4091-ad82-6faf8ffc85fa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.296245 Apr 13 16:22:46 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 66/200] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 16:22:46 2023] POST /compute/v2.1/servers/8c6d8096-853b-4091-ad82-6faf8ffc85fa/os-volume_attachments => generated 194 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:22:46 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-6b5165c3-6f03-451d-8787-e886677b3996 req-74e416b5-94c3-46ad-a637-c7877c8e38a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c6d8096-853b-4091-ad82-6faf8ffc85fa", "tag": "385dec44-4145-4606-b0af-30fbc721eb2c"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:22:46 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-6b5165c3-6f03-451d-8787-e886677b3996 req-74e416b5-94c3-46ad-a637-c7877c8e38a7 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:22:46 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-6b5165c3-6f03-451d-8787-e886677b3996 req-74e416b5-94c3-46ad-a637-c7877c8e38a7 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:22:46 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-6b5165c3-6f03-451d-8787-e886677b3996 req-74e416b5-94c3-46ad-a637-c7877c8e38a7 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:22:46 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-6b5165c3-6f03-451d-8787-e886677b3996 req-74e416b5-94c3-46ad-a637-c7877c8e38a7 service nova] Creating event network-changed:385dec44-4145-4606-b0af-30fbc721eb2c for instance 8c6d8096-853b-4091-ad82-6faf8ffc85fa on user Apr 13 16:22:46 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [req-6b5165c3-6f03-451d-8787-e886677b3996 req-74e416b5-94c3-46ad-a637-c7877c8e38a7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030826 Apr 13 16:22:46 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 70/201] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:22:46 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:22:47 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-b00db723-aa0b-4c61-a959-7e5eca86fc73 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a3ec6bc1-d29e-4348-adf7-8bc66e2414a1"}} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:22:47 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-b00db723-aa0b-4c61-a959-7e5eca86fc73 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] [instance: cf54be22-2a5d-40c4-8a1a-0060c77f83f6] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:22:47 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-b00db723-aa0b-4c61-a959-7e5eca86fc73 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:22:47 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-b00db723-aa0b-4c61-a959-7e5eca86fc73 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:22:47 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-b00db723-aa0b-4c61-a959-7e5eca86fc73 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:22:47 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-b00db723-aa0b-4c61-a959-7e5eca86fc73 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:22:47 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-b00db723-aa0b-4c61-a959-7e5eca86fc73 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:22:47 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-b00db723-aa0b-4c61-a959-7e5eca86fc73 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:22:47 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-b00db723-aa0b-4c61-a959-7e5eca86fc73 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] 10.0.0.210 "POST /compute/v2.1/servers/cf54be22-2a5d-40c4-8a1a-0060c77f83f6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.296738 Apr 13 16:22:47 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 66/202] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 16:22:47 2023] POST /compute/v2.1/servers/cf54be22-2a5d-40c4-8a1a-0060c77f83f6/os-volume_attachments => generated 194 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:22:53 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-f806038a-767a-4661-99e7-7942ce22ab8a tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "d3a41289-1225-4bee-927e-5da050896328"}} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:22:53 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-f806038a-767a-4661-99e7-7942ce22ab8a tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] [instance: 8c6d8096-853b-4091-ad82-6faf8ffc85fa] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:22:53 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-f806038a-767a-4661-99e7-7942ce22ab8a tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:22:53 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-f806038a-767a-4661-99e7-7942ce22ab8a tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:22:53 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-f806038a-767a-4661-99e7-7942ce22ab8a tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:22:53 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-f806038a-767a-4661-99e7-7942ce22ab8a tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:22:53 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-f806038a-767a-4661-99e7-7942ce22ab8a tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:22:53 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-f806038a-767a-4661-99e7-7942ce22ab8a tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:22:53 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-f806038a-767a-4661-99e7-7942ce22ab8a tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/8c6d8096-853b-4091-ad82-6faf8ffc85fa/os-volume_attachments/62e7747a-651a-4d0a-a763-bfce9c4a3cff" status: 202 len: 0 microversion: 2.1 time: 0.442296 Apr 13 16:22:53 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 67/203] 10.0.0.210 () {64 vars in 1510 bytes} [Thu Apr 13 16:22:53 2023] PUT /compute/v2.1/servers/8c6d8096-853b-4091-ad82-6faf8ffc85fa/os-volume_attachments/62e7747a-651a-4d0a-a763-bfce9c4a3cff => generated 0 bytes in 444 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 16:22:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-0a17fb06-fa3d-4097-8ff7-bba83e914ea7 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:22:55 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-0a17fb06-fa3d-4097-8ff7-bba83e914ea7 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] [instance: cf54be22-2a5d-40c4-8a1a-0060c77f83f6] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:22:55 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-0a17fb06-fa3d-4097-8ff7-bba83e914ea7 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:22:55 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-0a17fb06-fa3d-4097-8ff7-bba83e914ea7 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:22:55 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-0a17fb06-fa3d-4097-8ff7-bba83e914ea7 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:22:55 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-0a17fb06-fa3d-4097-8ff7-bba83e914ea7 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:22:55 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-0a17fb06-fa3d-4097-8ff7-bba83e914ea7 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:22:55 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-0a17fb06-fa3d-4097-8ff7-bba83e914ea7 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:22:55 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-0a17fb06-fa3d-4097-8ff7-bba83e914ea7 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cf54be22-2a5d-40c4-8a1a-0060c77f83f6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048023 Apr 13 16:22:55 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 71/204] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 16:22:55 2023] GET /compute/v2.1/servers/cf54be22-2a5d-40c4-8a1a-0060c77f83f6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:22:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-d07fab4c-773e-4684-83cb-19e7cefdb3af tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:22:55 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-d07fab4c-773e-4684-83cb-19e7cefdb3af tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] [instance: cf54be22-2a5d-40c4-8a1a-0060c77f83f6] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:22:55 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_api:SELECT=16 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:22:55 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-d07fab4c-773e-4684-83cb-19e7cefdb3af tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:22:55 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-d07fab4c-773e-4684-83cb-19e7cefdb3af tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:22:55 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-d07fab4c-773e-4684-83cb-19e7cefdb3af tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:22:55 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-d07fab4c-773e-4684-83cb-19e7cefdb3af tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:22:55 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-d07fab4c-773e-4684-83cb-19e7cefdb3af tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:22:55 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-d07fab4c-773e-4684-83cb-19e7cefdb3af tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:22:55 user devstack@n-api.service[62053]: DEBUG nova.objects.instance [None req-d07fab4c-773e-4684-83cb-19e7cefdb3af tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Lazy-loading 'services' on Instance uuid cf54be22-2a5d-40c4-8a1a-0060c77f83f6 {{(pid=62053) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 16:22:55 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-d07fab4c-773e-4684-83cb-19e7cefdb3af tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/cf54be22-2a5d-40c4-8a1a-0060c77f83f6/os-volume_attachments/a3ec6bc1-d29e-4348-adf7-8bc66e2414a1" status: 202 len: 0 microversion: 2.1 time: 0.275810 Apr 13 16:22:55 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 67/205] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 16:22:55 2023] DELETE /compute/v2.1/servers/cf54be22-2a5d-40c4-8a1a-0060c77f83f6/os-volume_attachments/a3ec6bc1-d29e-4348-adf7-8bc66e2414a1 => generated 0 bytes in 278 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 16:22:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-08d8f600-472c-4d4c-a714-3646e78edba4 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:22:55 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-08d8f600-472c-4d4c-a714-3646e78edba4 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] [instance: 0e731607-fce1-4f19-9e4b-5b892e760179] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:22:55 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-08d8f600-472c-4d4c-a714-3646e78edba4 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:22:55 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-08d8f600-472c-4d4c-a714-3646e78edba4 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:22:55 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-08d8f600-472c-4d4c-a714-3646e78edba4 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:22:55 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-08d8f600-472c-4d4c-a714-3646e78edba4 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:22:55 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-08d8f600-472c-4d4c-a714-3646e78edba4 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:22:55 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-08d8f600-472c-4d4c-a714-3646e78edba4 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:22:55 user devstack@n-api.service[62055]: DEBUG nova.policy [None req-08d8f600-472c-4d4c-a714-3646e78edba4 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ddd547d240b43ccb213e9d459082309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5554aa7f1b4d471b8807a845ab1ea33f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62055) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:22:55 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-08d8f600-472c-4d4c-a714-3646e78edba4 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0e731607-fce1-4f19-9e4b-5b892e760179" status: 200 len: 1495 microversion: 2.1 time: 0.167337 Apr 13 16:22:55 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 68/206] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:22:55 2023] GET /compute/v2.1/servers/0e731607-fce1-4f19-9e4b-5b892e760179 => generated 1495 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:22:57 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-79956d5b-b060-44c2-942b-3dd77965e16f tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:22:57 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-79956d5b-b060-44c2-942b-3dd77965e16f tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] [instance: cf54be22-2a5d-40c4-8a1a-0060c77f83f6] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:22:57 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-79956d5b-b060-44c2-942b-3dd77965e16f tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:22:57 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-79956d5b-b060-44c2-942b-3dd77965e16f tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:22:57 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-79956d5b-b060-44c2-942b-3dd77965e16f tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:22:57 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-79956d5b-b060-44c2-942b-3dd77965e16f tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:22:57 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-79956d5b-b060-44c2-942b-3dd77965e16f tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:22:57 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-79956d5b-b060-44c2-942b-3dd77965e16f tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:22:57 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-79956d5b-b060-44c2-942b-3dd77965e16f tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cf54be22-2a5d-40c4-8a1a-0060c77f83f6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040147 Apr 13 16:22:57 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 72/207] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 16:22:57 2023] GET /compute/v2.1/servers/cf54be22-2a5d-40c4-8a1a-0060c77f83f6/os-volume_attachments => generated 25 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 16:22:57 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-33d1c529-4c82-4fe2-b611-8bb9aaaa6454 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:22:57 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-33d1c529-4c82-4fe2-b611-8bb9aaaa6454 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] [instance: cf54be22-2a5d-40c4-8a1a-0060c77f83f6] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:22:57 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-33d1c529-4c82-4fe2-b611-8bb9aaaa6454 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:22:57 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-33d1c529-4c82-4fe2-b611-8bb9aaaa6454 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:22:57 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-33d1c529-4c82-4fe2-b611-8bb9aaaa6454 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:22:57 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-33d1c529-4c82-4fe2-b611-8bb9aaaa6454 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:22:57 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-33d1c529-4c82-4fe2-b611-8bb9aaaa6454 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:22:57 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-33d1c529-4c82-4fe2-b611-8bb9aaaa6454 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:22:57 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-33d1c529-4c82-4fe2-b611-8bb9aaaa6454 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cf54be22-2a5d-40c4-8a1a-0060c77f83f6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046737 Apr 13 16:22:57 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 68/208] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 16:22:57 2023] GET /compute/v2.1/servers/cf54be22-2a5d-40c4-8a1a-0060c77f83f6/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 16:22:57 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-45ae7812-0322-4a05-bda4-66d4168a7ed2 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:22:57 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-45ae7812-0322-4a05-bda4-66d4168a7ed2 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] [instance: cf54be22-2a5d-40c4-8a1a-0060c77f83f6] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:22:57 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-45ae7812-0322-4a05-bda4-66d4168a7ed2 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:22:57 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-45ae7812-0322-4a05-bda4-66d4168a7ed2 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:22:57 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-45ae7812-0322-4a05-bda4-66d4168a7ed2 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:22:57 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-45ae7812-0322-4a05-bda4-66d4168a7ed2 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:22:57 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-45ae7812-0322-4a05-bda4-66d4168a7ed2 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:22:57 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-45ae7812-0322-4a05-bda4-66d4168a7ed2 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:22:57 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-45ae7812-0322-4a05-bda4-66d4168a7ed2 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] [instance: cf54be22-2a5d-40c4-8a1a-0060c77f83f6] Going to try to terminate instance {{(pid=62055) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 16:22:58 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-45ae7812-0322-4a05-bda4-66d4168a7ed2 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/cf54be22-2a5d-40c4-8a1a-0060c77f83f6" status: 204 len: 0 microversion: 2.1 time: 0.128333 Apr 13 16:22:58 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 69/209] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 16:22:57 2023] DELETE /compute/v2.1/servers/cf54be22-2a5d-40c4-8a1a-0060c77f83f6 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 16:22:58 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-922fa476-df45-47af-8514-4f63f7136c03 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:22:58 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-922fa476-df45-47af-8514-4f63f7136c03 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] [instance: cf54be22-2a5d-40c4-8a1a-0060c77f83f6] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:22:58 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-922fa476-df45-47af-8514-4f63f7136c03 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:22:58 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-922fa476-df45-47af-8514-4f63f7136c03 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:22:58 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-922fa476-df45-47af-8514-4f63f7136c03 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:22:58 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-922fa476-df45-47af-8514-4f63f7136c03 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:22:58 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-922fa476-df45-47af-8514-4f63f7136c03 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:22:58 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-922fa476-df45-47af-8514-4f63f7136c03 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:22:58 user devstack@n-api.service[62054]: DEBUG nova.policy [None req-922fa476-df45-47af-8514-4f63f7136c03 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b143a8db8a3410eb09b21ced7bd883e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6365a1e8d6c48499d4b8921244d92a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62054) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:22:58 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-922fa476-df45-47af-8514-4f63f7136c03 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cf54be22-2a5d-40c4-8a1a-0060c77f83f6" status: 200 len: 1672 microversion: 2.1 time: 0.271842 Apr 13 16:22:58 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 73/210] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:22:58 2023] GET /compute/v2.1/servers/cf54be22-2a5d-40c4-8a1a-0060c77f83f6 => generated 1672 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:22:58 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-b600d3cf-6866-4db2-85dc-6e432f133553 req-c1f3efc2-1269-44d0-9f13-f79621ab56cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf54be22-2a5d-40c4-8a1a-0060c77f83f6", "name": "network-vif-unplugged", "status": "completed", "tag": "3e9128bc-6e2e-4c5e-bf37-1142304eff26"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:22:58 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-b600d3cf-6866-4db2-85dc-6e432f133553 req-c1f3efc2-1269-44d0-9f13-f79621ab56cd service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:22:58 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-b600d3cf-6866-4db2-85dc-6e432f133553 req-c1f3efc2-1269-44d0-9f13-f79621ab56cd service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:22:58 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-b600d3cf-6866-4db2-85dc-6e432f133553 req-c1f3efc2-1269-44d0-9f13-f79621ab56cd service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:22:58 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-b600d3cf-6866-4db2-85dc-6e432f133553 req-c1f3efc2-1269-44d0-9f13-f79621ab56cd service nova] Creating event network-vif-unplugged:3e9128bc-6e2e-4c5e-bf37-1142304eff26 for instance cf54be22-2a5d-40c4-8a1a-0060c77f83f6 on user Apr 13 16:22:58 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [req-b600d3cf-6866-4db2-85dc-6e432f133553 req-c1f3efc2-1269-44d0-9f13-f79621ab56cd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028580 Apr 13 16:22:58 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 69/211] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:22:58 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 16:23:00 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [req-13fe3719-b2af-4562-aad2-860fbe1b056d req-9b46799f-5202-40d0-b102-9a98e00fcaf4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf54be22-2a5d-40c4-8a1a-0060c77f83f6", "name": "network-vif-deleted", "tag": "3e9128bc-6e2e-4c5e-bf37-1142304eff26"}]} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:23:00 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-13fe3719-b2af-4562-aad2-860fbe1b056d req-9b46799f-5202-40d0-b102-9a98e00fcaf4 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:23:00 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-13fe3719-b2af-4562-aad2-860fbe1b056d req-9b46799f-5202-40d0-b102-9a98e00fcaf4 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:23:00 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-13fe3719-b2af-4562-aad2-860fbe1b056d req-9b46799f-5202-40d0-b102-9a98e00fcaf4 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:23:00 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-13fe3719-b2af-4562-aad2-860fbe1b056d req-9b46799f-5202-40d0-b102-9a98e00fcaf4 service nova] Creating event network-vif-deleted:3e9128bc-6e2e-4c5e-bf37-1142304eff26 for instance cf54be22-2a5d-40c4-8a1a-0060c77f83f6 on user Apr 13 16:23:00 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [req-13fe3719-b2af-4562-aad2-860fbe1b056d req-9b46799f-5202-40d0-b102-9a98e00fcaf4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054236 Apr 13 16:23:00 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 70/212] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:23:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:23:00 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-db885a01-036b-4cc1-9249-30cf574cd2a2 req-31ab3289-8bf5-45c7-a4f2-5949f9eb0b0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf54be22-2a5d-40c4-8a1a-0060c77f83f6", "name": "network-vif-plugged", "status": "completed", "tag": "3e9128bc-6e2e-4c5e-bf37-1142304eff26"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:23:00 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-db885a01-036b-4cc1-9249-30cf574cd2a2 req-31ab3289-8bf5-45c7-a4f2-5949f9eb0b0d service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:23:00 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-db885a01-036b-4cc1-9249-30cf574cd2a2 req-31ab3289-8bf5-45c7-a4f2-5949f9eb0b0d service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:23:00 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-db885a01-036b-4cc1-9249-30cf574cd2a2 req-31ab3289-8bf5-45c7-a4f2-5949f9eb0b0d service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:23:00 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-db885a01-036b-4cc1-9249-30cf574cd2a2 req-31ab3289-8bf5-45c7-a4f2-5949f9eb0b0d service nova] Creating event network-vif-plugged:3e9128bc-6e2e-4c5e-bf37-1142304eff26 for instance cf54be22-2a5d-40c4-8a1a-0060c77f83f6 on user Apr 13 16:23:00 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [req-db885a01-036b-4cc1-9249-30cf574cd2a2 req-31ab3289-8bf5-45c7-a4f2-5949f9eb0b0d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065493 Apr 13 16:23:00 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 74/213] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:23:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:23:03 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-e48f4fb6-62c5-4a74-b645-9763c5f0893d tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:23:03 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-e48f4fb6-62c5-4a74-b645-9763c5f0893d tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: db65920b-7872-44c1-a68a-a696681d9d95] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:23:03 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-e48f4fb6-62c5-4a74-b645-9763c5f0893d tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:23:03 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-e48f4fb6-62c5-4a74-b645-9763c5f0893d tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:23:03 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-e48f4fb6-62c5-4a74-b645-9763c5f0893d tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:23:03 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-e48f4fb6-62c5-4a74-b645-9763c5f0893d tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:23:03 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-e48f4fb6-62c5-4a74-b645-9763c5f0893d tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:23:03 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-e48f4fb6-62c5-4a74-b645-9763c5f0893d tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:23:03 user devstack@n-api.service[62053]: DEBUG nova.policy [None req-e48f4fb6-62c5-4a74-b645-9763c5f0893d tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e10f63cdd49a9a1ebe1fe4c9de0a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d451e0e239f486aa2b3abe9e273eab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62053) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:23:03 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-e48f4fb6-62c5-4a74-b645-9763c5f0893d tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] 10.0.0.210 "GET /compute/v2.1/servers/db65920b-7872-44c1-a68a-a696681d9d95" status: 200 len: 1378 microversion: 2.1 time: 0.198012 Apr 13 16:23:03 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 70/214] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:23:03 2023] GET /compute/v2.1/servers/db65920b-7872-44c1-a68a-a696681d9d95 => generated 1378 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:23:06 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-642cd7df-6dcb-459e-a912-f809f687fc96 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:23:06 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-642cd7df-6dcb-459e-a912-f809f687fc96 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] [instance: 8c6d8096-853b-4091-ad82-6faf8ffc85fa] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:23:06 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-642cd7df-6dcb-459e-a912-f809f687fc96 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:23:06 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-642cd7df-6dcb-459e-a912-f809f687fc96 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:23:06 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-642cd7df-6dcb-459e-a912-f809f687fc96 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:23:06 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-642cd7df-6dcb-459e-a912-f809f687fc96 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:23:06 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-642cd7df-6dcb-459e-a912-f809f687fc96 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:23:06 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-642cd7df-6dcb-459e-a912-f809f687fc96 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:23:06 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-642cd7df-6dcb-459e-a912-f809f687fc96 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8c6d8096-853b-4091-ad82-6faf8ffc85fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049457 Apr 13 16:23:06 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 71/215] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 16:23:06 2023] GET /compute/v2.1/servers/8c6d8096-853b-4091-ad82-6faf8ffc85fa/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:23:06 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-c1ddd840-2c08-4d7a-8d32-aebd186430de tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:23:06 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-c1ddd840-2c08-4d7a-8d32-aebd186430de tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] [instance: 8c6d8096-853b-4091-ad82-6faf8ffc85fa] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:23:06 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-c1ddd840-2c08-4d7a-8d32-aebd186430de tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:23:06 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-c1ddd840-2c08-4d7a-8d32-aebd186430de tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:23:06 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-c1ddd840-2c08-4d7a-8d32-aebd186430de tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:23:06 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-c1ddd840-2c08-4d7a-8d32-aebd186430de tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:23:06 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-c1ddd840-2c08-4d7a-8d32-aebd186430de tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:23:06 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-c1ddd840-2c08-4d7a-8d32-aebd186430de tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:23:06 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-c1ddd840-2c08-4d7a-8d32-aebd186430de tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8c6d8096-853b-4091-ad82-6faf8ffc85fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043358 Apr 13 16:23:06 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 75/216] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 16:23:06 2023] GET /compute/v2.1/servers/8c6d8096-853b-4091-ad82-6faf8ffc85fa/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:23:06 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-6d9cc235-0c45-4909-a9f0-7f972b8cc030 tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "62e7747a-651a-4d0a-a763-bfce9c4a3cff"}} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:23:06 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-6d9cc235-0c45-4909-a9f0-7f972b8cc030 tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] [instance: 8c6d8096-853b-4091-ad82-6faf8ffc85fa] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:23:06 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-6d9cc235-0c45-4909-a9f0-7f972b8cc030 tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:23:06 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-6d9cc235-0c45-4909-a9f0-7f972b8cc030 tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:23:06 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-6d9cc235-0c45-4909-a9f0-7f972b8cc030 tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:23:06 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-6d9cc235-0c45-4909-a9f0-7f972b8cc030 tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:23:06 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-6d9cc235-0c45-4909-a9f0-7f972b8cc030 tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:23:06 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-6d9cc235-0c45-4909-a9f0-7f972b8cc030 tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:23:07 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-6d9cc235-0c45-4909-a9f0-7f972b8cc030 tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/8c6d8096-853b-4091-ad82-6faf8ffc85fa/os-volume_attachments/d3a41289-1225-4bee-927e-5da050896328" status: 202 len: 0 microversion: 2.1 time: 0.312356 Apr 13 16:23:07 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 71/217] 10.0.0.210 () {64 vars in 1510 bytes} [Thu Apr 13 16:23:06 2023] PUT /compute/v2.1/servers/8c6d8096-853b-4091-ad82-6faf8ffc85fa/os-volume_attachments/d3a41289-1225-4bee-927e-5da050896328 => generated 0 bytes in 314 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 16:23:11 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-11e574de-dc6c-48c4-b898-3cc7f840ba7c tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Calling method '.version_select at 0x7f96e4d61e10>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:23:11 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-11e574de-dc6c-48c4-b898-3cc7f840ba7c tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] 10.0.0.210 "GET /compute/v2.1/images/fe56253b-3d7f-43e5-9008-6d9c17385e97" status: 200 len: 1724 microversion: 2.1 time: 0.062617 Apr 13 16:23:11 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 72/218] 10.0.0.210 () {62 vars in 1310 bytes} [Thu Apr 13 16:23:11 2023] GET /compute/v2.1/images/fe56253b-3d7f-43e5-9008-6d9c17385e97 => generated 1724 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:23:11 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-e8a7b508-8fdc-4413-bfa3-a2b2e7474233 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Calling method '.version_select at 0x7f96e4c45fc0>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:23:11 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-e8a7b508-8fdc-4413-bfa3-a2b2e7474233 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] 10.0.0.210 "GET /compute/v2.1/images/fe56253b-3d7f-43e5-9008-6d9c17385e97" status: 200 len: 1724 microversion: 2.1 time: 0.050805 Apr 13 16:23:11 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 76/219] 10.0.0.210 () {62 vars in 1310 bytes} [Thu Apr 13 16:23:11 2023] GET /compute/v2.1/images/fe56253b-3d7f-43e5-9008-6d9c17385e97 => generated 1724 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:23:11 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-29d11655-5dea-43b1-b17a-62ac0389a2da tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:23:11 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-29d11655-5dea-43b1-b17a-62ac0389a2da tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:23:11 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-29d11655-5dea-43b1-b17a-62ac0389a2da tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:23:11 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-29d11655-5dea-43b1-b17a-62ac0389a2da tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:23:11 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-29d11655-5dea-43b1-b17a-62ac0389a2da tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:23:11 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-29d11655-5dea-43b1-b17a-62ac0389a2da tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:23:11 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-29d11655-5dea-43b1-b17a-62ac0389a2da tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:23:11 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-29d11655-5dea-43b1-b17a-62ac0389a2da tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:23:11 user devstack@n-api.service[62053]: DEBUG nova.policy [None req-29d11655-5dea-43b1-b17a-62ac0389a2da tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf19848229f45baad45c490cf539508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7061f2f041954ffe90b0c87b422890e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62053) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:23:11 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-29d11655-5dea-43b1-b17a-62ac0389a2da tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bbcccf4b-e861-4254-9be3-a491776214e9" status: 200 len: 1670 microversion: 2.1 time: 0.147111 Apr 13 16:23:11 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 72/220] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:23:11 2023] GET /compute/v2.1/servers/bbcccf4b-e861-4254-9be3-a491776214e9 => generated 1670 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:23:13 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-9e131767-04d4-45b2-8e12-2a4ab0daa556 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-1447697852", "imageRef": "708622a9-7465-4492-ade8-b827198f7e30", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "blank", "volume_size": 1, "destination_type": "volume"}], "networks": [{"uuid": "5a7877ff-8230-470b-90b5-e5dcfc8f0cee"}]}} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:23:13 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:23:13 user devstack@n-api.service[62055]: DEBUG nova.network.neutron [None req-9e131767-04d4-45b2-8e12-2a4ab0daa556 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] validate_networks() for [('5a7877ff-8230-470b-90b5-e5dcfc8f0cee', None, None, None, None, None)] {{(pid=62055) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 16:23:14 user devstack@n-api.service[62055]: DEBUG nova.virt.hardware [None req-9e131767-04d4-45b2-8e12-2a4ab0daa556 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Flavor limits 0:0:0 {{(pid=62055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 16:23:14 user devstack@n-api.service[62055]: DEBUG nova.virt.hardware [None req-9e131767-04d4-45b2-8e12-2a4ab0daa556 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Image limits 0:0:0 {{(pid=62055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 16:23:14 user devstack@n-api.service[62055]: DEBUG nova.virt.hardware [None req-9e131767-04d4-45b2-8e12-2a4ab0daa556 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Flavor pref 0:0:0 {{(pid=62055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 16:23:14 user devstack@n-api.service[62055]: DEBUG nova.virt.hardware [None req-9e131767-04d4-45b2-8e12-2a4ab0daa556 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Image pref 0:0:0 {{(pid=62055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 16:23:14 user devstack@n-api.service[62055]: DEBUG nova.virt.hardware [None req-9e131767-04d4-45b2-8e12-2a4ab0daa556 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 16:23:14 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-9e131767-04d4-45b2-8e12-2a4ab0daa556 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:23:14 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-9e131767-04d4-45b2-8e12-2a4ab0daa556 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:23:14 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-9e131767-04d4-45b2-8e12-2a4ab0daa556 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:23:14 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-9e131767-04d4-45b2-8e12-2a4ab0daa556 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:23:14 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-9e131767-04d4-45b2-8e12-2a4ab0daa556 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:23:14 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-9e131767-04d4-45b2-8e12-2a4ab0daa556 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:23:14 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:23:14 user devstack@n-api.service[62055]: DEBUG nova.quota [None req-9e131767-04d4-45b2-8e12-2a4ab0daa556 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Getting quotas for project b2d09a74bf684a9fb1dd1e95d6c23f3c. Resources: {'instances', 'cores', 'ram'} {{(pid=62055) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 16:23:14 user devstack@n-api.service[62055]: DEBUG nova.quota [None req-9e131767-04d4-45b2-8e12-2a4ab0daa556 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Getting quotas for user e45a882dbafb4ea4976e4f45289eb2b8 and project b2d09a74bf684a9fb1dd1e95d6c23f3c. Resources: {'instances', 'cores', 'ram'} {{(pid=62055) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 16:23:14 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-9e131767-04d4-45b2-8e12-2a4ab0daa556 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Going to run 1 instances... {{(pid=62055) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 16:23:14 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-9e131767-04d4-45b2-8e12-2a4ab0daa556 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=62055) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 16:23:14 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-b2c1701b-4139-41e7-96d4-1cc7eb8c74d8 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:23:14 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-b2c1701b-4139-41e7-96d4-1cc7eb8c74d8 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:23:14 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_api:SELECT=17 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:23:14 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-b2c1701b-4139-41e7-96d4-1cc7eb8c74d8 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:23:14 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-b2c1701b-4139-41e7-96d4-1cc7eb8c74d8 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:23:14 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-b2c1701b-4139-41e7-96d4-1cc7eb8c74d8 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:23:14 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-b2c1701b-4139-41e7-96d4-1cc7eb8c74d8 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:23:14 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-b2c1701b-4139-41e7-96d4-1cc7eb8c74d8 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:23:14 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-b2c1701b-4139-41e7-96d4-1cc7eb8c74d8 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:23:14 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-9e131767-04d4-45b2-8e12-2a4ab0daa556 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 1.144086 Apr 13 16:23:14 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 73/221] 10.0.0.210 () {66 vars in 1265 bytes} [Thu Apr 13 16:23:13 2023] POST /compute/v2.1/servers => generated 378 bytes in 1146 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 13 16:23:14 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-47cdef6d-a0cd-4663-b7ee-5a34deda54db tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:23:14 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-47cdef6d-a0cd-4663-b7ee-5a34deda54db tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:23:14 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_cell1:SELECT=41,nova_cell1:INSERT=1 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:23:14 user devstack@n-api.service[62053]: DEBUG nova.policy [None req-47cdef6d-a0cd-4663-b7ee-5a34deda54db tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45a882dbafb4ea4976e4f45289eb2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d09a74bf684a9fb1dd1e95d6c23f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62053) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:23:14 user devstack@n-api.service[62053]: DEBUG nova.policy [None req-47cdef6d-a0cd-4663-b7ee-5a34deda54db tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e45a882dbafb4ea4976e4f45289eb2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d09a74bf684a9fb1dd1e95d6c23f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62053) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:23:14 user devstack@n-api.service[62053]: DEBUG nova.policy [None req-47cdef6d-a0cd-4663-b7ee-5a34deda54db tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e45a882dbafb4ea4976e4f45289eb2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d09a74bf684a9fb1dd1e95d6c23f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62053) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:23:14 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-47cdef6d-a0cd-4663-b7ee-5a34deda54db tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] 10.0.0.210 "GET /compute/v2.1/servers/235f827c-7116-48e9-84c5-0c9761c18e1e" status: 200 len: 1395 microversion: 2.87 time: 0.082015 Apr 13 16:23:14 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 73/222] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 16:23:14 2023] GET /compute/v2.1/servers/235f827c-7116-48e9-84c5-0c9761c18e1e => generated 1395 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 16:23:14 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-b2c1701b-4139-41e7-96d4-1cc7eb8c74d8 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e4ada2d7-7ace-4ed4-86a6-ed121c95e80f/os-interface" status: 200 len: 1829 microversion: 2.42 time: 0.134436 Apr 13 16:23:14 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 77/223] 10.0.0.210 () {64 vars in 1393 bytes} [Thu Apr 13 16:23:14 2023] GET /compute/v2.1/servers/e4ada2d7-7ace-4ed4-86a6-ed121c95e80f/os-interface => generated 1829 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 13 16:23:14 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-019c04a4-1d65-427d-96ed-1a24fbd9a3c6 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:23:14 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-019c04a4-1d65-427d-96ed-1a24fbd9a3c6 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:23:14 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-019c04a4-1d65-427d-96ed-1a24fbd9a3c6 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:23:14 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-019c04a4-1d65-427d-96ed-1a24fbd9a3c6 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:23:14 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-019c04a4-1d65-427d-96ed-1a24fbd9a3c6 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:23:14 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-019c04a4-1d65-427d-96ed-1a24fbd9a3c6 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:23:14 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-019c04a4-1d65-427d-96ed-1a24fbd9a3c6 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:23:14 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-019c04a4-1d65-427d-96ed-1a24fbd9a3c6 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:23:15 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-019c04a4-1d65-427d-96ed-1a24fbd9a3c6 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2549ba85-4e0a-420e-b711-07cafa8c60e9/os-interface" status: 200 len: 1829 microversion: 2.32 time: 0.170253 Apr 13 16:23:15 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 74/224] 10.0.0.210 () {64 vars in 1393 bytes} [Thu Apr 13 16:23:14 2023] GET /compute/v2.1/servers/2549ba85-4e0a-420e-b711-07cafa8c60e9/os-interface => generated 1829 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 16:23:15 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-fe849af7-1ea8-40a6-8703-ddc31a65b63e tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:23:15 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-fe849af7-1ea8-40a6-8703-ddc31a65b63e tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] [instance: 823749e1-56ca-44f9-be83-a36b4851c28f] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:23:15 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-fe849af7-1ea8-40a6-8703-ddc31a65b63e tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:23:15 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-fe849af7-1ea8-40a6-8703-ddc31a65b63e tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:23:15 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-fe849af7-1ea8-40a6-8703-ddc31a65b63e tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:23:15 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-fe849af7-1ea8-40a6-8703-ddc31a65b63e tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:23:15 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-fe849af7-1ea8-40a6-8703-ddc31a65b63e tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:23:15 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-fe849af7-1ea8-40a6-8703-ddc31a65b63e tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:23:15 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_cell1:SELECT=59,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:23:15 user devstack@n-api.service[62053]: INFO nova.api.openstack.wsgi [None req-fe849af7-1ea8-40a6-8703-ddc31a65b63e tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] HTTP exception thrown: Instance 823749e1-56ca-44f9-be83-a36b4851c28f could not be found. Apr 13 16:23:15 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-fe849af7-1ea8-40a6-8703-ddc31a65b63e tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Request method failure captured: Apr 13 16:23:15 user devstack@n-api.service[62053]: request: GET /compute/v2.1/servers/823749e1-56ca-44f9-be83-a36b4851c28f HTTP/1.1 Apr 13 16:23:15 user devstack@n-api.service[62053]: Accept: application/json Apr 13 16:23:15 user devstack@n-api.service[62053]: Accept-Encoding: identity Apr 13 16:23:15 user devstack@n-api.service[62053]: Connection: close Apr 13 16:23:15 user devstack@n-api.service[62053]: Content-Length: 0 Apr 13 16:23:15 user devstack@n-api.service[62053]: Content-Type: application/json Apr 13 16:23:15 user devstack@n-api.service[62053]: Host: 10.0.0.210 Apr 13 16:23:15 user devstack@n-api.service[62053]: Openstack-System-Scope: None Apr 13 16:23:15 user devstack@n-api.service[62053]: User-Agent: python-urllib3/1.26.15 Apr 13 16:23:15 user devstack@n-api.service[62053]: X-Auth-Token: gAAAAABkOCvGmn8t3JOik8FMnAeE_xE-9WuX2SrfwuDSjvfThqLEPojSzlht7ZV2f8zgYFoos_2-k-KXVc7r2lgpWXXr7ZQHB5bGcbo7M2gXlARxGz67L4Ejgqla5tiXk8m3boORi2OzcIKWylhP_nVcV3pDpwV_90g-0lP8NjPhg8JCumwyb6Q Apr 13 16:23:15 user devstack@n-api.service[62053]: X-Domain-Id: None Apr 13 16:23:15 user devstack@n-api.service[62053]: X-Domain-Name: None Apr 13 16:23:15 user devstack@n-api.service[62053]: X-Identity-Status: Confirmed Apr 13 16:23:15 user devstack@n-api.service[62053]: X-Is-Admin-Project: True Apr 13 16:23:15 user devstack@n-api.service[62053]: X-Project-Domain-Id: default Apr 13 16:23:15 user devstack@n-api.service[62053]: X-Project-Domain-Name: Default Apr 13 16:23:15 user devstack@n-api.service[62053]: X-Project-Id: 608ff87aadc7408e9010212fd5f482b7 Apr 13 16:23:15 user devstack@n-api.service[62053]: X-Project-Name: tempest-DeleteServersTestJSON-1138024295 Apr 13 16:23:15 user devstack@n-api.service[62053]: X-Role: reader,member Apr 13 16:23:15 user devstack@n-api.service[62053]: X-Roles: reader,member Apr 13 16:23:15 user devstack@n-api.service[62053]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/608ff87aadc7408e9010212fd5f482b7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/608ff87aadc7408e9010212fd5f482b7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/608ff87aadc7408e9010212fd5f482b7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 13 16:23:15 user devstack@n-api.service[62053]: X-Tenant: tempest-DeleteServersTestJSON-1138024295 Apr 13 16:23:15 user devstack@n-api.service[62053]: X-Tenant-Id: 608ff87aadc7408e9010212fd5f482b7 Apr 13 16:23:15 user devstack@n-api.service[62053]: X-Tenant-Name: tempest-DeleteServersTestJSON-1138024295 Apr 13 16:23:15 user devstack@n-api.service[62053]: X-User: tempest-DeleteServersTestJSON-1138024295-project-member Apr 13 16:23:15 user devstack@n-api.service[62053]: X-User-Domain-Id: default Apr 13 16:23:15 user devstack@n-api.service[62053]: X-User-Domain-Name: Default Apr 13 16:23:15 user devstack@n-api.service[62053]: X-User-Id: 55d232911f5742aa83146f19f13dd198 Apr 13 16:23:15 user devstack@n-api.service[62053]: X-User-Name: tempest-DeleteServersTestJSON-1138024295-project-member Apr 13 16:23:15 user devstack@n-api.service[62053]: method: > Apr 13 16:23:15 user devstack@n-api.service[62053]: exception: Instance 823749e1-56ca-44f9-be83-a36b4851c28f could not be found. Apr 13 16:23:15 user devstack@n-api.service[62053]: action_args: {'id': '823749e1-56ca-44f9-be83-a36b4851c28f'} Apr 13 16:23:15 user devstack@n-api.service[62053]: {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 16:23:15 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:23:15 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 16:23:15 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 16:23:15 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 16:23:15 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 16:23:15 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 16:23:15 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 16:23:15 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 16:23:15 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 16:23:15 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 823749e1-56ca-44f9-be83-a36b4851c28f could not be found. Apr 13 16:23:15 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:23:15 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:23:15 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:23:15 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:23:15 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 16:23:15 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 16:23:15 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 16:23:15 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 16:23:15 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 16:23:15 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 16:23:15 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 16:23:15 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 16:23:15 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 16:23:15 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 16:23:15 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 16:23:15 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 16:23:15 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 823749e1-56ca-44f9-be83-a36b4851c28f could not be found. Apr 13 16:23:15 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:23:15 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:23:15 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:23:15 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:23:15 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 16:23:15 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 16:23:15 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 16:23:15 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 16:23:15 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 823749e1-56ca-44f9-be83-a36b4851c28f could not be found. Apr 13 16:23:15 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:23:15 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-fe849af7-1ea8-40a6-8703-ddc31a65b63e tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Returning 404 to user: Instance 823749e1-56ca-44f9-be83-a36b4851c28f could not be found. {{(pid=62053) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 16:23:15 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-fe849af7-1ea8-40a6-8703-ddc31a65b63e tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] 10.0.0.210 "GET /compute/v2.1/servers/823749e1-56ca-44f9-be83-a36b4851c28f" status: 404 len: 111 microversion: 2.1 time: 0.047120 Apr 13 16:23:15 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 74/225] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:23:15 2023] GET /compute/v2.1/servers/823749e1-56ca-44f9-be83-a36b4851c28f => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 16:23:15 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-e0bd970a-5641-4fcb-9f79-541d494e087a tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:23:15 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-e0bd970a-5641-4fcb-9f79-541d494e087a tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] [instance: 823749e1-56ca-44f9-be83-a36b4851c28f] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:23:15 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-e0bd970a-5641-4fcb-9f79-541d494e087a tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:23:15 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-e0bd970a-5641-4fcb-9f79-541d494e087a tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:23:15 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-e0bd970a-5641-4fcb-9f79-541d494e087a tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:23:15 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-e0bd970a-5641-4fcb-9f79-541d494e087a tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:23:15 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-e0bd970a-5641-4fcb-9f79-541d494e087a tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:23:15 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-e0bd970a-5641-4fcb-9f79-541d494e087a tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:23:15 user devstack@n-api.service[62054]: INFO nova.api.openstack.wsgi [None req-e0bd970a-5641-4fcb-9f79-541d494e087a tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] HTTP exception thrown: Instance 823749e1-56ca-44f9-be83-a36b4851c28f could not be found. Apr 13 16:23:15 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-e0bd970a-5641-4fcb-9f79-541d494e087a tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Request method failure captured: Apr 13 16:23:15 user devstack@n-api.service[62054]: request: GET /compute/v2.1/servers/823749e1-56ca-44f9-be83-a36b4851c28f/os-volume_attachments HTTP/1.1 Apr 13 16:23:15 user devstack@n-api.service[62054]: Accept: application/json Apr 13 16:23:15 user devstack@n-api.service[62054]: Accept-Encoding: identity Apr 13 16:23:15 user devstack@n-api.service[62054]: Connection: close Apr 13 16:23:15 user devstack@n-api.service[62054]: Content-Length: 0 Apr 13 16:23:15 user devstack@n-api.service[62054]: Content-Type: application/json Apr 13 16:23:15 user devstack@n-api.service[62054]: Host: 10.0.0.210 Apr 13 16:23:15 user devstack@n-api.service[62054]: Openstack-System-Scope: None Apr 13 16:23:15 user devstack@n-api.service[62054]: User-Agent: python-urllib3/1.26.15 Apr 13 16:23:15 user devstack@n-api.service[62054]: X-Auth-Token: gAAAAABkOCvGmn8t3JOik8FMnAeE_xE-9WuX2SrfwuDSjvfThqLEPojSzlht7ZV2f8zgYFoos_2-k-KXVc7r2lgpWXXr7ZQHB5bGcbo7M2gXlARxGz67L4Ejgqla5tiXk8m3boORi2OzcIKWylhP_nVcV3pDpwV_90g-0lP8NjPhg8JCumwyb6Q Apr 13 16:23:15 user devstack@n-api.service[62054]: X-Domain-Id: None Apr 13 16:23:15 user devstack@n-api.service[62054]: X-Domain-Name: None Apr 13 16:23:15 user devstack@n-api.service[62054]: X-Identity-Status: Confirmed Apr 13 16:23:15 user devstack@n-api.service[62054]: X-Is-Admin-Project: True Apr 13 16:23:15 user devstack@n-api.service[62054]: X-Project-Domain-Id: default Apr 13 16:23:15 user devstack@n-api.service[62054]: X-Project-Domain-Name: Default Apr 13 16:23:15 user devstack@n-api.service[62054]: X-Project-Id: 608ff87aadc7408e9010212fd5f482b7 Apr 13 16:23:15 user devstack@n-api.service[62054]: X-Project-Name: tempest-DeleteServersTestJSON-1138024295 Apr 13 16:23:15 user devstack@n-api.service[62054]: X-Role: reader,member Apr 13 16:23:15 user devstack@n-api.service[62054]: X-Roles: reader,member Apr 13 16:23:15 user devstack@n-api.service[62054]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/608ff87aadc7408e9010212fd5f482b7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/608ff87aadc7408e9010212fd5f482b7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/608ff87aadc7408e9010212fd5f482b7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 13 16:23:15 user devstack@n-api.service[62054]: X-Tenant: tempest-DeleteServersTestJSON-1138024295 Apr 13 16:23:15 user devstack@n-api.service[62054]: X-Tenant-Id: 608ff87aadc7408e9010212fd5f482b7 Apr 13 16:23:15 user devstack@n-api.service[62054]: X-Tenant-Name: tempest-DeleteServersTestJSON-1138024295 Apr 13 16:23:15 user devstack@n-api.service[62054]: X-User: tempest-DeleteServersTestJSON-1138024295-project-member Apr 13 16:23:15 user devstack@n-api.service[62054]: X-User-Domain-Id: default Apr 13 16:23:15 user devstack@n-api.service[62054]: X-User-Domain-Name: Default Apr 13 16:23:15 user devstack@n-api.service[62054]: X-User-Id: 55d232911f5742aa83146f19f13dd198 Apr 13 16:23:15 user devstack@n-api.service[62054]: X-User-Name: tempest-DeleteServersTestJSON-1138024295-project-member Apr 13 16:23:15 user devstack@n-api.service[62054]: method: > Apr 13 16:23:15 user devstack@n-api.service[62054]: exception: Instance 823749e1-56ca-44f9-be83-a36b4851c28f could not be found. Apr 13 16:23:15 user devstack@n-api.service[62054]: action_args: {'server_id': '823749e1-56ca-44f9-be83-a36b4851c28f'} Apr 13 16:23:15 user devstack@n-api.service[62054]: {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 16:23:15 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:23:15 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 16:23:15 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 16:23:15 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 16:23:15 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 16:23:15 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 16:23:15 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 16:23:15 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 16:23:15 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 16:23:15 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 823749e1-56ca-44f9-be83-a36b4851c28f could not be found. Apr 13 16:23:15 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:23:15 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:23:15 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:23:15 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:23:15 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 16:23:15 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 16:23:15 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 16:23:15 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 16:23:15 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 16:23:15 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 16:23:15 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 13 16:23:15 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 16:23:15 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 13 16:23:15 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 16:23:15 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Apr 13 16:23:15 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Apr 13 16:23:15 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 16:23:15 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 16:23:15 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 823749e1-56ca-44f9-be83-a36b4851c28f could not be found. Apr 13 16:23:15 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:23:15 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:23:15 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:23:15 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:23:15 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 16:23:15 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 16:23:15 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 16:23:15 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 16:23:15 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 823749e1-56ca-44f9-be83-a36b4851c28f could not be found. Apr 13 16:23:15 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:23:15 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-e0bd970a-5641-4fcb-9f79-541d494e087a tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Returning 404 to user: Instance 823749e1-56ca-44f9-be83-a36b4851c28f could not be found. {{(pid=62054) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 16:23:15 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-e0bd970a-5641-4fcb-9f79-541d494e087a tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] 10.0.0.210 "GET /compute/v2.1/servers/823749e1-56ca-44f9-be83-a36b4851c28f/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.059375 Apr 13 16:23:15 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 78/226] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 16:23:15 2023] GET /compute/v2.1/servers/823749e1-56ca-44f9-be83-a36b4851c28f/os-volume_attachments => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 16:23:16 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [req-a4bfb42a-ae92-4e20-be8d-afcd30f7869e req-80f0e18c-3bd1-44fb-aaf5-8f7964ebf203 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2549ba85-4e0a-420e-b711-07cafa8c60e9", "tag": "36152688-366c-40a2-8bf9-88f69925594a"}]} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:23:16 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-a4bfb42a-ae92-4e20-be8d-afcd30f7869e req-80f0e18c-3bd1-44fb-aaf5-8f7964ebf203 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:23:16 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-a4bfb42a-ae92-4e20-be8d-afcd30f7869e req-80f0e18c-3bd1-44fb-aaf5-8f7964ebf203 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:23:16 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-a4bfb42a-ae92-4e20-be8d-afcd30f7869e req-80f0e18c-3bd1-44fb-aaf5-8f7964ebf203 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:23:16 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-966e8c91-d158-4253-a6f6-e74b1c87c080 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:23:16 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-a4bfb42a-ae92-4e20-be8d-afcd30f7869e req-80f0e18c-3bd1-44fb-aaf5-8f7964ebf203 service nova] Creating event network-changed:36152688-366c-40a2-8bf9-88f69925594a for instance 2549ba85-4e0a-420e-b711-07cafa8c60e9 on user Apr 13 16:23:16 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-966e8c91-d158-4253-a6f6-e74b1c87c080 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:23:16 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [req-a4bfb42a-ae92-4e20-be8d-afcd30f7869e req-80f0e18c-3bd1-44fb-aaf5-8f7964ebf203 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041115 Apr 13 16:23:16 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 75/227] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:23:16 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 16:23:16 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-966e8c91-d158-4253-a6f6-e74b1c87c080 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:23:16 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-966e8c91-d158-4253-a6f6-e74b1c87c080 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:23:16 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-966e8c91-d158-4253-a6f6-e74b1c87c080 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:23:16 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-966e8c91-d158-4253-a6f6-e74b1c87c080 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:23:16 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-966e8c91-d158-4253-a6f6-e74b1c87c080 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:23:16 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-966e8c91-d158-4253-a6f6-e74b1c87c080 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:23:16 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-7669d726-c8d2-4ff6-aecf-0ad5d113c8a4 req-aeddb40d-66dd-46f2-b890-2b84667b1069 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4ada2d7-7ace-4ed4-86a6-ed121c95e80f", "tag": "a409f60c-6c6a-49f8-8520-04614e804002"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:23:16 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-7669d726-c8d2-4ff6-aecf-0ad5d113c8a4 req-aeddb40d-66dd-46f2-b890-2b84667b1069 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:23:16 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-7669d726-c8d2-4ff6-aecf-0ad5d113c8a4 req-aeddb40d-66dd-46f2-b890-2b84667b1069 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:23:16 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-7669d726-c8d2-4ff6-aecf-0ad5d113c8a4 req-aeddb40d-66dd-46f2-b890-2b84667b1069 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:23:16 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-7669d726-c8d2-4ff6-aecf-0ad5d113c8a4 req-aeddb40d-66dd-46f2-b890-2b84667b1069 service nova] Creating event network-changed:a409f60c-6c6a-49f8-8520-04614e804002 for instance e4ada2d7-7ace-4ed4-86a6-ed121c95e80f on user Apr 13 16:23:16 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [req-7669d726-c8d2-4ff6-aecf-0ad5d113c8a4 req-aeddb40d-66dd-46f2-b890-2b84667b1069 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062365 Apr 13 16:23:16 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 79/228] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:23:16 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:23:17 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-f5a75d6f-8593-4845-9551-71e01d27ed76 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:23:17 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-f5a75d6f-8593-4845-9551-71e01d27ed76 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:23:17 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-f5a75d6f-8593-4845-9551-71e01d27ed76 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:23:17 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-f5a75d6f-8593-4845-9551-71e01d27ed76 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:23:17 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-f5a75d6f-8593-4845-9551-71e01d27ed76 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:23:17 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-f5a75d6f-8593-4845-9551-71e01d27ed76 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:23:17 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-f5a75d6f-8593-4845-9551-71e01d27ed76 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:23:17 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-f5a75d6f-8593-4845-9551-71e01d27ed76 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:23:17 user devstack@n-api.service[62055]: DEBUG nova.policy [None req-f5a75d6f-8593-4845-9551-71e01d27ed76 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e50bd9d540549a194f706dac48ce93d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649e366b0164e2fa5b3faa0830b6ea6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62055) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:23:17 user devstack@n-api.service[62055]: DEBUG nova.policy [None req-f5a75d6f-8593-4845-9551-71e01d27ed76 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e50bd9d540549a194f706dac48ce93d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649e366b0164e2fa5b3faa0830b6ea6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62055) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:23:17 user devstack@n-api.service[62055]: DEBUG nova.policy [None req-f5a75d6f-8593-4845-9551-71e01d27ed76 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e50bd9d540549a194f706dac48ce93d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649e366b0164e2fa5b3faa0830b6ea6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62055) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:23:17 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-f5a75d6f-8593-4845-9551-71e01d27ed76 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e4ada2d7-7ace-4ed4-86a6-ed121c95e80f" status: 200 len: 2822 microversion: 2.42 time: 0.360955 Apr 13 16:23:17 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 76/229] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 16:23:16 2023] GET /compute/v2.1/servers/e4ada2d7-7ace-4ed4-86a6-ed121c95e80f => generated 2822 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 16:23:17 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-cab630e9-9be8-4b10-bfb7-6a95f9cbb8de tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:23:17 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-cab630e9-9be8-4b10-bfb7-6a95f9cbb8de tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:23:17 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-cab630e9-9be8-4b10-bfb7-6a95f9cbb8de tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:23:17 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-cab630e9-9be8-4b10-bfb7-6a95f9cbb8de tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:23:17 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-cab630e9-9be8-4b10-bfb7-6a95f9cbb8de tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:23:17 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-cab630e9-9be8-4b10-bfb7-6a95f9cbb8de tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:23:17 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-cab630e9-9be8-4b10-bfb7-6a95f9cbb8de tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:23:17 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-cab630e9-9be8-4b10-bfb7-6a95f9cbb8de tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:23:17 user devstack@n-api.service[62053]: DEBUG nova.policy [None req-966e8c91-d158-4253-a6f6-e74b1c87c080 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14566b85d0424c08999726ff72a67634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe4e9fb786d4015b035b4d00f75a1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62053) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:23:17 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-cab630e9-9be8-4b10-bfb7-6a95f9cbb8de tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e4ada2d7-7ace-4ed4-86a6-ed121c95e80f/os-interface" status: 200 len: 1829 microversion: 2.42 time: 0.224998 Apr 13 16:23:17 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 80/230] 10.0.0.210 () {64 vars in 1393 bytes} [Thu Apr 13 16:23:17 2023] GET /compute/v2.1/servers/e4ada2d7-7ace-4ed4-86a6-ed121c95e80f/os-interface => generated 1829 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 16:23:17 user devstack@n-api.service[62053]: DEBUG nova.policy [None req-966e8c91-d158-4253-a6f6-e74b1c87c080 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14566b85d0424c08999726ff72a67634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe4e9fb786d4015b035b4d00f75a1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62053) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:23:17 user devstack@n-api.service[62053]: DEBUG nova.policy [None req-966e8c91-d158-4253-a6f6-e74b1c87c080 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14566b85d0424c08999726ff72a67634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe4e9fb786d4015b035b4d00f75a1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62053) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:23:17 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-966e8c91-d158-4253-a6f6-e74b1c87c080 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2549ba85-4e0a-420e-b711-07cafa8c60e9" status: 200 len: 2822 microversion: 2.32 time: 0.819130 Apr 13 16:23:17 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 75/231] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 16:23:16 2023] GET /compute/v2.1/servers/2549ba85-4e0a-420e-b711-07cafa8c60e9 => generated 2822 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 16:23:17 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-e6a2611e-d94d-4505-87c0-be603ed08f99 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:23:17 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-e6a2611e-d94d-4505-87c0-be603ed08f99 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:23:17 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-e6a2611e-d94d-4505-87c0-be603ed08f99 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:23:17 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-e6a2611e-d94d-4505-87c0-be603ed08f99 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:23:17 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-e6a2611e-d94d-4505-87c0-be603ed08f99 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:23:17 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-e6a2611e-d94d-4505-87c0-be603ed08f99 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:23:17 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-e6a2611e-d94d-4505-87c0-be603ed08f99 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:23:17 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-e6a2611e-d94d-4505-87c0-be603ed08f99 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:23:17 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-e6a2611e-d94d-4505-87c0-be603ed08f99 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2549ba85-4e0a-420e-b711-07cafa8c60e9/os-interface" status: 200 len: 1829 microversion: 2.32 time: 0.133440 Apr 13 16:23:17 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 77/232] 10.0.0.210 () {64 vars in 1393 bytes} [Thu Apr 13 16:23:17 2023] GET /compute/v2.1/servers/2549ba85-4e0a-420e-b711-07cafa8c60e9/os-interface => generated 1829 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 16:23:18 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-dbf47c70-b17d-428f-97f0-d7601655d4d4 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:23:18 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-dbf47c70-b17d-428f-97f0-d7601655d4d4 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:23:18 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-dbf47c70-b17d-428f-97f0-d7601655d4d4 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:23:18 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-dbf47c70-b17d-428f-97f0-d7601655d4d4 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:23:18 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-dbf47c70-b17d-428f-97f0-d7601655d4d4 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:23:18 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-dbf47c70-b17d-428f-97f0-d7601655d4d4 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:23:18 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-dbf47c70-b17d-428f-97f0-d7601655d4d4 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:23:18 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-dbf47c70-b17d-428f-97f0-d7601655d4d4 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:23:18 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-dbf47c70-b17d-428f-97f0-d7601655d4d4 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Going to try to terminate instance {{(pid=62054) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 16:23:18 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-dbf47c70-b17d-428f-97f0-d7601655d4d4 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e4ada2d7-7ace-4ed4-86a6-ed121c95e80f" status: 204 len: 0 microversion: 2.42 time: 0.132981 Apr 13 16:23:18 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 81/233] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 13 16:23:18 2023] DELETE /compute/v2.1/servers/e4ada2d7-7ace-4ed4-86a6-ed121c95e80f => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 13 16:23:18 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-384d182b-f621-45f2-84ae-ccd2efa68392 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:23:18 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-384d182b-f621-45f2-84ae-ccd2efa68392 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:23:18 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-384d182b-f621-45f2-84ae-ccd2efa68392 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:23:18 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-384d182b-f621-45f2-84ae-ccd2efa68392 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:23:18 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-384d182b-f621-45f2-84ae-ccd2efa68392 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:23:18 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-384d182b-f621-45f2-84ae-ccd2efa68392 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:23:18 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-384d182b-f621-45f2-84ae-ccd2efa68392 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:23:18 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-384d182b-f621-45f2-84ae-ccd2efa68392 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:23:19 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-48b63815-ac65-4477-a276-ce12f90a7768 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:23:19 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-48b63815-ac65-4477-a276-ce12f90a7768 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:23:19 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-48b63815-ac65-4477-a276-ce12f90a7768 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:23:19 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-48b63815-ac65-4477-a276-ce12f90a7768 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:23:19 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-48b63815-ac65-4477-a276-ce12f90a7768 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:23:19 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-48b63815-ac65-4477-a276-ce12f90a7768 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:23:19 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-48b63815-ac65-4477-a276-ce12f90a7768 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:23:19 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-48b63815-ac65-4477-a276-ce12f90a7768 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:23:19 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-48b63815-ac65-4477-a276-ce12f90a7768 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Going to try to terminate instance {{(pid=62055) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 16:23:19 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-928ffb60-2661-4ec9-99d3-7a9f7e7d4883 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:23:19 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-928ffb60-2661-4ec9-99d3-7a9f7e7d4883 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] [instance: 8c6d8096-853b-4091-ad82-6faf8ffc85fa] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:23:19 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-928ffb60-2661-4ec9-99d3-7a9f7e7d4883 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:23:19 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-928ffb60-2661-4ec9-99d3-7a9f7e7d4883 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:23:19 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-928ffb60-2661-4ec9-99d3-7a9f7e7d4883 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:23:19 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-928ffb60-2661-4ec9-99d3-7a9f7e7d4883 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:23:19 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-928ffb60-2661-4ec9-99d3-7a9f7e7d4883 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:23:19 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-928ffb60-2661-4ec9-99d3-7a9f7e7d4883 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:23:19 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-48b63815-ac65-4477-a276-ce12f90a7768 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/2549ba85-4e0a-420e-b711-07cafa8c60e9" status: 204 len: 0 microversion: 2.32 time: 0.184991 Apr 13 16:23:19 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 78/234] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 13 16:23:19 2023] DELETE /compute/v2.1/servers/2549ba85-4e0a-420e-b711-07cafa8c60e9 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 13 16:23:19 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [req-a0c7e314-7ea4-4d74-b53e-6bfc70abc808 req-6db9cb28-fc39-4943-b8c0-fa3b6ad46371 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "235f827c-7116-48e9-84c5-0c9761c18e1e", "tag": "b72a6c8b-7244-41c2-a4f7-6da43b4944b8"}]} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:23:19 user devstack@n-api.service[62053]: DEBUG nova.policy [None req-384d182b-f621-45f2-84ae-ccd2efa68392 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e50bd9d540549a194f706dac48ce93d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649e366b0164e2fa5b3faa0830b6ea6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62053) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:23:19 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-928ffb60-2661-4ec9-99d3-7a9f7e7d4883 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8c6d8096-853b-4091-ad82-6faf8ffc85fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055644 Apr 13 16:23:19 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 82/235] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 16:23:19 2023] GET /compute/v2.1/servers/8c6d8096-853b-4091-ad82-6faf8ffc85fa/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:23:19 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-ee98982f-dba6-45a8-b3e0-ffaf7152e693 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:23:19 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-ee98982f-dba6-45a8-b3e0-ffaf7152e693 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:23:19 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-ee98982f-dba6-45a8-b3e0-ffaf7152e693 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:23:19 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-ee98982f-dba6-45a8-b3e0-ffaf7152e693 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:23:19 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-ee98982f-dba6-45a8-b3e0-ffaf7152e693 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:23:19 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-a0c7e314-7ea4-4d74-b53e-6bfc70abc808 req-6db9cb28-fc39-4943-b8c0-fa3b6ad46371 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:23:19 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-ee98982f-dba6-45a8-b3e0-ffaf7152e693 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:23:19 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-ee98982f-dba6-45a8-b3e0-ffaf7152e693 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:23:19 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-a0c7e314-7ea4-4d74-b53e-6bfc70abc808 req-6db9cb28-fc39-4943-b8c0-fa3b6ad46371 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:23:19 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-ee98982f-dba6-45a8-b3e0-ffaf7152e693 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:23:19 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-a0c7e314-7ea4-4d74-b53e-6bfc70abc808 req-6db9cb28-fc39-4943-b8c0-fa3b6ad46371 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:23:19 user devstack@n-api.service[62053]: DEBUG nova.policy [None req-384d182b-f621-45f2-84ae-ccd2efa68392 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e50bd9d540549a194f706dac48ce93d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649e366b0164e2fa5b3faa0830b6ea6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62053) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:23:19 user devstack@n-api.service[62053]: DEBUG nova.policy [None req-384d182b-f621-45f2-84ae-ccd2efa68392 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e50bd9d540549a194f706dac48ce93d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649e366b0164e2fa5b3faa0830b6ea6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62053) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:23:19 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-384d182b-f621-45f2-84ae-ccd2efa68392 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e4ada2d7-7ace-4ed4-86a6-ed121c95e80f" status: 200 len: 2947 microversion: 2.42 time: 0.411093 Apr 13 16:23:19 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 76/236] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 16:23:18 2023] GET /compute/v2.1/servers/e4ada2d7-7ace-4ed4-86a6-ed121c95e80f => generated 2947 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 16:23:19 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-a6cbd759-b4f2-4ab1-8198-5b423243b6a6 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:23:19 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-a6cbd759-b4f2-4ab1-8198-5b423243b6a6 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] [instance: 8c6d8096-853b-4091-ad82-6faf8ffc85fa] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:23:19 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-a6cbd759-b4f2-4ab1-8198-5b423243b6a6 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:23:19 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-a6cbd759-b4f2-4ab1-8198-5b423243b6a6 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:23:19 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-a6cbd759-b4f2-4ab1-8198-5b423243b6a6 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:23:19 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-a0c7e314-7ea4-4d74-b53e-6bfc70abc808 req-6db9cb28-fc39-4943-b8c0-fa3b6ad46371 service nova] Creating event network-changed:b72a6c8b-7244-41c2-a4f7-6da43b4944b8 for instance 235f827c-7116-48e9-84c5-0c9761c18e1e on user Apr 13 16:23:19 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-a6cbd759-b4f2-4ab1-8198-5b423243b6a6 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:23:19 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-a6cbd759-b4f2-4ab1-8198-5b423243b6a6 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:23:19 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-a6cbd759-b4f2-4ab1-8198-5b423243b6a6 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:23:19 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [req-a0c7e314-7ea4-4d74-b53e-6bfc70abc808 req-6db9cb28-fc39-4943-b8c0-fa3b6ad46371 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073818 Apr 13 16:23:19 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 79/237] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:23:19 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:23:19 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-a6cbd759-b4f2-4ab1-8198-5b423243b6a6 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8c6d8096-853b-4091-ad82-6faf8ffc85fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056716 Apr 13 16:23:19 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 77/238] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 16:23:19 2023] GET /compute/v2.1/servers/8c6d8096-853b-4091-ad82-6faf8ffc85fa/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:23:19 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-e756df0a-9800-4113-816b-da9f309139b0 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:23:19 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-e756df0a-9800-4113-816b-da9f309139b0 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] [instance: 823749e1-56ca-44f9-be83-a36b4851c28f] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:23:19 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-e756df0a-9800-4113-816b-da9f309139b0 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:23:19 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-e756df0a-9800-4113-816b-da9f309139b0 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:23:19 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-e756df0a-9800-4113-816b-da9f309139b0 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:23:19 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-e756df0a-9800-4113-816b-da9f309139b0 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:23:19 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-e756df0a-9800-4113-816b-da9f309139b0 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:23:19 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-e756df0a-9800-4113-816b-da9f309139b0 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:23:19 user devstack@n-api.service[62055]: INFO nova.api.openstack.wsgi [None req-e756df0a-9800-4113-816b-da9f309139b0 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] HTTP exception thrown: Instance 823749e1-56ca-44f9-be83-a36b4851c28f could not be found. Apr 13 16:23:19 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-e756df0a-9800-4113-816b-da9f309139b0 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Request method failure captured: Apr 13 16:23:19 user devstack@n-api.service[62055]: request: DELETE /compute/v2.1/servers/823749e1-56ca-44f9-be83-a36b4851c28f HTTP/1.1 Apr 13 16:23:19 user devstack@n-api.service[62055]: Accept: application/json Apr 13 16:23:19 user devstack@n-api.service[62055]: Accept-Encoding: identity Apr 13 16:23:19 user devstack@n-api.service[62055]: Connection: close Apr 13 16:23:19 user devstack@n-api.service[62055]: Content-Length: 0 Apr 13 16:23:19 user devstack@n-api.service[62055]: Content-Type: application/json Apr 13 16:23:19 user devstack@n-api.service[62055]: Host: 10.0.0.210 Apr 13 16:23:19 user devstack@n-api.service[62055]: Openstack-System-Scope: None Apr 13 16:23:19 user devstack@n-api.service[62055]: User-Agent: python-urllib3/1.26.15 Apr 13 16:23:19 user devstack@n-api.service[62055]: X-Auth-Token: gAAAAABkOCvGmn8t3JOik8FMnAeE_xE-9WuX2SrfwuDSjvfThqLEPojSzlht7ZV2f8zgYFoos_2-k-KXVc7r2lgpWXXr7ZQHB5bGcbo7M2gXlARxGz67L4Ejgqla5tiXk8m3boORi2OzcIKWylhP_nVcV3pDpwV_90g-0lP8NjPhg8JCumwyb6Q Apr 13 16:23:19 user devstack@n-api.service[62055]: X-Domain-Id: None Apr 13 16:23:19 user devstack@n-api.service[62055]: X-Domain-Name: None Apr 13 16:23:19 user devstack@n-api.service[62055]: X-Identity-Status: Confirmed Apr 13 16:23:19 user devstack@n-api.service[62055]: X-Is-Admin-Project: True Apr 13 16:23:19 user devstack@n-api.service[62055]: X-Project-Domain-Id: default Apr 13 16:23:19 user devstack@n-api.service[62055]: X-Project-Domain-Name: Default Apr 13 16:23:19 user devstack@n-api.service[62055]: X-Project-Id: 608ff87aadc7408e9010212fd5f482b7 Apr 13 16:23:19 user devstack@n-api.service[62055]: X-Project-Name: tempest-DeleteServersTestJSON-1138024295 Apr 13 16:23:19 user devstack@n-api.service[62055]: X-Role: reader,member Apr 13 16:23:19 user devstack@n-api.service[62055]: X-Roles: reader,member Apr 13 16:23:19 user devstack@n-api.service[62055]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/608ff87aadc7408e9010212fd5f482b7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/608ff87aadc7408e9010212fd5f482b7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/608ff87aadc7408e9010212fd5f482b7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 13 16:23:19 user devstack@n-api.service[62055]: X-Tenant: tempest-DeleteServersTestJSON-1138024295 Apr 13 16:23:19 user devstack@n-api.service[62055]: X-Tenant-Id: 608ff87aadc7408e9010212fd5f482b7 Apr 13 16:23:19 user devstack@n-api.service[62055]: X-Tenant-Name: tempest-DeleteServersTestJSON-1138024295 Apr 13 16:23:19 user devstack@n-api.service[62055]: X-User: tempest-DeleteServersTestJSON-1138024295-project-member Apr 13 16:23:19 user devstack@n-api.service[62055]: X-User-Domain-Id: default Apr 13 16:23:19 user devstack@n-api.service[62055]: X-User-Domain-Name: Default Apr 13 16:23:19 user devstack@n-api.service[62055]: X-User-Id: 55d232911f5742aa83146f19f13dd198 Apr 13 16:23:19 user devstack@n-api.service[62055]: X-User-Name: tempest-DeleteServersTestJSON-1138024295-project-member Apr 13 16:23:19 user devstack@n-api.service[62055]: method: > Apr 13 16:23:19 user devstack@n-api.service[62055]: exception: Instance 823749e1-56ca-44f9-be83-a36b4851c28f could not be found. Apr 13 16:23:19 user devstack@n-api.service[62055]: action_args: {'id': '823749e1-56ca-44f9-be83-a36b4851c28f'} Apr 13 16:23:19 user devstack@n-api.service[62055]: {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 16:23:19 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:23:19 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 16:23:19 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 16:23:19 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 16:23:19 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 16:23:19 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 16:23:19 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 16:23:19 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 16:23:19 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 16:23:19 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 823749e1-56ca-44f9-be83-a36b4851c28f could not be found. Apr 13 16:23:19 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:23:19 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:23:19 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:23:19 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:23:19 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 16:23:19 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 16:23:19 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 16:23:19 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 16:23:19 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 16:23:19 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 16:23:19 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 16:23:19 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 16:23:19 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 16:23:19 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 16:23:19 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 16:23:19 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 16:23:19 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 16:23:19 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 16:23:19 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 823749e1-56ca-44f9-be83-a36b4851c28f could not be found. Apr 13 16:23:19 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:23:19 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:23:19 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:23:19 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:23:19 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 16:23:19 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 16:23:19 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 16:23:19 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 16:23:19 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 823749e1-56ca-44f9-be83-a36b4851c28f could not be found. Apr 13 16:23:19 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:23:19 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-e756df0a-9800-4113-816b-da9f309139b0 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Returning 404 to user: Instance 823749e1-56ca-44f9-be83-a36b4851c28f could not be found. {{(pid=62055) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 16:23:19 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-e756df0a-9800-4113-816b-da9f309139b0 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/823749e1-56ca-44f9-be83-a36b4851c28f" status: 404 len: 111 microversion: 2.1 time: 0.044602 Apr 13 16:23:19 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 80/239] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 16:23:19 2023] DELETE /compute/v2.1/servers/823749e1-56ca-44f9-be83-a36b4851c28f => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 16:23:19 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-7e024d87-2f2b-46f7-b474-9a33d6373f0f tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:23:19 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-7e024d87-2f2b-46f7-b474-9a33d6373f0f tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] [instance: 823749e1-56ca-44f9-be83-a36b4851c28f] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:23:19 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-7e024d87-2f2b-46f7-b474-9a33d6373f0f tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:23:19 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-7e024d87-2f2b-46f7-b474-9a33d6373f0f tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:23:19 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-7e024d87-2f2b-46f7-b474-9a33d6373f0f tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:23:19 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-7e024d87-2f2b-46f7-b474-9a33d6373f0f tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:23:19 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-7e024d87-2f2b-46f7-b474-9a33d6373f0f tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:23:19 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-7e024d87-2f2b-46f7-b474-9a33d6373f0f tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:23:19 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [req-7f7492f9-1f05-4f2d-b1bb-4f58af44f8c7 req-6cdef93e-a7d0-4780-bbe7-f44557c5fdec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4ada2d7-7ace-4ed4-86a6-ed121c95e80f", "name": "network-vif-unplugged", "status": "completed", "tag": "ac94464f-32dc-4cd1-a270-ec8934e77c21"}]} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:23:19 user devstack@n-api.service[62053]: INFO nova.api.openstack.wsgi [None req-7e024d87-2f2b-46f7-b474-9a33d6373f0f tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] HTTP exception thrown: Instance 823749e1-56ca-44f9-be83-a36b4851c28f could not be found. Apr 13 16:23:19 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-7f7492f9-1f05-4f2d-b1bb-4f58af44f8c7 req-6cdef93e-a7d0-4780-bbe7-f44557c5fdec service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:23:19 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-7f7492f9-1f05-4f2d-b1bb-4f58af44f8c7 req-6cdef93e-a7d0-4780-bbe7-f44557c5fdec service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:23:19 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-7f7492f9-1f05-4f2d-b1bb-4f58af44f8c7 req-6cdef93e-a7d0-4780-bbe7-f44557c5fdec service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:23:19 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-7e024d87-2f2b-46f7-b474-9a33d6373f0f tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Request method failure captured: Apr 13 16:23:19 user devstack@n-api.service[62053]: request: GET /compute/v2.1/servers/823749e1-56ca-44f9-be83-a36b4851c28f HTTP/1.1 Apr 13 16:23:19 user devstack@n-api.service[62053]: Accept: application/json Apr 13 16:23:19 user devstack@n-api.service[62053]: Accept-Encoding: identity Apr 13 16:23:19 user devstack@n-api.service[62053]: Connection: close Apr 13 16:23:19 user devstack@n-api.service[62053]: Content-Length: 0 Apr 13 16:23:19 user devstack@n-api.service[62053]: Content-Type: application/json Apr 13 16:23:19 user devstack@n-api.service[62053]: Host: 10.0.0.210 Apr 13 16:23:19 user devstack@n-api.service[62053]: Openstack-System-Scope: None Apr 13 16:23:19 user devstack@n-api.service[62053]: User-Agent: python-urllib3/1.26.15 Apr 13 16:23:19 user devstack@n-api.service[62053]: X-Auth-Token: gAAAAABkOCvGmn8t3JOik8FMnAeE_xE-9WuX2SrfwuDSjvfThqLEPojSzlht7ZV2f8zgYFoos_2-k-KXVc7r2lgpWXXr7ZQHB5bGcbo7M2gXlARxGz67L4Ejgqla5tiXk8m3boORi2OzcIKWylhP_nVcV3pDpwV_90g-0lP8NjPhg8JCumwyb6Q Apr 13 16:23:19 user devstack@n-api.service[62053]: X-Domain-Id: None Apr 13 16:23:19 user devstack@n-api.service[62053]: X-Domain-Name: None Apr 13 16:23:19 user devstack@n-api.service[62053]: X-Identity-Status: Confirmed Apr 13 16:23:19 user devstack@n-api.service[62053]: X-Is-Admin-Project: True Apr 13 16:23:19 user devstack@n-api.service[62053]: X-Project-Domain-Id: default Apr 13 16:23:19 user devstack@n-api.service[62053]: X-Project-Domain-Name: Default Apr 13 16:23:19 user devstack@n-api.service[62053]: X-Project-Id: 608ff87aadc7408e9010212fd5f482b7 Apr 13 16:23:19 user devstack@n-api.service[62053]: X-Project-Name: tempest-DeleteServersTestJSON-1138024295 Apr 13 16:23:19 user devstack@n-api.service[62053]: X-Role: reader,member Apr 13 16:23:19 user devstack@n-api.service[62053]: X-Roles: reader,member Apr 13 16:23:19 user devstack@n-api.service[62053]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/608ff87aadc7408e9010212fd5f482b7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/608ff87aadc7408e9010212fd5f482b7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/608ff87aadc7408e9010212fd5f482b7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 13 16:23:19 user devstack@n-api.service[62053]: X-Tenant: tempest-DeleteServersTestJSON-1138024295 Apr 13 16:23:19 user devstack@n-api.service[62053]: X-Tenant-Id: 608ff87aadc7408e9010212fd5f482b7 Apr 13 16:23:19 user devstack@n-api.service[62053]: X-Tenant-Name: tempest-DeleteServersTestJSON-1138024295 Apr 13 16:23:19 user devstack@n-api.service[62053]: X-User: tempest-DeleteServersTestJSON-1138024295-project-member Apr 13 16:23:19 user devstack@n-api.service[62053]: X-User-Domain-Id: default Apr 13 16:23:19 user devstack@n-api.service[62053]: X-User-Domain-Name: Default Apr 13 16:23:19 user devstack@n-api.service[62053]: X-User-Id: 55d232911f5742aa83146f19f13dd198 Apr 13 16:23:19 user devstack@n-api.service[62053]: X-User-Name: tempest-DeleteServersTestJSON-1138024295-project-member Apr 13 16:23:19 user devstack@n-api.service[62053]: method: > Apr 13 16:23:19 user devstack@n-api.service[62053]: exception: Instance 823749e1-56ca-44f9-be83-a36b4851c28f could not be found. Apr 13 16:23:19 user devstack@n-api.service[62053]: action_args: {'id': '823749e1-56ca-44f9-be83-a36b4851c28f'} Apr 13 16:23:19 user devstack@n-api.service[62053]: {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 16:23:19 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:23:19 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 16:23:19 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 16:23:19 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 16:23:19 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 16:23:19 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 16:23:19 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 16:23:19 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 16:23:19 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 16:23:19 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 823749e1-56ca-44f9-be83-a36b4851c28f could not be found. Apr 13 16:23:19 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:23:19 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:23:19 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:23:19 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:23:19 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 16:23:19 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 16:23:19 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 16:23:19 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 16:23:19 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 16:23:19 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 16:23:19 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 16:23:19 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 16:23:19 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 16:23:19 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 16:23:19 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 16:23:19 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 16:23:19 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 823749e1-56ca-44f9-be83-a36b4851c28f could not be found. Apr 13 16:23:19 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:23:19 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:23:19 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:23:19 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:23:19 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 16:23:19 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 16:23:19 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 16:23:19 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 16:23:19 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 823749e1-56ca-44f9-be83-a36b4851c28f could not be found. Apr 13 16:23:19 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:23:19 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-7e024d87-2f2b-46f7-b474-9a33d6373f0f tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Returning 404 to user: Instance 823749e1-56ca-44f9-be83-a36b4851c28f could not be found. {{(pid=62053) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 16:23:19 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-7e024d87-2f2b-46f7-b474-9a33d6373f0f tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] 10.0.0.210 "GET /compute/v2.1/servers/823749e1-56ca-44f9-be83-a36b4851c28f" status: 404 len: 111 microversion: 2.1 time: 0.053567 Apr 13 16:23:19 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 78/240] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:23:19 2023] GET /compute/v2.1/servers/823749e1-56ca-44f9-be83-a36b4851c28f => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 16:23:19 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-cfbbaf71-6557-432f-a527-7937d6bc5423 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:23:19 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-cfbbaf71-6557-432f-a527-7937d6bc5423 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] [instance: 8c6d8096-853b-4091-ad82-6faf8ffc85fa] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:23:19 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-cfbbaf71-6557-432f-a527-7937d6bc5423 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:23:19 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-cfbbaf71-6557-432f-a527-7937d6bc5423 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:23:19 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-cfbbaf71-6557-432f-a527-7937d6bc5423 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:23:19 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-cfbbaf71-6557-432f-a527-7937d6bc5423 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:23:19 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-cfbbaf71-6557-432f-a527-7937d6bc5423 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:23:19 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-cfbbaf71-6557-432f-a527-7937d6bc5423 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:23:19 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-7f7492f9-1f05-4f2d-b1bb-4f58af44f8c7 req-6cdef93e-a7d0-4780-bbe7-f44557c5fdec service nova] Creating event network-vif-unplugged:ac94464f-32dc-4cd1-a270-ec8934e77c21 for instance e4ada2d7-7ace-4ed4-86a6-ed121c95e80f on user Apr 13 16:23:19 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [req-7f7492f9-1f05-4f2d-b1bb-4f58af44f8c7 req-6cdef93e-a7d0-4780-bbe7-f44557c5fdec service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057965 Apr 13 16:23:19 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 81/241] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:23:19 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:23:19 user devstack@n-api.service[62053]: DEBUG nova.objects.instance [None req-cfbbaf71-6557-432f-a527-7937d6bc5423 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Lazy-loading 'services' on Instance uuid 8c6d8096-853b-4091-ad82-6faf8ffc85fa {{(pid=62053) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 16:23:19 user devstack@n-api.service[62054]: DEBUG nova.policy [None req-ee98982f-dba6-45a8-b3e0-ffaf7152e693 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14566b85d0424c08999726ff72a67634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe4e9fb786d4015b035b4d00f75a1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62054) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:23:19 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [req-9c292206-e760-4ae3-b88a-c4aaa01ad318 req-8af19971-1957-406d-9990-daa8d60d9eec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4ada2d7-7ace-4ed4-86a6-ed121c95e80f", "name": "network-vif-unplugged", "status": "completed", "tag": "8f3a3011-e474-4538-812b-9df3968fd629"}]} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:23:19 user devstack@n-api.service[62054]: DEBUG nova.policy [None req-ee98982f-dba6-45a8-b3e0-ffaf7152e693 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14566b85d0424c08999726ff72a67634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe4e9fb786d4015b035b4d00f75a1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62054) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:23:19 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-9c292206-e760-4ae3-b88a-c4aaa01ad318 req-8af19971-1957-406d-9990-daa8d60d9eec service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:23:19 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-9c292206-e760-4ae3-b88a-c4aaa01ad318 req-8af19971-1957-406d-9990-daa8d60d9eec service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:23:19 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-9c292206-e760-4ae3-b88a-c4aaa01ad318 req-8af19971-1957-406d-9990-daa8d60d9eec service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:23:19 user devstack@n-api.service[62054]: DEBUG nova.policy [None req-ee98982f-dba6-45a8-b3e0-ffaf7152e693 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14566b85d0424c08999726ff72a67634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe4e9fb786d4015b035b4d00f75a1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62054) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:23:19 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-ee98982f-dba6-45a8-b3e0-ffaf7152e693 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2549ba85-4e0a-420e-b711-07cafa8c60e9" status: 200 len: 2946 microversion: 2.32 time: 0.466648 Apr 13 16:23:19 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 83/242] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 16:23:19 2023] GET /compute/v2.1/servers/2549ba85-4e0a-420e-b711-07cafa8c60e9 => generated 2946 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 16:23:19 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-9c292206-e760-4ae3-b88a-c4aaa01ad318 req-8af19971-1957-406d-9990-daa8d60d9eec service nova] Creating event network-vif-unplugged:8f3a3011-e474-4538-812b-9df3968fd629 for instance e4ada2d7-7ace-4ed4-86a6-ed121c95e80f on user Apr 13 16:23:19 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [req-9c292206-e760-4ae3-b88a-c4aaa01ad318 req-8af19971-1957-406d-9990-daa8d60d9eec service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044027 Apr 13 16:23:19 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 82/243] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:23:19 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:23:19 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-cfbbaf71-6557-432f-a527-7937d6bc5423 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8c6d8096-853b-4091-ad82-6faf8ffc85fa/os-volume_attachments/62e7747a-651a-4d0a-a763-bfce9c4a3cff" status: 202 len: 0 microversion: 2.1 time: 0.331269 Apr 13 16:23:19 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 79/244] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 16:23:19 2023] DELETE /compute/v2.1/servers/8c6d8096-853b-4091-ad82-6faf8ffc85fa/os-volume_attachments/62e7747a-651a-4d0a-a763-bfce9c4a3cff => generated 0 bytes in 333 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 16:23:19 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-601f28ad-a315-4bf6-9ba9-43c418b245a9 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:23:19 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-601f28ad-a315-4bf6-9ba9-43c418b245a9 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] [instance: 8c6d8096-853b-4091-ad82-6faf8ffc85fa] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:23:19 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-601f28ad-a315-4bf6-9ba9-43c418b245a9 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:23:19 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-601f28ad-a315-4bf6-9ba9-43c418b245a9 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:23:19 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-601f28ad-a315-4bf6-9ba9-43c418b245a9 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:23:19 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-601f28ad-a315-4bf6-9ba9-43c418b245a9 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:23:19 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-601f28ad-a315-4bf6-9ba9-43c418b245a9 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:23:19 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-601f28ad-a315-4bf6-9ba9-43c418b245a9 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:23:19 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-601f28ad-a315-4bf6-9ba9-43c418b245a9 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8c6d8096-853b-4091-ad82-6faf8ffc85fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071023 Apr 13 16:23:19 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 84/245] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 16:23:19 2023] GET /compute/v2.1/servers/8c6d8096-853b-4091-ad82-6faf8ffc85fa/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:23:21 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [req-3d6e9cfb-7cee-4f6c-8ddd-341c5011adb4 req-705cf505-5ea9-445f-9b08-608afc7a82e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4ada2d7-7ace-4ed4-86a6-ed121c95e80f", "name": "network-vif-unplugged", "status": "completed", "tag": "a409f60c-6c6a-49f8-8520-04614e804002"}, {"server_uuid": "e4ada2d7-7ace-4ed4-86a6-ed121c95e80f", "name": "network-vif-plugged", "status": "completed", "tag": "a409f60c-6c6a-49f8-8520-04614e804002"}, {"server_uuid": "e4ada2d7-7ace-4ed4-86a6-ed121c95e80f", "name": "network-vif-unplugged", "status": "completed", "tag": "0125a8df-e91c-4d65-be74-fda2f2d93938"}]} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:23:21 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-3d6e9cfb-7cee-4f6c-8ddd-341c5011adb4 req-705cf505-5ea9-445f-9b08-608afc7a82e0 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:23:21 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-3d6e9cfb-7cee-4f6c-8ddd-341c5011adb4 req-705cf505-5ea9-445f-9b08-608afc7a82e0 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:23:21 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-3d6e9cfb-7cee-4f6c-8ddd-341c5011adb4 req-705cf505-5ea9-445f-9b08-608afc7a82e0 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:23:21 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-3d6e9cfb-7cee-4f6c-8ddd-341c5011adb4 req-705cf505-5ea9-445f-9b08-608afc7a82e0 service nova] Creating event network-vif-unplugged:a409f60c-6c6a-49f8-8520-04614e804002 for instance e4ada2d7-7ace-4ed4-86a6-ed121c95e80f on user Apr 13 16:23:21 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-3d6e9cfb-7cee-4f6c-8ddd-341c5011adb4 req-705cf505-5ea9-445f-9b08-608afc7a82e0 service nova] Creating event network-vif-plugged:a409f60c-6c6a-49f8-8520-04614e804002 for instance e4ada2d7-7ace-4ed4-86a6-ed121c95e80f on user Apr 13 16:23:21 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-3d6e9cfb-7cee-4f6c-8ddd-341c5011adb4 req-705cf505-5ea9-445f-9b08-608afc7a82e0 service nova] Creating event network-vif-unplugged:0125a8df-e91c-4d65-be74-fda2f2d93938 for instance e4ada2d7-7ace-4ed4-86a6-ed121c95e80f on user Apr 13 16:23:21 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [req-3d6e9cfb-7cee-4f6c-8ddd-341c5011adb4 req-705cf505-5ea9-445f-9b08-608afc7a82e0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 529 microversion: 2.1 time: 0.076298 Apr 13 16:23:21 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 83/246] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:23:21 2023] POST /compute/v2.1/os-server-external-events => generated 529 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:23:21 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-99d9d482-612d-4963-b567-a6df8f50a008 req-0bc37d2f-33d3-4686-90cf-3aef947ef043 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4ada2d7-7ace-4ed4-86a6-ed121c95e80f", "name": "network-vif-plugged", "status": "completed", "tag": "ac94464f-32dc-4cd1-a270-ec8934e77c21"}, {"server_uuid": "e4ada2d7-7ace-4ed4-86a6-ed121c95e80f", "name": "network-vif-unplugged", "status": "completed", "tag": "2430beb8-b2e4-4493-bdc5-df6b4c1181c6"}, {"server_uuid": "e4ada2d7-7ace-4ed4-86a6-ed121c95e80f", "name": "network-vif-plugged", "status": "completed", "tag": "2430beb8-b2e4-4493-bdc5-df6b4c1181c6"}, {"server_uuid": "e4ada2d7-7ace-4ed4-86a6-ed121c95e80f", "name": "network-vif-unplugged", "status": "completed", "tag": "d41765b6-0d5b-43c1-bf58-a82a7bbe3137"}, {"server_uuid": "e4ada2d7-7ace-4ed4-86a6-ed121c95e80f", "name": "network-vif-plugged", "status": "completed", "tag": "d41765b6-0d5b-43c1-bf58-a82a7bbe3137"}, {"server_uuid": "2549ba85-4e0a-420e-b711-07cafa8c60e9", "name": "network-vif-unplugged", "status": "completed", "tag": "0fbdf291-df5d-41c5-a765-7145a87da272"}, {"server_uuid": "2549ba85-4e0a-420e-b711-07cafa8c60e9", "name": "network-vif-plugged", "status": "completed", "tag": "0fbdf291-df5d-41c5-a765-7145a87da272"}, {"server_uuid": "2549ba85-4e0a-420e-b711-07cafa8c60e9", "name": "network-vif-unplugged", "status": "completed", "tag": "38e92b7c-b7c1-4137-a1db-21bc1d24f3ee"}, {"server_uuid": "2549ba85-4e0a-420e-b711-07cafa8c60e9", "name": "network-vif-plugged", "status": "completed", "tag": "38e92b7c-b7c1-4137-a1db-21bc1d24f3ee"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:23:21 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-99d9d482-612d-4963-b567-a6df8f50a008 req-0bc37d2f-33d3-4686-90cf-3aef947ef043 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:23:21 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-99d9d482-612d-4963-b567-a6df8f50a008 req-0bc37d2f-33d3-4686-90cf-3aef947ef043 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:23:21 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-99d9d482-612d-4963-b567-a6df8f50a008 req-0bc37d2f-33d3-4686-90cf-3aef947ef043 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:23:21 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-99d9d482-612d-4963-b567-a6df8f50a008 req-0bc37d2f-33d3-4686-90cf-3aef947ef043 service nova] Creating event network-vif-plugged:ac94464f-32dc-4cd1-a270-ec8934e77c21 for instance e4ada2d7-7ace-4ed4-86a6-ed121c95e80f on user Apr 13 16:23:21 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-99d9d482-612d-4963-b567-a6df8f50a008 req-0bc37d2f-33d3-4686-90cf-3aef947ef043 service nova] Creating event network-vif-unplugged:2430beb8-b2e4-4493-bdc5-df6b4c1181c6 for instance e4ada2d7-7ace-4ed4-86a6-ed121c95e80f on user Apr 13 16:23:21 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-99d9d482-612d-4963-b567-a6df8f50a008 req-0bc37d2f-33d3-4686-90cf-3aef947ef043 service nova] Creating event network-vif-plugged:2430beb8-b2e4-4493-bdc5-df6b4c1181c6 for instance e4ada2d7-7ace-4ed4-86a6-ed121c95e80f on user Apr 13 16:23:21 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-99d9d482-612d-4963-b567-a6df8f50a008 req-0bc37d2f-33d3-4686-90cf-3aef947ef043 service nova] Creating event network-vif-unplugged:d41765b6-0d5b-43c1-bf58-a82a7bbe3137 for instance e4ada2d7-7ace-4ed4-86a6-ed121c95e80f on user Apr 13 16:23:21 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-99d9d482-612d-4963-b567-a6df8f50a008 req-0bc37d2f-33d3-4686-90cf-3aef947ef043 service nova] Creating event network-vif-plugged:d41765b6-0d5b-43c1-bf58-a82a7bbe3137 for instance e4ada2d7-7ace-4ed4-86a6-ed121c95e80f on user Apr 13 16:23:21 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-99d9d482-612d-4963-b567-a6df8f50a008 req-0bc37d2f-33d3-4686-90cf-3aef947ef043 service nova] Creating event network-vif-unplugged:0fbdf291-df5d-41c5-a765-7145a87da272 for instance 2549ba85-4e0a-420e-b711-07cafa8c60e9 on user Apr 13 16:23:21 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-99d9d482-612d-4963-b567-a6df8f50a008 req-0bc37d2f-33d3-4686-90cf-3aef947ef043 service nova] Creating event network-vif-plugged:0fbdf291-df5d-41c5-a765-7145a87da272 for instance 2549ba85-4e0a-420e-b711-07cafa8c60e9 on user Apr 13 16:23:21 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-99d9d482-612d-4963-b567-a6df8f50a008 req-0bc37d2f-33d3-4686-90cf-3aef947ef043 service nova] Creating event network-vif-unplugged:38e92b7c-b7c1-4137-a1db-21bc1d24f3ee for instance 2549ba85-4e0a-420e-b711-07cafa8c60e9 on user Apr 13 16:23:21 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-99d9d482-612d-4963-b567-a6df8f50a008 req-0bc37d2f-33d3-4686-90cf-3aef947ef043 service nova] Creating event network-vif-plugged:38e92b7c-b7c1-4137-a1db-21bc1d24f3ee for instance 2549ba85-4e0a-420e-b711-07cafa8c60e9 on user Apr 13 16:23:21 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [req-99d9d482-612d-4963-b567-a6df8f50a008 req-0bc37d2f-33d3-4686-90cf-3aef947ef043 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1559 microversion: 2.1 time: 0.049250 Apr 13 16:23:21 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 80/247] 10.0.0.210 () {68 vars in 1395 bytes} [Thu Apr 13 16:23:21 2023] POST /compute/v2.1/os-server-external-events => generated 1559 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:23:21 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-8375c23c-fcbe-4ba0-a6f5-f957cfb42a0d req-34e6fe1c-37e7-4aa3-b365-9a83c233565a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4ada2d7-7ace-4ed4-86a6-ed121c95e80f", "name": "network-vif-plugged", "status": "completed", "tag": "8f3a3011-e474-4538-812b-9df3968fd629"}, {"server_uuid": "2549ba85-4e0a-420e-b711-07cafa8c60e9", "name": "network-vif-unplugged", "status": "completed", "tag": "36152688-366c-40a2-8bf9-88f69925594a"}, {"server_uuid": "2549ba85-4e0a-420e-b711-07cafa8c60e9", "name": "network-vif-plugged", "status": "completed", "tag": "36152688-366c-40a2-8bf9-88f69925594a"}, {"server_uuid": "e4ada2d7-7ace-4ed4-86a6-ed121c95e80f", "name": "network-vif-unplugged", "status": "completed", "tag": "15dca2c3-5048-4e80-8008-c19400ea34e4"}, {"server_uuid": "e4ada2d7-7ace-4ed4-86a6-ed121c95e80f", "name": "network-vif-plugged", "status": "completed", "tag": "15dca2c3-5048-4e80-8008-c19400ea34e4"}, {"server_uuid": "2549ba85-4e0a-420e-b711-07cafa8c60e9", "name": "network-vif-unplugged", "status": "completed", "tag": "0152bbb9-d50d-4e58-8a2b-727c4675ea2f"}, {"server_uuid": "2549ba85-4e0a-420e-b711-07cafa8c60e9", "name": "network-vif-plugged", "status": "completed", "tag": "0152bbb9-d50d-4e58-8a2b-727c4675ea2f"}, {"server_uuid": "2549ba85-4e0a-420e-b711-07cafa8c60e9", "name": "network-vif-unplugged", "status": "completed", "tag": "4c481745-6342-43f8-9040-3ea1d8c5c572"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:23:21 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-8375c23c-fcbe-4ba0-a6f5-f957cfb42a0d req-34e6fe1c-37e7-4aa3-b365-9a83c233565a service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:23:21 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-8375c23c-fcbe-4ba0-a6f5-f957cfb42a0d req-34e6fe1c-37e7-4aa3-b365-9a83c233565a service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:23:21 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-8375c23c-fcbe-4ba0-a6f5-f957cfb42a0d req-34e6fe1c-37e7-4aa3-b365-9a83c233565a service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:23:21 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-8375c23c-fcbe-4ba0-a6f5-f957cfb42a0d req-34e6fe1c-37e7-4aa3-b365-9a83c233565a service nova] Creating event network-vif-plugged:8f3a3011-e474-4538-812b-9df3968fd629 for instance e4ada2d7-7ace-4ed4-86a6-ed121c95e80f on user Apr 13 16:23:21 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-8375c23c-fcbe-4ba0-a6f5-f957cfb42a0d req-34e6fe1c-37e7-4aa3-b365-9a83c233565a service nova] Creating event network-vif-unplugged:36152688-366c-40a2-8bf9-88f69925594a for instance 2549ba85-4e0a-420e-b711-07cafa8c60e9 on user Apr 13 16:23:21 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-8375c23c-fcbe-4ba0-a6f5-f957cfb42a0d req-34e6fe1c-37e7-4aa3-b365-9a83c233565a service nova] Creating event network-vif-plugged:36152688-366c-40a2-8bf9-88f69925594a for instance 2549ba85-4e0a-420e-b711-07cafa8c60e9 on user Apr 13 16:23:21 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-8375c23c-fcbe-4ba0-a6f5-f957cfb42a0d req-34e6fe1c-37e7-4aa3-b365-9a83c233565a service nova] Creating event network-vif-unplugged:15dca2c3-5048-4e80-8008-c19400ea34e4 for instance e4ada2d7-7ace-4ed4-86a6-ed121c95e80f on user Apr 13 16:23:21 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-8375c23c-fcbe-4ba0-a6f5-f957cfb42a0d req-34e6fe1c-37e7-4aa3-b365-9a83c233565a service nova] Creating event network-vif-plugged:15dca2c3-5048-4e80-8008-c19400ea34e4 for instance e4ada2d7-7ace-4ed4-86a6-ed121c95e80f on user Apr 13 16:23:21 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-8375c23c-fcbe-4ba0-a6f5-f957cfb42a0d req-34e6fe1c-37e7-4aa3-b365-9a83c233565a service nova] Creating event network-vif-unplugged:0152bbb9-d50d-4e58-8a2b-727c4675ea2f for instance 2549ba85-4e0a-420e-b711-07cafa8c60e9 on user Apr 13 16:23:21 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-8375c23c-fcbe-4ba0-a6f5-f957cfb42a0d req-34e6fe1c-37e7-4aa3-b365-9a83c233565a service nova] Creating event network-vif-plugged:0152bbb9-d50d-4e58-8a2b-727c4675ea2f for instance 2549ba85-4e0a-420e-b711-07cafa8c60e9 on user Apr 13 16:23:21 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-8375c23c-fcbe-4ba0-a6f5-f957cfb42a0d req-34e6fe1c-37e7-4aa3-b365-9a83c233565a service nova] Creating event network-vif-unplugged:4c481745-6342-43f8-9040-3ea1d8c5c572 for instance 2549ba85-4e0a-420e-b711-07cafa8c60e9 on user Apr 13 16:23:21 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [req-8375c23c-fcbe-4ba0-a6f5-f957cfb42a0d req-34e6fe1c-37e7-4aa3-b365-9a83c233565a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1388 microversion: 2.1 time: 0.049884 Apr 13 16:23:21 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 85/248] 10.0.0.210 () {68 vars in 1395 bytes} [Thu Apr 13 16:23:21 2023] POST /compute/v2.1/os-server-external-events => generated 1388 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:23:23 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [req-f8a0ed5b-19f3-45de-bbde-8f0b34a61bc5 req-b56725a8-e17a-4ee7-8428-a7af02fd6c9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4ada2d7-7ace-4ed4-86a6-ed121c95e80f", "name": "network-vif-plugged", "status": "completed", "tag": "0125a8df-e91c-4d65-be74-fda2f2d93938"}, {"server_uuid": "2549ba85-4e0a-420e-b711-07cafa8c60e9", "name": "network-vif-unplugged", "status": "completed", "tag": "d7155dcf-9e83-4579-b81a-7277d4a9eeaf"}, {"server_uuid": "2549ba85-4e0a-420e-b711-07cafa8c60e9", "name": "network-vif-plugged", "status": "completed", "tag": "d7155dcf-9e83-4579-b81a-7277d4a9eeaf"}]} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:23:23 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-f8a0ed5b-19f3-45de-bbde-8f0b34a61bc5 req-b56725a8-e17a-4ee7-8428-a7af02fd6c9e service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:23:23 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-f8a0ed5b-19f3-45de-bbde-8f0b34a61bc5 req-b56725a8-e17a-4ee7-8428-a7af02fd6c9e service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:23:23 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-f8a0ed5b-19f3-45de-bbde-8f0b34a61bc5 req-b56725a8-e17a-4ee7-8428-a7af02fd6c9e service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:23:23 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-f8a0ed5b-19f3-45de-bbde-8f0b34a61bc5 req-b56725a8-e17a-4ee7-8428-a7af02fd6c9e service nova] Creating event network-vif-plugged:0125a8df-e91c-4d65-be74-fda2f2d93938 for instance e4ada2d7-7ace-4ed4-86a6-ed121c95e80f on user Apr 13 16:23:23 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-f8a0ed5b-19f3-45de-bbde-8f0b34a61bc5 req-b56725a8-e17a-4ee7-8428-a7af02fd6c9e service nova] Creating event network-vif-unplugged:d7155dcf-9e83-4579-b81a-7277d4a9eeaf for instance 2549ba85-4e0a-420e-b711-07cafa8c60e9 on user Apr 13 16:23:23 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-f8a0ed5b-19f3-45de-bbde-8f0b34a61bc5 req-b56725a8-e17a-4ee7-8428-a7af02fd6c9e service nova] Creating event network-vif-plugged:d7155dcf-9e83-4579-b81a-7277d4a9eeaf for instance 2549ba85-4e0a-420e-b711-07cafa8c60e9 on user Apr 13 16:23:23 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [req-f8a0ed5b-19f3-45de-bbde-8f0b34a61bc5 req-b56725a8-e17a-4ee7-8428-a7af02fd6c9e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.042486 Apr 13 16:23:23 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 84/249] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:23:23 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:23:23 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-f804aa51-bd10-4e3e-a501-e82fcf3e53bd req-a01e3729-0bc3-452b-860e-c040cd63b390 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2549ba85-4e0a-420e-b711-07cafa8c60e9", "name": "network-vif-plugged", "status": "completed", "tag": "4c481745-6342-43f8-9040-3ea1d8c5c572"}, {"server_uuid": "2549ba85-4e0a-420e-b711-07cafa8c60e9", "name": "network-vif-unplugged", "status": "completed", "tag": "3730ed6e-b093-4232-800b-b064d650e9e8"}, {"server_uuid": "2549ba85-4e0a-420e-b711-07cafa8c60e9", "name": "network-vif-plugged", "status": "completed", "tag": "3730ed6e-b093-4232-800b-b064d650e9e8"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:23:23 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-f804aa51-bd10-4e3e-a501-e82fcf3e53bd req-a01e3729-0bc3-452b-860e-c040cd63b390 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:23:23 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-f804aa51-bd10-4e3e-a501-e82fcf3e53bd req-a01e3729-0bc3-452b-860e-c040cd63b390 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:23:23 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-f804aa51-bd10-4e3e-a501-e82fcf3e53bd req-a01e3729-0bc3-452b-860e-c040cd63b390 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:23:23 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-f804aa51-bd10-4e3e-a501-e82fcf3e53bd req-a01e3729-0bc3-452b-860e-c040cd63b390 service nova] Creating event network-vif-plugged:4c481745-6342-43f8-9040-3ea1d8c5c572 for instance 2549ba85-4e0a-420e-b711-07cafa8c60e9 on user Apr 13 16:23:23 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-f804aa51-bd10-4e3e-a501-e82fcf3e53bd req-a01e3729-0bc3-452b-860e-c040cd63b390 service nova] Creating event network-vif-unplugged:3730ed6e-b093-4232-800b-b064d650e9e8 for instance 2549ba85-4e0a-420e-b711-07cafa8c60e9 on user Apr 13 16:23:23 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-f804aa51-bd10-4e3e-a501-e82fcf3e53bd req-a01e3729-0bc3-452b-860e-c040cd63b390 service nova] Creating event network-vif-plugged:3730ed6e-b093-4232-800b-b064d650e9e8 for instance 2549ba85-4e0a-420e-b711-07cafa8c60e9 on user Apr 13 16:23:23 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [req-f804aa51-bd10-4e3e-a501-e82fcf3e53bd req-a01e3729-0bc3-452b-860e-c040cd63b390 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.056048 Apr 13 16:23:23 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 81/250] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:23:23 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:23:25 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-a969112c-b8b8-4710-b337-1114a7ebb0b2 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e962a4d5-41c9-4b3b-b78e-c25e451aa73f", "device": "/dev/vdb"}} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:23:25 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-a969112c-b8b8-4710-b337-1114a7ebb0b2 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] [instance: 031c7939-a53c-4f7d-9f36-4ec1d06e2717] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:23:25 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-a969112c-b8b8-4710-b337-1114a7ebb0b2 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:23:25 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-a969112c-b8b8-4710-b337-1114a7ebb0b2 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:23:25 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-a969112c-b8b8-4710-b337-1114a7ebb0b2 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:23:25 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-a969112c-b8b8-4710-b337-1114a7ebb0b2 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:23:25 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-a969112c-b8b8-4710-b337-1114a7ebb0b2 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:23:25 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-a969112c-b8b8-4710-b337-1114a7ebb0b2 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:23:26 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-a969112c-b8b8-4710-b337-1114a7ebb0b2 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] 10.0.0.210 "POST /compute/v2.1/servers/031c7939-a53c-4f7d-9f36-4ec1d06e2717/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.328349 Apr 13 16:23:26 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 86/251] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 16:23:25 2023] POST /compute/v2.1/servers/031c7939-a53c-4f7d-9f36-4ec1d06e2717/os-volume_attachments => generated 194 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:23:27 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_cell0:SELECT=2 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:23:27 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_cell0:SELECT=6 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:23:27 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-bfffd8e8-9a92-40da-ac12-b098992e3931 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:23:27 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-bfffd8e8-9a92-40da-ac12-b098992e3931 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:23:27 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-bfffd8e8-9a92-40da-ac12-b098992e3931 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:23:27 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-bfffd8e8-9a92-40da-ac12-b098992e3931 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:23:27 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-bfffd8e8-9a92-40da-ac12-b098992e3931 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:23:27 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-bfffd8e8-9a92-40da-ac12-b098992e3931 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:23:27 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-bfffd8e8-9a92-40da-ac12-b098992e3931 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:23:27 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-bfffd8e8-9a92-40da-ac12-b098992e3931 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:23:27 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_cell0:SELECT=2 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:23:27 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-0bed434e-5fb2-4e06-ad75-779572ca9200 req-424cb285-93cc-464b-ae2c-2a7d8c6af2fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4ada2d7-7ace-4ed4-86a6-ed121c95e80f", "name": "network-vif-deleted", "tag": "2430beb8-b2e4-4493-bdc5-df6b4c1181c6"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:23:27 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_api:SELECT=34 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:23:27 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-0bed434e-5fb2-4e06-ad75-779572ca9200 req-424cb285-93cc-464b-ae2c-2a7d8c6af2fe service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:23:27 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-0bed434e-5fb2-4e06-ad75-779572ca9200 req-424cb285-93cc-464b-ae2c-2a7d8c6af2fe service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:23:27 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-0bed434e-5fb2-4e06-ad75-779572ca9200 req-424cb285-93cc-464b-ae2c-2a7d8c6af2fe service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:23:27 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-0bed434e-5fb2-4e06-ad75-779572ca9200 req-424cb285-93cc-464b-ae2c-2a7d8c6af2fe service nova] Creating event network-vif-deleted:2430beb8-b2e4-4493-bdc5-df6b4c1181c6 for instance e4ada2d7-7ace-4ed4-86a6-ed121c95e80f on user Apr 13 16:23:27 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [req-0bed434e-5fb2-4e06-ad75-779572ca9200 req-424cb285-93cc-464b-ae2c-2a7d8c6af2fe service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035185 Apr 13 16:23:27 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 82/252] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:23:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 16:23:27 user devstack@n-api.service[62055]: DEBUG nova.policy [None req-bfffd8e8-9a92-40da-ac12-b098992e3931 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6a4bf1a7794af2958c3d53ea1e19c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed94fa5d89c2486b8e2951e608e6630f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62055) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:23:27 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-bfffd8e8-9a92-40da-ac12-b098992e3931 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bf350da4-9cc2-4900-adf0-506e44984b42" status: 200 len: 1433 microversion: 2.1 time: 0.182955 Apr 13 16:23:27 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 85/253] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:23:27 2023] GET /compute/v2.1/servers/bf350da4-9cc2-4900-adf0-506e44984b42 => generated 1433 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:23:29 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-359b3c7b-2454-4fdd-a8cb-58771a1a8b36 req-2e43653c-f150-4bb8-adbf-3e8ae9bdad02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2549ba85-4e0a-420e-b711-07cafa8c60e9", "name": "network-vif-deleted", "tag": "0fbdf291-df5d-41c5-a765-7145a87da272"}, {"server_uuid": "e4ada2d7-7ace-4ed4-86a6-ed121c95e80f", "name": "network-vif-deleted", "tag": "d41765b6-0d5b-43c1-bf58-a82a7bbe3137"}, {"server_uuid": "e4ada2d7-7ace-4ed4-86a6-ed121c95e80f", "name": "network-vif-deleted", "tag": "15dca2c3-5048-4e80-8008-c19400ea34e4"}, {"server_uuid": "2549ba85-4e0a-420e-b711-07cafa8c60e9", "name": "network-vif-deleted", "tag": "36152688-366c-40a2-8bf9-88f69925594a"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:23:29 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-359b3c7b-2454-4fdd-a8cb-58771a1a8b36 req-2e43653c-f150-4bb8-adbf-3e8ae9bdad02 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:23:29 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-359b3c7b-2454-4fdd-a8cb-58771a1a8b36 req-2e43653c-f150-4bb8-adbf-3e8ae9bdad02 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:23:29 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-359b3c7b-2454-4fdd-a8cb-58771a1a8b36 req-2e43653c-f150-4bb8-adbf-3e8ae9bdad02 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:23:29 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-926ddc63-9f10-415a-8a5e-11567d4523d9 req-f659fa69-e66f-4755-a082-d2b149e1aef5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf350da4-9cc2-4900-adf0-506e44984b42", "tag": "1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:23:29 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-926ddc63-9f10-415a-8a5e-11567d4523d9 req-f659fa69-e66f-4755-a082-d2b149e1aef5 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:23:29 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-926ddc63-9f10-415a-8a5e-11567d4523d9 req-f659fa69-e66f-4755-a082-d2b149e1aef5 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:23:29 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-926ddc63-9f10-415a-8a5e-11567d4523d9 req-f659fa69-e66f-4755-a082-d2b149e1aef5 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:23:29 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-359b3c7b-2454-4fdd-a8cb-58771a1a8b36 req-2e43653c-f150-4bb8-adbf-3e8ae9bdad02 service nova] Creating event network-vif-deleted:0fbdf291-df5d-41c5-a765-7145a87da272 for instance 2549ba85-4e0a-420e-b711-07cafa8c60e9 on user Apr 13 16:23:29 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-359b3c7b-2454-4fdd-a8cb-58771a1a8b36 req-2e43653c-f150-4bb8-adbf-3e8ae9bdad02 service nova] Creating event network-vif-deleted:d41765b6-0d5b-43c1-bf58-a82a7bbe3137 for instance e4ada2d7-7ace-4ed4-86a6-ed121c95e80f on user Apr 13 16:23:29 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-359b3c7b-2454-4fdd-a8cb-58771a1a8b36 req-2e43653c-f150-4bb8-adbf-3e8ae9bdad02 service nova] Creating event network-vif-deleted:15dca2c3-5048-4e80-8008-c19400ea34e4 for instance e4ada2d7-7ace-4ed4-86a6-ed121c95e80f on user Apr 13 16:23:29 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-359b3c7b-2454-4fdd-a8cb-58771a1a8b36 req-2e43653c-f150-4bb8-adbf-3e8ae9bdad02 service nova] Creating event network-vif-deleted:36152688-366c-40a2-8bf9-88f69925594a for instance 2549ba85-4e0a-420e-b711-07cafa8c60e9 on user Apr 13 16:23:29 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [req-359b3c7b-2454-4fdd-a8cb-58771a1a8b36 req-2e43653c-f150-4bb8-adbf-3e8ae9bdad02 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.052119 Apr 13 16:23:29 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 87/254] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:23:29 2023] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:23:29 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-926ddc63-9f10-415a-8a5e-11567d4523d9 req-f659fa69-e66f-4755-a082-d2b149e1aef5 service nova] Creating event network-changed:1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8 for instance bf350da4-9cc2-4900-adf0-506e44984b42 on user Apr 13 16:23:29 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [req-926ddc63-9f10-415a-8a5e-11567d4523d9 req-f659fa69-e66f-4755-a082-d2b149e1aef5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069242 Apr 13 16:23:29 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 83/255] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:23:29 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:23:29 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-12217892-5cbd-46ad-9ee3-cc51a81755e5 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:23:29 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-12217892-5cbd-46ad-9ee3-cc51a81755e5 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:23:29 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-12217892-5cbd-46ad-9ee3-cc51a81755e5 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:23:29 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-12217892-5cbd-46ad-9ee3-cc51a81755e5 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:23:29 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-12217892-5cbd-46ad-9ee3-cc51a81755e5 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:23:29 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-12217892-5cbd-46ad-9ee3-cc51a81755e5 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:23:29 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-12217892-5cbd-46ad-9ee3-cc51a81755e5 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:23:29 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-12217892-5cbd-46ad-9ee3-cc51a81755e5 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:23:29 user devstack@n-api.service[62055]: DEBUG nova.objects.instance [None req-12217892-5cbd-46ad-9ee3-cc51a81755e5 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Lazy-loading 'flavor' on Instance uuid bf350da4-9cc2-4900-adf0-506e44984b42 {{(pid=62055) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 16:23:29 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-12217892-5cbd-46ad-9ee3-cc51a81755e5 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] 10.0.0.210 "POST /compute/v2.1/servers/bf350da4-9cc2-4900-adf0-506e44984b42/action" status: 202 len: 0 microversion: 2.1 time: 0.168882 Apr 13 16:23:29 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 86/256] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 16:23:29 2023] POST /compute/v2.1/servers/bf350da4-9cc2-4900-adf0-506e44984b42/action => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 16:23:29 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-d3744915-aae1-4acf-a356-eb6c2543f2d3 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:23:29 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-d3744915-aae1-4acf-a356-eb6c2543f2d3 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:23:29 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-d3744915-aae1-4acf-a356-eb6c2543f2d3 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:23:29 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-d3744915-aae1-4acf-a356-eb6c2543f2d3 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:23:29 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-d3744915-aae1-4acf-a356-eb6c2543f2d3 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:23:29 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-d3744915-aae1-4acf-a356-eb6c2543f2d3 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:23:29 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-d3744915-aae1-4acf-a356-eb6c2543f2d3 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:23:29 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-d3744915-aae1-4acf-a356-eb6c2543f2d3 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:23:30 user devstack@n-api.service[62054]: DEBUG nova.policy [None req-d3744915-aae1-4acf-a356-eb6c2543f2d3 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6a4bf1a7794af2958c3d53ea1e19c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed94fa5d89c2486b8e2951e608e6630f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62054) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:23:30 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-d3744915-aae1-4acf-a356-eb6c2543f2d3 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bf350da4-9cc2-4900-adf0-506e44984b42" status: 200 len: 1439 microversion: 2.1 time: 0.598266 Apr 13 16:23:30 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 88/257] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:23:29 2023] GET /compute/v2.1/servers/bf350da4-9cc2-4900-adf0-506e44984b42 => generated 1439 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:23:30 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-b638765b-0ff1-4d2c-9a36-c169674649fb req-edcc4bc8-2625-4038-b63a-eb0e0803430c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf350da4-9cc2-4900-adf0-506e44984b42", "name": "network-vif-unplugged", "status": "completed", "tag": "1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:23:30 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-b638765b-0ff1-4d2c-9a36-c169674649fb req-edcc4bc8-2625-4038-b63a-eb0e0803430c service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:23:30 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-b638765b-0ff1-4d2c-9a36-c169674649fb req-edcc4bc8-2625-4038-b63a-eb0e0803430c service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:23:30 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-b638765b-0ff1-4d2c-9a36-c169674649fb req-edcc4bc8-2625-4038-b63a-eb0e0803430c service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:23:30 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-b638765b-0ff1-4d2c-9a36-c169674649fb req-edcc4bc8-2625-4038-b63a-eb0e0803430c service nova] Creating event network-vif-unplugged:1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8 for instance bf350da4-9cc2-4900-adf0-506e44984b42 on user Apr 13 16:23:30 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [req-b638765b-0ff1-4d2c-9a36-c169674649fb req-edcc4bc8-2625-4038-b63a-eb0e0803430c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.072064 Apr 13 16:23:30 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 84/258] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:23:30 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:23:31 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [req-8408accb-65cb-4289-b81b-56e27276ddfb req-d07750a9-6020-4112-b629-b218b5586a93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4ada2d7-7ace-4ed4-86a6-ed121c95e80f", "name": "network-vif-deleted", "tag": "8f3a3011-e474-4538-812b-9df3968fd629"}, {"server_uuid": "2549ba85-4e0a-420e-b711-07cafa8c60e9", "name": "network-vif-deleted", "tag": "0152bbb9-d50d-4e58-8a2b-727c4675ea2f"}, {"server_uuid": "2549ba85-4e0a-420e-b711-07cafa8c60e9", "name": "network-vif-deleted", "tag": "3730ed6e-b093-4232-800b-b064d650e9e8"}, {"server_uuid": "e4ada2d7-7ace-4ed4-86a6-ed121c95e80f", "name": "network-vif-deleted", "tag": "a409f60c-6c6a-49f8-8520-04614e804002"}]} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:23:31 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-8408accb-65cb-4289-b81b-56e27276ddfb req-d07750a9-6020-4112-b629-b218b5586a93 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:23:31 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-8408accb-65cb-4289-b81b-56e27276ddfb req-d07750a9-6020-4112-b629-b218b5586a93 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:23:31 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-8408accb-65cb-4289-b81b-56e27276ddfb req-d07750a9-6020-4112-b629-b218b5586a93 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:23:31 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-8408accb-65cb-4289-b81b-56e27276ddfb req-d07750a9-6020-4112-b629-b218b5586a93 service nova] Creating event network-vif-deleted:8f3a3011-e474-4538-812b-9df3968fd629 for instance e4ada2d7-7ace-4ed4-86a6-ed121c95e80f on user Apr 13 16:23:31 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-8408accb-65cb-4289-b81b-56e27276ddfb req-d07750a9-6020-4112-b629-b218b5586a93 service nova] Creating event network-vif-deleted:0152bbb9-d50d-4e58-8a2b-727c4675ea2f for instance 2549ba85-4e0a-420e-b711-07cafa8c60e9 on user Apr 13 16:23:31 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-8408accb-65cb-4289-b81b-56e27276ddfb req-d07750a9-6020-4112-b629-b218b5586a93 service nova] Creating event network-vif-deleted:3730ed6e-b093-4232-800b-b064d650e9e8 for instance 2549ba85-4e0a-420e-b711-07cafa8c60e9 on user Apr 13 16:23:31 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-8408accb-65cb-4289-b81b-56e27276ddfb req-d07750a9-6020-4112-b629-b218b5586a93 service nova] Creating event network-vif-deleted:a409f60c-6c6a-49f8-8520-04614e804002 for instance e4ada2d7-7ace-4ed4-86a6-ed121c95e80f on user Apr 13 16:23:31 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [req-8408accb-65cb-4289-b81b-56e27276ddfb req-d07750a9-6020-4112-b629-b218b5586a93 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.079209 Apr 13 16:23:31 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 87/259] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:23:31 2023] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:23:32 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-ac1894b6-fabc-4e85-b888-ea78f4f822a8 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:23:32 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-ac1894b6-fabc-4e85-b888-ea78f4f822a8 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] [instance: 5db1cb51-2e5a-46c9-8914-cba759a96a65] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:23:32 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-ac1894b6-fabc-4e85-b888-ea78f4f822a8 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:23:32 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-ac1894b6-fabc-4e85-b888-ea78f4f822a8 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:23:32 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-ac1894b6-fabc-4e85-b888-ea78f4f822a8 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:23:32 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-ac1894b6-fabc-4e85-b888-ea78f4f822a8 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:23:32 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-ac1894b6-fabc-4e85-b888-ea78f4f822a8 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:23:32 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-ac1894b6-fabc-4e85-b888-ea78f4f822a8 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:23:32 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-ac1894b6-fabc-4e85-b888-ea78f4f822a8 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5db1cb51-2e5a-46c9-8914-cba759a96a65/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.065469 Apr 13 16:23:32 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 89/260] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 16:23:32 2023] GET /compute/v2.1/servers/5db1cb51-2e5a-46c9-8914-cba759a96a65/os-volume_attachments => generated 25 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 16:23:32 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-b9c9119a-d4f4-4884-83ee-893254529e1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1338821197", "imageRef": "708622a9-7465-4492-ade8-b827198f7e30", "flavorRef": "42", "networks": [{"uuid": "fc7f5f86-d676-4a45-b0f4-c93f3eae043e"}]}} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:23:32 user devstack@n-api.service[62053]: DEBUG nova.network.neutron [None req-b9c9119a-d4f4-4884-83ee-893254529e1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] validate_networks() for [('fc7f5f86-d676-4a45-b0f4-c93f3eae043e', None, None, None, None, None)] {{(pid=62053) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 16:23:32 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [req-f37f0d3f-7667-49d8-b844-831d0503ef73 req-36dc23bc-d367-4ff3-866f-0e8e308ef2c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf350da4-9cc2-4900-adf0-506e44984b42", "name": "network-vif-plugged", "status": "completed", "tag": "1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8"}, {"server_uuid": "235f827c-7116-48e9-84c5-0c9761c18e1e", "name": "network-vif-plugged", "status": "completed", "tag": "b72a6c8b-7244-41c2-a4f7-6da43b4944b8"}]} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:23:32 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-f37f0d3f-7667-49d8-b844-831d0503ef73 req-36dc23bc-d367-4ff3-866f-0e8e308ef2c4 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:23:32 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-f37f0d3f-7667-49d8-b844-831d0503ef73 req-36dc23bc-d367-4ff3-866f-0e8e308ef2c4 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:23:32 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-f37f0d3f-7667-49d8-b844-831d0503ef73 req-36dc23bc-d367-4ff3-866f-0e8e308ef2c4 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:23:32 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-f37f0d3f-7667-49d8-b844-831d0503ef73 req-36dc23bc-d367-4ff3-866f-0e8e308ef2c4 service nova] Creating event network-vif-plugged:1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8 for instance bf350da4-9cc2-4900-adf0-506e44984b42 on user Apr 13 16:23:32 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-f37f0d3f-7667-49d8-b844-831d0503ef73 req-36dc23bc-d367-4ff3-866f-0e8e308ef2c4 service nova] Creating event network-vif-plugged:b72a6c8b-7244-41c2-a4f7-6da43b4944b8 for instance 235f827c-7116-48e9-84c5-0c9761c18e1e on user Apr 13 16:23:32 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [req-f37f0d3f-7667-49d8-b844-831d0503ef73 req-36dc23bc-d367-4ff3-866f-0e8e308ef2c4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.035136 Apr 13 16:23:32 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 88/261] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:23:32 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:23:33 user devstack@n-api.service[62053]: DEBUG nova.virt.hardware [None req-b9c9119a-d4f4-4884-83ee-893254529e1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Flavor limits 0:0:0 {{(pid=62053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 16:23:33 user devstack@n-api.service[62053]: DEBUG nova.virt.hardware [None req-b9c9119a-d4f4-4884-83ee-893254529e1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Image limits 0:0:0 {{(pid=62053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 16:23:33 user devstack@n-api.service[62053]: DEBUG nova.virt.hardware [None req-b9c9119a-d4f4-4884-83ee-893254529e1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Flavor pref 0:0:0 {{(pid=62053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 16:23:33 user devstack@n-api.service[62053]: DEBUG nova.virt.hardware [None req-b9c9119a-d4f4-4884-83ee-893254529e1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Image pref 0:0:0 {{(pid=62053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 16:23:33 user devstack@n-api.service[62053]: DEBUG nova.virt.hardware [None req-b9c9119a-d4f4-4884-83ee-893254529e1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 16:23:33 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-b9c9119a-d4f4-4884-83ee-893254529e1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:23:33 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-b9c9119a-d4f4-4884-83ee-893254529e1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:23:33 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-b9c9119a-d4f4-4884-83ee-893254529e1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:23:33 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-b9c9119a-d4f4-4884-83ee-893254529e1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:23:33 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-b9c9119a-d4f4-4884-83ee-893254529e1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:23:33 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-b9c9119a-d4f4-4884-83ee-893254529e1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:23:33 user devstack@n-api.service[62053]: DEBUG nova.quota [None req-b9c9119a-d4f4-4884-83ee-893254529e1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Getting quotas for project 5ded8a69b7e941f9bcdc502cfeed79db. Resources: {'instances', 'cores', 'ram'} {{(pid=62053) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 16:23:33 user devstack@n-api.service[62053]: DEBUG nova.quota [None req-b9c9119a-d4f4-4884-83ee-893254529e1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Getting quotas for user 62cf399757f544649fed18ee5a31d50c and project 5ded8a69b7e941f9bcdc502cfeed79db. Resources: {'instances', 'cores', 'ram'} {{(pid=62053) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 16:23:33 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-b9c9119a-d4f4-4884-83ee-893254529e1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Going to run 1 instances... {{(pid=62053) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 16:23:33 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-b9c9119a-d4f4-4884-83ee-893254529e1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] [instance: 94a2b8c9-388d-454c-88a1-54d7a8506511] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='708622a9-7465-4492-ade8-b827198f7e30',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=62053) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 16:23:33 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-b9c9119a-d4f4-4884-83ee-893254529e1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.646110 Apr 13 16:23:33 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 85/262] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 16:23:32 2023] POST /compute/v2.1/servers => generated 378 bytes in 650 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 16:23:33 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-a95c8b5b-9292-406a-be82-0f2d9b59f13c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:23:33 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-a95c8b5b-9292-406a-be82-0f2d9b59f13c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] [instance: 94a2b8c9-388d-454c-88a1-54d7a8506511] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:23:33 user devstack@n-api.service[62054]: DEBUG nova.policy [None req-a95c8b5b-9292-406a-be82-0f2d9b59f13c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cf399757f544649fed18ee5a31d50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ded8a69b7e941f9bcdc502cfeed79db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62054) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:23:33 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-a95c8b5b-9292-406a-be82-0f2d9b59f13c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] 10.0.0.210 "GET /compute/v2.1/servers/94a2b8c9-388d-454c-88a1-54d7a8506511" status: 200 len: 1212 microversion: 2.1 time: 0.144248 Apr 13 16:23:33 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 90/263] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:23:33 2023] GET /compute/v2.1/servers/94a2b8c9-388d-454c-88a1-54d7a8506511 => generated 1212 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:23:34 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [req-2168ef01-0997-424c-9465-d55dea4f93e7 req-5821bfec-7c2b-4343-86aa-0dbf34121007 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2549ba85-4e0a-420e-b711-07cafa8c60e9", "name": "network-vif-deleted", "tag": "38e92b7c-b7c1-4137-a1db-21bc1d24f3ee"}]} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:23:34 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-2168ef01-0997-424c-9465-d55dea4f93e7 req-5821bfec-7c2b-4343-86aa-0dbf34121007 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:23:34 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-2168ef01-0997-424c-9465-d55dea4f93e7 req-5821bfec-7c2b-4343-86aa-0dbf34121007 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:23:34 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-2168ef01-0997-424c-9465-d55dea4f93e7 req-5821bfec-7c2b-4343-86aa-0dbf34121007 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:23:34 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-2168ef01-0997-424c-9465-d55dea4f93e7 req-5821bfec-7c2b-4343-86aa-0dbf34121007 service nova] Creating event network-vif-deleted:38e92b7c-b7c1-4137-a1db-21bc1d24f3ee for instance 2549ba85-4e0a-420e-b711-07cafa8c60e9 on user Apr 13 16:23:34 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [req-2168ef01-0997-424c-9465-d55dea4f93e7 req-5821bfec-7c2b-4343-86aa-0dbf34121007 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041652 Apr 13 16:23:34 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 89/264] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:23:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:23:34 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-fc33f3be-9d20-46ad-90f9-8873b05de0c6 req-f6499974-171f-4633-912e-619208aaff0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "235f827c-7116-48e9-84c5-0c9761c18e1e", "name": "network-vif-plugged", "status": "completed", "tag": "b72a6c8b-7244-41c2-a4f7-6da43b4944b8"}, {"name": "network-changed", "server_uuid": "bf350da4-9cc2-4900-adf0-506e44984b42", "tag": "1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:23:34 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-fc33f3be-9d20-46ad-90f9-8873b05de0c6 req-f6499974-171f-4633-912e-619208aaff0e service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:23:34 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-fc33f3be-9d20-46ad-90f9-8873b05de0c6 req-f6499974-171f-4633-912e-619208aaff0e service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:23:34 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-fc33f3be-9d20-46ad-90f9-8873b05de0c6 req-f6499974-171f-4633-912e-619208aaff0e service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:23:34 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-fc33f3be-9d20-46ad-90f9-8873b05de0c6 req-f6499974-171f-4633-912e-619208aaff0e service nova] Creating event network-vif-plugged:b72a6c8b-7244-41c2-a4f7-6da43b4944b8 for instance 235f827c-7116-48e9-84c5-0c9761c18e1e on user Apr 13 16:23:34 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-fc33f3be-9d20-46ad-90f9-8873b05de0c6 req-f6499974-171f-4633-912e-619208aaff0e service nova] Creating event network-changed:1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8 for instance bf350da4-9cc2-4900-adf0-506e44984b42 on user Apr 13 16:23:34 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [req-fc33f3be-9d20-46ad-90f9-8873b05de0c6 req-f6499974-171f-4633-912e-619208aaff0e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.061913 Apr 13 16:23:34 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 86/265] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:23:34 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 16:23:38 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-cc9d6026-09d8-47ba-9c7f-d0f9ab1144f7 req-6ca0d72f-2659-42c1-bd8a-19b461f2183f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94a2b8c9-388d-454c-88a1-54d7a8506511", "tag": "8731e8dd-3e93-4fa1-b8e6-f1d2d10271f7"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:23:38 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-cc9d6026-09d8-47ba-9c7f-d0f9ab1144f7 req-6ca0d72f-2659-42c1-bd8a-19b461f2183f service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:23:38 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-cc9d6026-09d8-47ba-9c7f-d0f9ab1144f7 req-6ca0d72f-2659-42c1-bd8a-19b461f2183f service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:23:38 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-cc9d6026-09d8-47ba-9c7f-d0f9ab1144f7 req-6ca0d72f-2659-42c1-bd8a-19b461f2183f service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:23:38 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-cc9d6026-09d8-47ba-9c7f-d0f9ab1144f7 req-6ca0d72f-2659-42c1-bd8a-19b461f2183f service nova] Creating event network-changed:8731e8dd-3e93-4fa1-b8e6-f1d2d10271f7 for instance 94a2b8c9-388d-454c-88a1-54d7a8506511 on user Apr 13 16:23:38 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [req-cc9d6026-09d8-47ba-9c7f-d0f9ab1144f7 req-6ca0d72f-2659-42c1-bd8a-19b461f2183f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038244 Apr 13 16:23:38 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 91/266] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:23:38 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:23:38 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-8038333d-9ac8-4762-9e2b-df5238cd6fae tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Action: 'create', calling method: .version_select at 0x7f96e4aa1870>, body: {"keypair": {"name": "tempest-keypair-1700037342", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPaDda4gTmMbkxKfok8i4i1XcNLza5lOVYjCPDEGVTF1JRQKderq80DnIN4GAkaZiBV5U44gvdu3wadL/M5wOH7VDSuEghHchow1mC9TB1xgdo8GoXeM279SVAyu08uhIQ=="}} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:23:38 user devstack@n-api.service[62055]: DEBUG nova.quota [None req-8038333d-9ac8-4762-9e2b-df5238cd6fae tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Getting quotas for project 980559734a504574a83224deb7423c77. Resources: {'key_pairs'} {{(pid=62055) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 16:23:38 user devstack@n-api.service[62055]: DEBUG nova.quota [None req-8038333d-9ac8-4762-9e2b-df5238cd6fae tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Getting quotas for user 1b3df1c5c5d441819bcef89ed6966815 and project 980559734a504574a83224deb7423c77. Resources: {'key_pairs'} {{(pid=62055) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 16:23:38 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-8038333d-9ac8-4762-9e2b-df5238cd6fae tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.151437 Apr 13 16:23:38 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 90/267] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 13 16:23:38 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:23:40 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-63ec20c0-7393-4d94-bcf5-b279d4a6efef req-0e42ae80-92ca-4e2e-b04a-532ba148748a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94a2b8c9-388d-454c-88a1-54d7a8506511", "name": "network-vif-plugged", "status": "completed", "tag": "8731e8dd-3e93-4fa1-b8e6-f1d2d10271f7"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:23:40 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-63ec20c0-7393-4d94-bcf5-b279d4a6efef req-0e42ae80-92ca-4e2e-b04a-532ba148748a service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:23:40 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-63ec20c0-7393-4d94-bcf5-b279d4a6efef req-0e42ae80-92ca-4e2e-b04a-532ba148748a service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:23:40 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-63ec20c0-7393-4d94-bcf5-b279d4a6efef req-0e42ae80-92ca-4e2e-b04a-532ba148748a service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:23:40 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-bfaa0693-007d-4127-9d17-282e2b179fff tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1986504733", "imageRef": "708622a9-7465-4492-ade8-b827198f7e30", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "cf1fef97-9ef1-449f-a302-b38110024547"}], "security_groups": [{"name": "tempest-securitygroup--1787105472"}], "key_name": "tempest-keypair-1700037342", "user_data": "}} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:23:40 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-63ec20c0-7393-4d94-bcf5-b279d4a6efef req-0e42ae80-92ca-4e2e-b04a-532ba148748a service nova] Creating event network-vif-plugged:8731e8dd-3e93-4fa1-b8e6-f1d2d10271f7 for instance 94a2b8c9-388d-454c-88a1-54d7a8506511 on user Apr 13 16:23:40 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [req-63ec20c0-7393-4d94-bcf5-b279d4a6efef req-0e42ae80-92ca-4e2e-b04a-532ba148748a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043890 Apr 13 16:23:40 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 87/268] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:23:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:23:40 user devstack@n-api.service[62054]: DEBUG nova.network.neutron [None req-bfaa0693-007d-4127-9d17-282e2b179fff tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] validate_networks() for [('cf1fef97-9ef1-449f-a302-b38110024547', None, None, None, None, None)] {{(pid=62054) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 16:23:41 user devstack@n-api.service[62054]: DEBUG nova.virt.hardware [None req-bfaa0693-007d-4127-9d17-282e2b179fff tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Flavor limits 0:0:0 {{(pid=62054) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 16:23:41 user devstack@n-api.service[62054]: DEBUG nova.virt.hardware [None req-bfaa0693-007d-4127-9d17-282e2b179fff tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Image limits 0:0:0 {{(pid=62054) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 16:23:41 user devstack@n-api.service[62054]: DEBUG nova.virt.hardware [None req-bfaa0693-007d-4127-9d17-282e2b179fff tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Flavor pref 0:0:0 {{(pid=62054) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 16:23:41 user devstack@n-api.service[62054]: DEBUG nova.virt.hardware [None req-bfaa0693-007d-4127-9d17-282e2b179fff tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Image pref 0:0:0 {{(pid=62054) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 16:23:41 user devstack@n-api.service[62054]: DEBUG nova.virt.hardware [None req-bfaa0693-007d-4127-9d17-282e2b179fff tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62054) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 16:23:41 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-bfaa0693-007d-4127-9d17-282e2b179fff tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:23:41 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-bfaa0693-007d-4127-9d17-282e2b179fff tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:23:41 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-bfaa0693-007d-4127-9d17-282e2b179fff tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:23:41 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-bfaa0693-007d-4127-9d17-282e2b179fff tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:23:41 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-bfaa0693-007d-4127-9d17-282e2b179fff tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:23:41 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-bfaa0693-007d-4127-9d17-282e2b179fff tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:23:41 user devstack@n-api.service[62054]: DEBUG nova.quota [None req-bfaa0693-007d-4127-9d17-282e2b179fff tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Getting quotas for project 980559734a504574a83224deb7423c77. Resources: {'instances', 'cores', 'ram'} {{(pid=62054) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 16:23:41 user devstack@n-api.service[62054]: DEBUG nova.quota [None req-bfaa0693-007d-4127-9d17-282e2b179fff tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Getting quotas for user 1b3df1c5c5d441819bcef89ed6966815 and project 980559734a504574a83224deb7423c77. Resources: {'instances', 'cores', 'ram'} {{(pid=62054) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 16:23:41 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-bfaa0693-007d-4127-9d17-282e2b179fff tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Going to run 1 instances... {{(pid=62054) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 16:23:41 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-bfaa0693-007d-4127-9d17-282e2b179fff tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='708622a9-7465-4492-ade8-b827198f7e30',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=62054) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 16:23:41 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-bfaa0693-007d-4127-9d17-282e2b179fff tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.148268 Apr 13 16:23:41 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 92/269] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 16:23:40 2023] POST /compute/v2.1/servers => generated 407 bytes in 1150 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 16:23:41 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-14fbe4af-52ad-4e2e-a579-e7ea7c09c9cb tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:23:41 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-14fbe4af-52ad-4e2e-a579-e7ea7c09c9cb tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:23:41 user devstack@n-api.service[62055]: DEBUG nova.policy [None req-14fbe4af-52ad-4e2e-a579-e7ea7c09c9cb tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b3df1c5c5d441819bcef89ed6966815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980559734a504574a83224deb7423c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62055) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:23:41 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-14fbe4af-52ad-4e2e-a579-e7ea7c09c9cb tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] 10.0.0.210 "GET /compute/v2.1/servers/acbcaee0-a47b-4fee-8765-9b1c9597d515" status: 200 len: 1233 microversion: 2.1 time: 0.066579 Apr 13 16:23:41 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 91/270] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:23:41 2023] GET /compute/v2.1/servers/acbcaee0-a47b-4fee-8765-9b1c9597d515 => generated 1233 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:23:42 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-e3f57d28-2df9-4b5e-9f3f-67cd152337df req-1b8f1f86-9e60-412c-bf6d-ea2a6706733f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94a2b8c9-388d-454c-88a1-54d7a8506511", "name": "network-vif-plugged", "status": "completed", "tag": "8731e8dd-3e93-4fa1-b8e6-f1d2d10271f7"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:23:42 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-e3f57d28-2df9-4b5e-9f3f-67cd152337df req-1b8f1f86-9e60-412c-bf6d-ea2a6706733f service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:23:42 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-e3f57d28-2df9-4b5e-9f3f-67cd152337df req-1b8f1f86-9e60-412c-bf6d-ea2a6706733f service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:23:42 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-e3f57d28-2df9-4b5e-9f3f-67cd152337df req-1b8f1f86-9e60-412c-bf6d-ea2a6706733f service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:23:42 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-e3f57d28-2df9-4b5e-9f3f-67cd152337df req-1b8f1f86-9e60-412c-bf6d-ea2a6706733f service nova] Creating event network-vif-plugged:8731e8dd-3e93-4fa1-b8e6-f1d2d10271f7 for instance 94a2b8c9-388d-454c-88a1-54d7a8506511 on user Apr 13 16:23:42 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [req-e3f57d28-2df9-4b5e-9f3f-67cd152337df req-1b8f1f86-9e60-412c-bf6d-ea2a6706733f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034521 Apr 13 16:23:42 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 88/271] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:23:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:23:44 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-109eff67-fe88-4e2d-8915-37b6aed2aaa6 req-cd3f6141-fec1-472b-83ed-6a6ee32365c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "acbcaee0-a47b-4fee-8765-9b1c9597d515", "tag": "13471516-9514-4b85-938f-69657c2990e5"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:23:44 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-109eff67-fe88-4e2d-8915-37b6aed2aaa6 req-cd3f6141-fec1-472b-83ed-6a6ee32365c8 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:23:44 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-109eff67-fe88-4e2d-8915-37b6aed2aaa6 req-cd3f6141-fec1-472b-83ed-6a6ee32365c8 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:23:44 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-109eff67-fe88-4e2d-8915-37b6aed2aaa6 req-cd3f6141-fec1-472b-83ed-6a6ee32365c8 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:23:44 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-109eff67-fe88-4e2d-8915-37b6aed2aaa6 req-cd3f6141-fec1-472b-83ed-6a6ee32365c8 service nova] Creating event network-changed:13471516-9514-4b85-938f-69657c2990e5 for instance acbcaee0-a47b-4fee-8765-9b1c9597d515 on user Apr 13 16:23:44 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [req-109eff67-fe88-4e2d-8915-37b6aed2aaa6 req-cd3f6141-fec1-472b-83ed-6a6ee32365c8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036957 Apr 13 16:23:44 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 93/272] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:23:44 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:23:46 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [req-e190830c-dbf2-4d2d-8e44-8d9cb32ac6de req-ab131f61-dee7-4b37-a475-68337103b350 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acbcaee0-a47b-4fee-8765-9b1c9597d515", "name": "network-vif-plugged", "status": "completed", "tag": "13471516-9514-4b85-938f-69657c2990e5"}]} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:23:46 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:23:46 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:23:46 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-e190830c-dbf2-4d2d-8e44-8d9cb32ac6de req-ab131f61-dee7-4b37-a475-68337103b350 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:23:46 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-e190830c-dbf2-4d2d-8e44-8d9cb32ac6de req-ab131f61-dee7-4b37-a475-68337103b350 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:23:46 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-e190830c-dbf2-4d2d-8e44-8d9cb32ac6de req-ab131f61-dee7-4b37-a475-68337103b350 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:23:46 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-e190830c-dbf2-4d2d-8e44-8d9cb32ac6de req-ab131f61-dee7-4b37-a475-68337103b350 service nova] Creating event network-vif-plugged:13471516-9514-4b85-938f-69657c2990e5 for instance acbcaee0-a47b-4fee-8765-9b1c9597d515 on user Apr 13 16:23:46 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [req-e190830c-dbf2-4d2d-8e44-8d9cb32ac6de req-ab131f61-dee7-4b37-a475-68337103b350 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040142 Apr 13 16:23:46 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 92/273] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:23:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 16:23:47 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_cell0:SELECT=2 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:23:47 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_cell0:SELECT=6 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:23:47 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-a05bd84b-ad12-4778-8b8a-a4430f7c9fca tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:23:47 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-a05bd84b-ad12-4778-8b8a-a4430f7c9fca tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] [instance: 031c7939-a53c-4f7d-9f36-4ec1d06e2717] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:23:47 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-a05bd84b-ad12-4778-8b8a-a4430f7c9fca tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:23:47 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-a05bd84b-ad12-4778-8b8a-a4430f7c9fca tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:23:47 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-a05bd84b-ad12-4778-8b8a-a4430f7c9fca tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:23:47 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-a05bd84b-ad12-4778-8b8a-a4430f7c9fca tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:23:47 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-a05bd84b-ad12-4778-8b8a-a4430f7c9fca tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:23:47 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-a05bd84b-ad12-4778-8b8a-a4430f7c9fca tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:23:47 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_cell1:SELECT=49,nova_cell1:INSERT=1 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:23:47 user devstack@n-api.service[62053]: DEBUG nova.objects.instance [None req-a05bd84b-ad12-4778-8b8a-a4430f7c9fca tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Lazy-loading 'services' on Instance uuid 031c7939-a53c-4f7d-9f36-4ec1d06e2717 {{(pid=62053) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 16:23:47 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-a05bd84b-ad12-4778-8b8a-a4430f7c9fca tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/031c7939-a53c-4f7d-9f36-4ec1d06e2717/os-volume_attachments/e962a4d5-41c9-4b3b-b78e-c25e451aa73f" status: 202 len: 0 microversion: 2.1 time: 0.218178 Apr 13 16:23:47 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 89/274] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 16:23:47 2023] DELETE /compute/v2.1/servers/031c7939-a53c-4f7d-9f36-4ec1d06e2717/os-volume_attachments/e962a4d5-41c9-4b3b-b78e-c25e451aa73f => generated 0 bytes in 220 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 16:23:47 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-d59a75f8-29c4-46fc-ab0e-5e914b270376 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:23:47 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-d59a75f8-29c4-46fc-ab0e-5e914b270376 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] [instance: 031c7939-a53c-4f7d-9f36-4ec1d06e2717] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:23:47 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:23:47 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-d59a75f8-29c4-46fc-ab0e-5e914b270376 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:23:47 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-d59a75f8-29c4-46fc-ab0e-5e914b270376 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:23:47 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-d59a75f8-29c4-46fc-ab0e-5e914b270376 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:23:47 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-d59a75f8-29c4-46fc-ab0e-5e914b270376 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:23:47 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-d59a75f8-29c4-46fc-ab0e-5e914b270376 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:23:47 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-d59a75f8-29c4-46fc-ab0e-5e914b270376 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:23:47 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:23:47 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-d59a75f8-29c4-46fc-ab0e-5e914b270376 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] [instance: 031c7939-a53c-4f7d-9f36-4ec1d06e2717] Going to try to terminate instance {{(pid=62054) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 16:23:47 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-d59a75f8-29c4-46fc-ab0e-5e914b270376 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/031c7939-a53c-4f7d-9f36-4ec1d06e2717" status: 204 len: 0 microversion: 2.1 time: 0.140665 Apr 13 16:23:47 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 94/275] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 16:23:47 2023] DELETE /compute/v2.1/servers/031c7939-a53c-4f7d-9f36-4ec1d06e2717 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 16:23:47 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-bf07e4e4-025e-4a65-a56a-688b11002caf tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:23:47 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-bf07e4e4-025e-4a65-a56a-688b11002caf tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] [instance: 031c7939-a53c-4f7d-9f36-4ec1d06e2717] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:23:47 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-bf07e4e4-025e-4a65-a56a-688b11002caf tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:23:47 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-bf07e4e4-025e-4a65-a56a-688b11002caf tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:23:47 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-bf07e4e4-025e-4a65-a56a-688b11002caf tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:23:47 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-bf07e4e4-025e-4a65-a56a-688b11002caf tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:23:47 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-bf07e4e4-025e-4a65-a56a-688b11002caf tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:23:47 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-bf07e4e4-025e-4a65-a56a-688b11002caf tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:23:48 user devstack@n-api.service[62055]: DEBUG nova.policy [None req-bf07e4e4-025e-4a65-a56a-688b11002caf tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9223a3efe4bc4e37946c8ed718100de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7395d2408a44cc88cf88eb49d5f8503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62055) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:23:48 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-bf07e4e4-025e-4a65-a56a-688b11002caf tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] 10.0.0.210 "GET /compute/v2.1/servers/031c7939-a53c-4f7d-9f36-4ec1d06e2717" status: 200 len: 1547 microversion: 2.1 time: 0.159559 Apr 13 16:23:48 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 93/276] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:23:47 2023] GET /compute/v2.1/servers/031c7939-a53c-4f7d-9f36-4ec1d06e2717 => generated 1547 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:23:48 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-30e13363-319e-4435-a7c0-7bf7cad23b5e tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:23:48 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-30e13363-319e-4435-a7c0-7bf7cad23b5e tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] [instance: cf54be22-2a5d-40c4-8a1a-0060c77f83f6] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:23:48 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-30e13363-319e-4435-a7c0-7bf7cad23b5e tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:23:48 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-30e13363-319e-4435-a7c0-7bf7cad23b5e tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:23:48 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-30e13363-319e-4435-a7c0-7bf7cad23b5e tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:23:48 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-30e13363-319e-4435-a7c0-7bf7cad23b5e tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:23:48 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-30e13363-319e-4435-a7c0-7bf7cad23b5e tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:23:48 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-30e13363-319e-4435-a7c0-7bf7cad23b5e tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:23:48 user devstack@n-api.service[62053]: INFO nova.api.openstack.wsgi [None req-30e13363-319e-4435-a7c0-7bf7cad23b5e tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] HTTP exception thrown: Instance cf54be22-2a5d-40c4-8a1a-0060c77f83f6 could not be found. Apr 13 16:23:48 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-30e13363-319e-4435-a7c0-7bf7cad23b5e tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Request method failure captured: Apr 13 16:23:48 user devstack@n-api.service[62053]: request: GET /compute/v2.1/servers/cf54be22-2a5d-40c4-8a1a-0060c77f83f6 HTTP/1.1 Apr 13 16:23:48 user devstack@n-api.service[62053]: Accept: application/json Apr 13 16:23:48 user devstack@n-api.service[62053]: Accept-Encoding: identity Apr 13 16:23:48 user devstack@n-api.service[62053]: Connection: close Apr 13 16:23:48 user devstack@n-api.service[62053]: Content-Length: 0 Apr 13 16:23:48 user devstack@n-api.service[62053]: Content-Type: application/json Apr 13 16:23:48 user devstack@n-api.service[62053]: Host: 10.0.0.210 Apr 13 16:23:48 user devstack@n-api.service[62053]: Openstack-System-Scope: None Apr 13 16:23:48 user devstack@n-api.service[62053]: User-Agent: python-urllib3/1.26.15 Apr 13 16:23:48 user devstack@n-api.service[62053]: X-Auth-Token: gAAAAABkOCvHU7WVCbYmnOnjY1urTXncKay7I6gMfZfbXC5AktBgKzsyLNf4L2ld53NHYnCVy9mujl5M7j7PJLUmxFCcHOypxo6IWN3SVAP_W3UKcTg5GPRGncqYFEHBrNjmyQ0lzmVZHFUVvzqlyxZSjrsdY6-kcl7pR0TQ0XxdPQbuwRiUAII Apr 13 16:23:48 user devstack@n-api.service[62053]: X-Domain-Id: None Apr 13 16:23:48 user devstack@n-api.service[62053]: X-Domain-Name: None Apr 13 16:23:48 user devstack@n-api.service[62053]: X-Identity-Status: Confirmed Apr 13 16:23:48 user devstack@n-api.service[62053]: X-Is-Admin-Project: True Apr 13 16:23:48 user devstack@n-api.service[62053]: X-Project-Domain-Id: default Apr 13 16:23:48 user devstack@n-api.service[62053]: X-Project-Domain-Name: Default Apr 13 16:23:48 user devstack@n-api.service[62053]: X-Project-Id: a6365a1e8d6c48499d4b8921244d92a9 Apr 13 16:23:48 user devstack@n-api.service[62053]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-942770243 Apr 13 16:23:48 user devstack@n-api.service[62053]: X-Role: reader,member Apr 13 16:23:48 user devstack@n-api.service[62053]: X-Roles: reader,member Apr 13 16:23:48 user devstack@n-api.service[62053]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a6365a1e8d6c48499d4b8921244d92a9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a6365a1e8d6c48499d4b8921244d92a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a6365a1e8d6c48499d4b8921244d92a9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 13 16:23:48 user devstack@n-api.service[62053]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-942770243 Apr 13 16:23:48 user devstack@n-api.service[62053]: X-Tenant-Id: a6365a1e8d6c48499d4b8921244d92a9 Apr 13 16:23:48 user devstack@n-api.service[62053]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-942770243 Apr 13 16:23:48 user devstack@n-api.service[62053]: X-User: tempest-AttachSCSIVolumeTestJSON-942770243-project-member Apr 13 16:23:48 user devstack@n-api.service[62053]: X-User-Domain-Id: default Apr 13 16:23:48 user devstack@n-api.service[62053]: X-User-Domain-Name: Default Apr 13 16:23:48 user devstack@n-api.service[62053]: X-User-Id: 0b143a8db8a3410eb09b21ced7bd883e Apr 13 16:23:48 user devstack@n-api.service[62053]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-942770243-project-member Apr 13 16:23:48 user devstack@n-api.service[62053]: method: > Apr 13 16:23:48 user devstack@n-api.service[62053]: exception: Instance cf54be22-2a5d-40c4-8a1a-0060c77f83f6 could not be found. Apr 13 16:23:48 user devstack@n-api.service[62053]: action_args: {'id': 'cf54be22-2a5d-40c4-8a1a-0060c77f83f6'} Apr 13 16:23:48 user devstack@n-api.service[62053]: {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 16:23:48 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:23:48 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 16:23:48 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 16:23:48 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 16:23:48 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 16:23:48 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 16:23:48 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 16:23:48 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 16:23:48 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 16:23:48 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf54be22-2a5d-40c4-8a1a-0060c77f83f6 could not be found. Apr 13 16:23:48 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:23:48 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:23:48 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:23:48 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:23:48 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 16:23:48 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 16:23:48 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 16:23:48 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 16:23:48 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 16:23:48 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 16:23:48 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 16:23:48 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 16:23:48 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 16:23:48 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 16:23:48 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 16:23:48 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 16:23:48 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf54be22-2a5d-40c4-8a1a-0060c77f83f6 could not be found. Apr 13 16:23:48 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:23:48 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:23:48 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:23:48 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:23:48 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 16:23:48 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 16:23:48 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 16:23:48 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 16:23:48 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf54be22-2a5d-40c4-8a1a-0060c77f83f6 could not be found. Apr 13 16:23:48 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:23:48 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-30e13363-319e-4435-a7c0-7bf7cad23b5e tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Returning 404 to user: Instance cf54be22-2a5d-40c4-8a1a-0060c77f83f6 could not be found. {{(pid=62053) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 16:23:48 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-30e13363-319e-4435-a7c0-7bf7cad23b5e tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cf54be22-2a5d-40c4-8a1a-0060c77f83f6" status: 404 len: 111 microversion: 2.1 time: 0.027983 Apr 13 16:23:48 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 90/277] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:23:48 2023] GET /compute/v2.1/servers/cf54be22-2a5d-40c4-8a1a-0060c77f83f6 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 16:23:48 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-8e062017-2c7d-4ed7-aa27-583326e8e9d2 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Calling method '.version_select at 0x7f96e4ab6d40>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:23:48 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-8e062017-2c7d-4ed7-aa27-583326e8e9d2 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-420366585" status: 202 len: 0 microversion: 2.1 time: 0.026058 Apr 13 16:23:48 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 95/278] 10.0.0.210 () {62 vars in 1295 bytes} [Thu Apr 13 16:23:48 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-420366585 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 16:23:48 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [req-bac8d8c4-52ab-4c7d-bbc0-d06661111c62 req-22dccc2e-6fc6-4241-8c4b-92b380329a49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acbcaee0-a47b-4fee-8765-9b1c9597d515", "name": "network-vif-plugged", "status": "completed", "tag": "13471516-9514-4b85-938f-69657c2990e5"}]} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:23:48 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-bac8d8c4-52ab-4c7d-bbc0-d06661111c62 req-22dccc2e-6fc6-4241-8c4b-92b380329a49 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:23:48 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-bac8d8c4-52ab-4c7d-bbc0-d06661111c62 req-22dccc2e-6fc6-4241-8c4b-92b380329a49 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:23:48 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-bac8d8c4-52ab-4c7d-bbc0-d06661111c62 req-22dccc2e-6fc6-4241-8c4b-92b380329a49 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:23:48 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-bac8d8c4-52ab-4c7d-bbc0-d06661111c62 req-22dccc2e-6fc6-4241-8c4b-92b380329a49 service nova] Creating event network-vif-plugged:13471516-9514-4b85-938f-69657c2990e5 for instance acbcaee0-a47b-4fee-8765-9b1c9597d515 on user Apr 13 16:23:48 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [req-bac8d8c4-52ab-4c7d-bbc0-d06661111c62 req-22dccc2e-6fc6-4241-8c4b-92b380329a49 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057883 Apr 13 16:23:48 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 94/279] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:23:48 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:23:49 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-99e27b20-acc7-4597-aece-f0a2eebcd137 req-a65d281b-f8de-4681-a21a-93bc3a307b81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "031c7939-a53c-4f7d-9f36-4ec1d06e2717", "name": "network-vif-unplugged", "status": "completed", "tag": "a99b01f1-3495-45d6-a802-a1f740719c17"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:23:49 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-99e27b20-acc7-4597-aece-f0a2eebcd137 req-a65d281b-f8de-4681-a21a-93bc3a307b81 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:23:49 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-99e27b20-acc7-4597-aece-f0a2eebcd137 req-a65d281b-f8de-4681-a21a-93bc3a307b81 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:23:49 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-99e27b20-acc7-4597-aece-f0a2eebcd137 req-a65d281b-f8de-4681-a21a-93bc3a307b81 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:23:49 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-99e27b20-acc7-4597-aece-f0a2eebcd137 req-a65d281b-f8de-4681-a21a-93bc3a307b81 service nova] Creating event network-vif-unplugged:a99b01f1-3495-45d6-a802-a1f740719c17 for instance 031c7939-a53c-4f7d-9f36-4ec1d06e2717 on user Apr 13 16:23:49 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [req-99e27b20-acc7-4597-aece-f0a2eebcd137 req-a65d281b-f8de-4681-a21a-93bc3a307b81 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039553 Apr 13 16:23:49 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 91/280] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:23:49 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 16:23:51 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-e5822ccb-a590-4751-ac60-1947dfe1bf4c req-226cfa5a-c720-4a5e-b05c-a8079149a643 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "031c7939-a53c-4f7d-9f36-4ec1d06e2717", "name": "network-vif-deleted", "tag": "a99b01f1-3495-45d6-a802-a1f740719c17"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:23:51 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-e5822ccb-a590-4751-ac60-1947dfe1bf4c req-226cfa5a-c720-4a5e-b05c-a8079149a643 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:23:51 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-e5822ccb-a590-4751-ac60-1947dfe1bf4c req-226cfa5a-c720-4a5e-b05c-a8079149a643 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:23:51 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-e5822ccb-a590-4751-ac60-1947dfe1bf4c req-226cfa5a-c720-4a5e-b05c-a8079149a643 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:23:51 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-e5822ccb-a590-4751-ac60-1947dfe1bf4c req-226cfa5a-c720-4a5e-b05c-a8079149a643 service nova] Creating event network-vif-deleted:a99b01f1-3495-45d6-a802-a1f740719c17 for instance 031c7939-a53c-4f7d-9f36-4ec1d06e2717 on user Apr 13 16:23:51 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [req-e5822ccb-a590-4751-ac60-1947dfe1bf4c req-226cfa5a-c720-4a5e-b05c-a8079149a643 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038117 Apr 13 16:23:51 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 96/281] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:23:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:23:51 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_cell0:SELECT=6 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:23:51 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [req-4fe3a936-3d1b-43a9-a2f5-c5ce3df6f976 req-0551f01d-8c82-4d59-bac6-64de4ffc096c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "031c7939-a53c-4f7d-9f36-4ec1d06e2717", "name": "network-vif-plugged", "status": "completed", "tag": "a99b01f1-3495-45d6-a802-a1f740719c17"}, {"server_uuid": "031c7939-a53c-4f7d-9f36-4ec1d06e2717", "name": "network-vif-plugged", "status": "completed", "tag": "a99b01f1-3495-45d6-a802-a1f740719c17"}, {"server_uuid": "031c7939-a53c-4f7d-9f36-4ec1d06e2717", "name": "network-vif-plugged", "status": "completed", "tag": "a99b01f1-3495-45d6-a802-a1f740719c17"}, {"server_uuid": "031c7939-a53c-4f7d-9f36-4ec1d06e2717", "name": "network-vif-unplugged", "status": "completed", "tag": "a99b01f1-3495-45d6-a802-a1f740719c17"}, {"server_uuid": "031c7939-a53c-4f7d-9f36-4ec1d06e2717", "name": "network-vif-plugged", "status": "completed", "tag": "a99b01f1-3495-45d6-a802-a1f740719c17"}]} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:23:51 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-4fe3a936-3d1b-43a9-a2f5-c5ce3df6f976 req-0551f01d-8c82-4d59-bac6-64de4ffc096c service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:23:51 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-4fe3a936-3d1b-43a9-a2f5-c5ce3df6f976 req-0551f01d-8c82-4d59-bac6-64de4ffc096c service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:23:51 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-4fe3a936-3d1b-43a9-a2f5-c5ce3df6f976 req-0551f01d-8c82-4d59-bac6-64de4ffc096c service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:23:51 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-4fe3a936-3d1b-43a9-a2f5-c5ce3df6f976 req-0551f01d-8c82-4d59-bac6-64de4ffc096c service nova] Creating event network-vif-plugged:a99b01f1-3495-45d6-a802-a1f740719c17 for instance 031c7939-a53c-4f7d-9f36-4ec1d06e2717 on user Apr 13 16:23:51 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-4fe3a936-3d1b-43a9-a2f5-c5ce3df6f976 req-0551f01d-8c82-4d59-bac6-64de4ffc096c service nova] Creating event network-vif-plugged:a99b01f1-3495-45d6-a802-a1f740719c17 for instance 031c7939-a53c-4f7d-9f36-4ec1d06e2717 on user Apr 13 16:23:51 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-4fe3a936-3d1b-43a9-a2f5-c5ce3df6f976 req-0551f01d-8c82-4d59-bac6-64de4ffc096c service nova] Creating event network-vif-plugged:a99b01f1-3495-45d6-a802-a1f740719c17 for instance 031c7939-a53c-4f7d-9f36-4ec1d06e2717 on user Apr 13 16:23:51 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-4fe3a936-3d1b-43a9-a2f5-c5ce3df6f976 req-0551f01d-8c82-4d59-bac6-64de4ffc096c service nova] Creating event network-vif-unplugged:a99b01f1-3495-45d6-a802-a1f740719c17 for instance 031c7939-a53c-4f7d-9f36-4ec1d06e2717 on user Apr 13 16:23:51 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-4fe3a936-3d1b-43a9-a2f5-c5ce3df6f976 req-0551f01d-8c82-4d59-bac6-64de4ffc096c service nova] Creating event network-vif-plugged:a99b01f1-3495-45d6-a802-a1f740719c17 for instance 031c7939-a53c-4f7d-9f36-4ec1d06e2717 on user Apr 13 16:23:51 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [req-4fe3a936-3d1b-43a9-a2f5-c5ce3df6f976 req-0551f01d-8c82-4d59-bac6-64de4ffc096c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.050380 Apr 13 16:23:51 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 95/282] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:23:51 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:23:52 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-6331688b-3feb-4797-a621-ea161efae7a0 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:23:52 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-6331688b-3feb-4797-a621-ea161efae7a0 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] [instance: cf54be22-2a5d-40c4-8a1a-0060c77f83f6] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:23:52 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-6331688b-3feb-4797-a621-ea161efae7a0 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:23:52 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-6331688b-3feb-4797-a621-ea161efae7a0 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:23:52 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-6331688b-3feb-4797-a621-ea161efae7a0 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:23:52 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-6331688b-3feb-4797-a621-ea161efae7a0 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:23:52 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-6331688b-3feb-4797-a621-ea161efae7a0 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:23:52 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-6331688b-3feb-4797-a621-ea161efae7a0 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:23:52 user devstack@n-api.service[62053]: INFO nova.api.openstack.wsgi [None req-6331688b-3feb-4797-a621-ea161efae7a0 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] HTTP exception thrown: Instance cf54be22-2a5d-40c4-8a1a-0060c77f83f6 could not be found. Apr 13 16:23:52 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-6331688b-3feb-4797-a621-ea161efae7a0 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Request method failure captured: Apr 13 16:23:52 user devstack@n-api.service[62053]: request: DELETE /compute/v2.1/servers/cf54be22-2a5d-40c4-8a1a-0060c77f83f6 HTTP/1.1 Apr 13 16:23:52 user devstack@n-api.service[62053]: Accept: application/json Apr 13 16:23:52 user devstack@n-api.service[62053]: Accept-Encoding: identity Apr 13 16:23:52 user devstack@n-api.service[62053]: Connection: close Apr 13 16:23:52 user devstack@n-api.service[62053]: Content-Length: 0 Apr 13 16:23:52 user devstack@n-api.service[62053]: Content-Type: application/json Apr 13 16:23:52 user devstack@n-api.service[62053]: Host: 10.0.0.210 Apr 13 16:23:52 user devstack@n-api.service[62053]: Openstack-System-Scope: None Apr 13 16:23:52 user devstack@n-api.service[62053]: User-Agent: python-urllib3/1.26.15 Apr 13 16:23:52 user devstack@n-api.service[62053]: X-Auth-Token: gAAAAABkOCvHU7WVCbYmnOnjY1urTXncKay7I6gMfZfbXC5AktBgKzsyLNf4L2ld53NHYnCVy9mujl5M7j7PJLUmxFCcHOypxo6IWN3SVAP_W3UKcTg5GPRGncqYFEHBrNjmyQ0lzmVZHFUVvzqlyxZSjrsdY6-kcl7pR0TQ0XxdPQbuwRiUAII Apr 13 16:23:52 user devstack@n-api.service[62053]: X-Domain-Id: None Apr 13 16:23:52 user devstack@n-api.service[62053]: X-Domain-Name: None Apr 13 16:23:52 user devstack@n-api.service[62053]: X-Identity-Status: Confirmed Apr 13 16:23:52 user devstack@n-api.service[62053]: X-Is-Admin-Project: True Apr 13 16:23:52 user devstack@n-api.service[62053]: X-Project-Domain-Id: default Apr 13 16:23:52 user devstack@n-api.service[62053]: X-Project-Domain-Name: Default Apr 13 16:23:52 user devstack@n-api.service[62053]: X-Project-Id: a6365a1e8d6c48499d4b8921244d92a9 Apr 13 16:23:52 user devstack@n-api.service[62053]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-942770243 Apr 13 16:23:52 user devstack@n-api.service[62053]: X-Role: reader,member Apr 13 16:23:52 user devstack@n-api.service[62053]: X-Roles: reader,member Apr 13 16:23:52 user devstack@n-api.service[62053]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a6365a1e8d6c48499d4b8921244d92a9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a6365a1e8d6c48499d4b8921244d92a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a6365a1e8d6c48499d4b8921244d92a9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 13 16:23:52 user devstack@n-api.service[62053]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-942770243 Apr 13 16:23:52 user devstack@n-api.service[62053]: X-Tenant-Id: a6365a1e8d6c48499d4b8921244d92a9 Apr 13 16:23:52 user devstack@n-api.service[62053]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-942770243 Apr 13 16:23:52 user devstack@n-api.service[62053]: X-User: tempest-AttachSCSIVolumeTestJSON-942770243-project-member Apr 13 16:23:52 user devstack@n-api.service[62053]: X-User-Domain-Id: default Apr 13 16:23:52 user devstack@n-api.service[62053]: X-User-Domain-Name: Default Apr 13 16:23:52 user devstack@n-api.service[62053]: X-User-Id: 0b143a8db8a3410eb09b21ced7bd883e Apr 13 16:23:52 user devstack@n-api.service[62053]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-942770243-project-member Apr 13 16:23:52 user devstack@n-api.service[62053]: method: > Apr 13 16:23:52 user devstack@n-api.service[62053]: exception: Instance cf54be22-2a5d-40c4-8a1a-0060c77f83f6 could not be found. Apr 13 16:23:52 user devstack@n-api.service[62053]: action_args: {'id': 'cf54be22-2a5d-40c4-8a1a-0060c77f83f6'} Apr 13 16:23:52 user devstack@n-api.service[62053]: {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 16:23:52 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:23:52 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 16:23:52 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 16:23:52 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 16:23:52 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 16:23:52 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 16:23:52 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 16:23:52 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 16:23:52 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 16:23:52 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf54be22-2a5d-40c4-8a1a-0060c77f83f6 could not be found. Apr 13 16:23:52 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:23:52 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:23:52 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:23:52 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:23:52 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 16:23:52 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 16:23:52 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 16:23:52 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 16:23:52 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 16:23:52 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 16:23:52 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 16:23:52 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 16:23:52 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 16:23:52 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 16:23:52 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 16:23:52 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 16:23:52 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 16:23:52 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 16:23:52 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf54be22-2a5d-40c4-8a1a-0060c77f83f6 could not be found. Apr 13 16:23:52 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:23:52 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:23:52 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:23:52 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:23:52 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 16:23:52 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 16:23:52 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 16:23:52 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 16:23:52 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf54be22-2a5d-40c4-8a1a-0060c77f83f6 could not be found. Apr 13 16:23:52 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:23:52 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-6331688b-3feb-4797-a621-ea161efae7a0 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Returning 404 to user: Instance cf54be22-2a5d-40c4-8a1a-0060c77f83f6 could not be found. {{(pid=62053) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 16:23:52 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-6331688b-3feb-4797-a621-ea161efae7a0 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/cf54be22-2a5d-40c4-8a1a-0060c77f83f6" status: 404 len: 111 microversion: 2.1 time: 0.032723 Apr 13 16:23:52 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 92/283] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 16:23:52 2023] DELETE /compute/v2.1/servers/cf54be22-2a5d-40c4-8a1a-0060c77f83f6 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 16:23:52 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_cell0:SELECT=2 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:23:52 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_cell0:SELECT=8 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:23:52 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-d6ce43b6-27d6-4898-a5e2-8935e64fbd49 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:23:52 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-d6ce43b6-27d6-4898-a5e2-8935e64fbd49 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] [instance: cf54be22-2a5d-40c4-8a1a-0060c77f83f6] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:23:52 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-d6ce43b6-27d6-4898-a5e2-8935e64fbd49 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:23:52 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-d6ce43b6-27d6-4898-a5e2-8935e64fbd49 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:23:52 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-d6ce43b6-27d6-4898-a5e2-8935e64fbd49 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:23:52 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-d6ce43b6-27d6-4898-a5e2-8935e64fbd49 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:23:52 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-d6ce43b6-27d6-4898-a5e2-8935e64fbd49 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:23:52 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-d6ce43b6-27d6-4898-a5e2-8935e64fbd49 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:23:52 user devstack@n-api.service[62054]: INFO nova.api.openstack.wsgi [None req-d6ce43b6-27d6-4898-a5e2-8935e64fbd49 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] HTTP exception thrown: Instance cf54be22-2a5d-40c4-8a1a-0060c77f83f6 could not be found. Apr 13 16:23:52 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-d6ce43b6-27d6-4898-a5e2-8935e64fbd49 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Request method failure captured: Apr 13 16:23:52 user devstack@n-api.service[62054]: request: GET /compute/v2.1/servers/cf54be22-2a5d-40c4-8a1a-0060c77f83f6 HTTP/1.1 Apr 13 16:23:52 user devstack@n-api.service[62054]: Accept: application/json Apr 13 16:23:52 user devstack@n-api.service[62054]: Accept-Encoding: identity Apr 13 16:23:52 user devstack@n-api.service[62054]: Connection: close Apr 13 16:23:52 user devstack@n-api.service[62054]: Content-Length: 0 Apr 13 16:23:52 user devstack@n-api.service[62054]: Content-Type: application/json Apr 13 16:23:52 user devstack@n-api.service[62054]: Host: 10.0.0.210 Apr 13 16:23:52 user devstack@n-api.service[62054]: Openstack-System-Scope: None Apr 13 16:23:52 user devstack@n-api.service[62054]: User-Agent: python-urllib3/1.26.15 Apr 13 16:23:52 user devstack@n-api.service[62054]: X-Auth-Token: gAAAAABkOCvHU7WVCbYmnOnjY1urTXncKay7I6gMfZfbXC5AktBgKzsyLNf4L2ld53NHYnCVy9mujl5M7j7PJLUmxFCcHOypxo6IWN3SVAP_W3UKcTg5GPRGncqYFEHBrNjmyQ0lzmVZHFUVvzqlyxZSjrsdY6-kcl7pR0TQ0XxdPQbuwRiUAII Apr 13 16:23:52 user devstack@n-api.service[62054]: X-Domain-Id: None Apr 13 16:23:52 user devstack@n-api.service[62054]: X-Domain-Name: None Apr 13 16:23:52 user devstack@n-api.service[62054]: X-Identity-Status: Confirmed Apr 13 16:23:52 user devstack@n-api.service[62054]: X-Is-Admin-Project: True Apr 13 16:23:52 user devstack@n-api.service[62054]: X-Project-Domain-Id: default Apr 13 16:23:52 user devstack@n-api.service[62054]: X-Project-Domain-Name: Default Apr 13 16:23:52 user devstack@n-api.service[62054]: X-Project-Id: a6365a1e8d6c48499d4b8921244d92a9 Apr 13 16:23:52 user devstack@n-api.service[62054]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-942770243 Apr 13 16:23:52 user devstack@n-api.service[62054]: X-Role: reader,member Apr 13 16:23:52 user devstack@n-api.service[62054]: X-Roles: reader,member Apr 13 16:23:52 user devstack@n-api.service[62054]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a6365a1e8d6c48499d4b8921244d92a9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a6365a1e8d6c48499d4b8921244d92a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a6365a1e8d6c48499d4b8921244d92a9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 13 16:23:52 user devstack@n-api.service[62054]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-942770243 Apr 13 16:23:52 user devstack@n-api.service[62054]: X-Tenant-Id: a6365a1e8d6c48499d4b8921244d92a9 Apr 13 16:23:52 user devstack@n-api.service[62054]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-942770243 Apr 13 16:23:52 user devstack@n-api.service[62054]: X-User: tempest-AttachSCSIVolumeTestJSON-942770243-project-member Apr 13 16:23:52 user devstack@n-api.service[62054]: X-User-Domain-Id: default Apr 13 16:23:52 user devstack@n-api.service[62054]: X-User-Domain-Name: Default Apr 13 16:23:52 user devstack@n-api.service[62054]: X-User-Id: 0b143a8db8a3410eb09b21ced7bd883e Apr 13 16:23:52 user devstack@n-api.service[62054]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-942770243-project-member Apr 13 16:23:52 user devstack@n-api.service[62054]: method: > Apr 13 16:23:52 user devstack@n-api.service[62054]: exception: Instance cf54be22-2a5d-40c4-8a1a-0060c77f83f6 could not be found. Apr 13 16:23:52 user devstack@n-api.service[62054]: action_args: {'id': 'cf54be22-2a5d-40c4-8a1a-0060c77f83f6'} Apr 13 16:23:52 user devstack@n-api.service[62054]: {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 16:23:52 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:23:52 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 16:23:52 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 16:23:52 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 16:23:52 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 16:23:52 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 16:23:52 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 16:23:52 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 16:23:52 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 16:23:52 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf54be22-2a5d-40c4-8a1a-0060c77f83f6 could not be found. Apr 13 16:23:52 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:23:52 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:23:52 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:23:52 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:23:52 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 16:23:52 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 16:23:52 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 16:23:52 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 16:23:52 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 16:23:52 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 16:23:52 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 16:23:52 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 16:23:52 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 16:23:52 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 16:23:52 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 16:23:52 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 16:23:52 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf54be22-2a5d-40c4-8a1a-0060c77f83f6 could not be found. Apr 13 16:23:52 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:23:52 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:23:52 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:23:52 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:23:52 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 16:23:52 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 16:23:52 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 16:23:52 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 16:23:52 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf54be22-2a5d-40c4-8a1a-0060c77f83f6 could not be found. Apr 13 16:23:52 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:23:52 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-d6ce43b6-27d6-4898-a5e2-8935e64fbd49 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Returning 404 to user: Instance cf54be22-2a5d-40c4-8a1a-0060c77f83f6 could not be found. {{(pid=62054) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 16:23:52 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-d6ce43b6-27d6-4898-a5e2-8935e64fbd49 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cf54be22-2a5d-40c4-8a1a-0060c77f83f6" status: 404 len: 111 microversion: 2.1 time: 0.033081 Apr 13 16:23:52 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 97/284] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:23:52 2023] GET /compute/v2.1/servers/cf54be22-2a5d-40c4-8a1a-0060c77f83f6 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 16:23:56 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-f6ac84ab-b8ed-49a4-9a7b-e93802271ff2 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:23:56 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-f6ac84ab-b8ed-49a4-9a7b-e93802271ff2 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] [instance: 0e731607-fce1-4f19-9e4b-5b892e760179] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:23:56 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-f6ac84ab-b8ed-49a4-9a7b-e93802271ff2 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:23:56 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-f6ac84ab-b8ed-49a4-9a7b-e93802271ff2 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:23:56 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-f6ac84ab-b8ed-49a4-9a7b-e93802271ff2 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:23:56 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-f6ac84ab-b8ed-49a4-9a7b-e93802271ff2 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:23:56 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-f6ac84ab-b8ed-49a4-9a7b-e93802271ff2 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:23:56 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-f6ac84ab-b8ed-49a4-9a7b-e93802271ff2 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:23:56 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-f6ac84ab-b8ed-49a4-9a7b-e93802271ff2 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] [instance: 0e731607-fce1-4f19-9e4b-5b892e760179] Going to try to terminate instance {{(pid=62055) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 16:23:56 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-f6ac84ab-b8ed-49a4-9a7b-e93802271ff2 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0e731607-fce1-4f19-9e4b-5b892e760179" status: 204 len: 0 microversion: 2.1 time: 0.139023 Apr 13 16:23:56 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 96/285] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 16:23:56 2023] DELETE /compute/v2.1/servers/0e731607-fce1-4f19-9e4b-5b892e760179 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 16:23:56 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-a848d0a0-4fe8-492a-b04e-5bbc44dc8267 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:23:56 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-a848d0a0-4fe8-492a-b04e-5bbc44dc8267 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] [instance: 0e731607-fce1-4f19-9e4b-5b892e760179] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:23:56 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-a848d0a0-4fe8-492a-b04e-5bbc44dc8267 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:23:56 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-a848d0a0-4fe8-492a-b04e-5bbc44dc8267 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:23:56 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-a848d0a0-4fe8-492a-b04e-5bbc44dc8267 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:23:56 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-a848d0a0-4fe8-492a-b04e-5bbc44dc8267 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:23:56 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-a848d0a0-4fe8-492a-b04e-5bbc44dc8267 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:23:56 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-a848d0a0-4fe8-492a-b04e-5bbc44dc8267 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:23:56 user devstack@n-api.service[62053]: DEBUG nova.policy [None req-a848d0a0-4fe8-492a-b04e-5bbc44dc8267 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ddd547d240b43ccb213e9d459082309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5554aa7f1b4d471b8807a845ab1ea33f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62053) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:23:56 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-a848d0a0-4fe8-492a-b04e-5bbc44dc8267 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0e731607-fce1-4f19-9e4b-5b892e760179" status: 200 len: 1501 microversion: 2.1 time: 0.177549 Apr 13 16:23:56 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 93/286] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:23:56 2023] GET /compute/v2.1/servers/0e731607-fce1-4f19-9e4b-5b892e760179 => generated 1501 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:23:56 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-edce7a7d-d3ba-4647-9a6e-c0c15dde32cb req-e9dd3ac7-785d-4150-b7e2-72837bb5c1ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e731607-fce1-4f19-9e4b-5b892e760179", "name": "network-vif-unplugged", "status": "completed", "tag": "62eabc99-73ed-4669-a7ce-6fc646611ff1"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:23:56 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-edce7a7d-d3ba-4647-9a6e-c0c15dde32cb req-e9dd3ac7-785d-4150-b7e2-72837bb5c1ec service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:23:56 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-edce7a7d-d3ba-4647-9a6e-c0c15dde32cb req-e9dd3ac7-785d-4150-b7e2-72837bb5c1ec service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:23:56 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-edce7a7d-d3ba-4647-9a6e-c0c15dde32cb req-e9dd3ac7-785d-4150-b7e2-72837bb5c1ec service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:23:56 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-edce7a7d-d3ba-4647-9a6e-c0c15dde32cb req-e9dd3ac7-785d-4150-b7e2-72837bb5c1ec service nova] Creating event network-vif-unplugged:62eabc99-73ed-4669-a7ce-6fc646611ff1 for instance 0e731607-fce1-4f19-9e4b-5b892e760179 on user Apr 13 16:23:56 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [req-edce7a7d-d3ba-4647-9a6e-c0c15dde32cb req-e9dd3ac7-785d-4150-b7e2-72837bb5c1ec service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037686 Apr 13 16:23:56 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 98/287] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:23:56 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:23:57 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [req-3b21e0b2-1ddd-4f08-a5e1-ed2a294421ed req-c2a63ad3-2b56-4c6a-b986-ad7a4463eaa2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e731607-fce1-4f19-9e4b-5b892e760179", "name": "network-vif-deleted", "tag": "62eabc99-73ed-4669-a7ce-6fc646611ff1"}]} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:23:57 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-3b21e0b2-1ddd-4f08-a5e1-ed2a294421ed req-c2a63ad3-2b56-4c6a-b986-ad7a4463eaa2 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:23:57 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-3b21e0b2-1ddd-4f08-a5e1-ed2a294421ed req-c2a63ad3-2b56-4c6a-b986-ad7a4463eaa2 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:23:57 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-3b21e0b2-1ddd-4f08-a5e1-ed2a294421ed req-c2a63ad3-2b56-4c6a-b986-ad7a4463eaa2 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:23:57 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-3b21e0b2-1ddd-4f08-a5e1-ed2a294421ed req-c2a63ad3-2b56-4c6a-b986-ad7a4463eaa2 service nova] Creating event network-vif-deleted:62eabc99-73ed-4669-a7ce-6fc646611ff1 for instance 0e731607-fce1-4f19-9e4b-5b892e760179 on user Apr 13 16:23:57 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [req-3b21e0b2-1ddd-4f08-a5e1-ed2a294421ed req-c2a63ad3-2b56-4c6a-b986-ad7a4463eaa2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031936 Apr 13 16:23:57 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 97/288] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:23:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 16:23:58 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-f48e12e1-6e4a-4cc9-858d-c6214844785f req-f259246b-15ce-468a-9a56-a0908c2b6b49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e731607-fce1-4f19-9e4b-5b892e760179", "name": "network-vif-plugged", "status": "completed", "tag": "62eabc99-73ed-4669-a7ce-6fc646611ff1"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:23:58 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:23:58 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-f48e12e1-6e4a-4cc9-858d-c6214844785f req-f259246b-15ce-468a-9a56-a0908c2b6b49 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:23:58 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-f48e12e1-6e4a-4cc9-858d-c6214844785f req-f259246b-15ce-468a-9a56-a0908c2b6b49 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:23:58 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-f48e12e1-6e4a-4cc9-858d-c6214844785f req-f259246b-15ce-468a-9a56-a0908c2b6b49 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:23:58 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-f48e12e1-6e4a-4cc9-858d-c6214844785f req-f259246b-15ce-468a-9a56-a0908c2b6b49 service nova] Creating event network-vif-plugged:62eabc99-73ed-4669-a7ce-6fc646611ff1 for instance 0e731607-fce1-4f19-9e4b-5b892e760179 on user Apr 13 16:23:58 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [req-f48e12e1-6e4a-4cc9-858d-c6214844785f req-f259246b-15ce-468a-9a56-a0908c2b6b49 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056252 Apr 13 16:23:58 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 94/289] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:23:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:24:03 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-e17f31dc-2d47-40c9-9fa5-bbcce914f907 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:24:03 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-e17f31dc-2d47-40c9-9fa5-bbcce914f907 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: db65920b-7872-44c1-a68a-a696681d9d95] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:24:03 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-e17f31dc-2d47-40c9-9fa5-bbcce914f907 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:24:03 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-e17f31dc-2d47-40c9-9fa5-bbcce914f907 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:24:03 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-e17f31dc-2d47-40c9-9fa5-bbcce914f907 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:24:03 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-e17f31dc-2d47-40c9-9fa5-bbcce914f907 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:24:03 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-e17f31dc-2d47-40c9-9fa5-bbcce914f907 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:24:03 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-e17f31dc-2d47-40c9-9fa5-bbcce914f907 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:24:03 user devstack@n-api.service[62054]: DEBUG nova.policy [None req-e17f31dc-2d47-40c9-9fa5-bbcce914f907 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e10f63cdd49a9a1ebe1fe4c9de0a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d451e0e239f486aa2b3abe9e273eab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62054) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:24:03 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-e17f31dc-2d47-40c9-9fa5-bbcce914f907 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] 10.0.0.210 "GET /compute/v2.1/servers/db65920b-7872-44c1-a68a-a696681d9d95" status: 200 len: 1378 microversion: 2.1 time: 0.326727 Apr 13 16:24:03 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 99/290] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:24:03 2023] GET /compute/v2.1/servers/db65920b-7872-44c1-a68a-a696681d9d95 => generated 1378 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:24:03 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-4ac39424-614e-49de-aa8e-04bc6d5b1175 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:24:03 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-4ac39424-614e-49de-aa8e-04bc6d5b1175 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: db65920b-7872-44c1-a68a-a696681d9d95] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:24:03 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-4ac39424-614e-49de-aa8e-04bc6d5b1175 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:24:03 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-4ac39424-614e-49de-aa8e-04bc6d5b1175 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:24:03 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-4ac39424-614e-49de-aa8e-04bc6d5b1175 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:24:03 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-4ac39424-614e-49de-aa8e-04bc6d5b1175 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:24:03 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-4ac39424-614e-49de-aa8e-04bc6d5b1175 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:24:03 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-4ac39424-614e-49de-aa8e-04bc6d5b1175 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:24:03 user devstack@n-api.service[62055]: DEBUG nova.policy [None req-4ac39424-614e-49de-aa8e-04bc6d5b1175 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e10f63cdd49a9a1ebe1fe4c9de0a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d451e0e239f486aa2b3abe9e273eab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62055) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:24:03 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-4ac39424-614e-49de-aa8e-04bc6d5b1175 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] 10.0.0.210 "GET /compute/v2.1/servers/db65920b-7872-44c1-a68a-a696681d9d95" status: 200 len: 1378 microversion: 2.1 time: 0.150697 Apr 13 16:24:03 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 98/291] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:24:03 2023] GET /compute/v2.1/servers/db65920b-7872-44c1-a68a-a696681d9d95 => generated 1378 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:24:04 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-3f0ba656-5851-47eb-a26c-ef70b92f6885 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:24:04 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-3f0ba656-5851-47eb-a26c-ef70b92f6885 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: db65920b-7872-44c1-a68a-a696681d9d95] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:24:04 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-3f0ba656-5851-47eb-a26c-ef70b92f6885 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:24:04 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-3f0ba656-5851-47eb-a26c-ef70b92f6885 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:24:04 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-3f0ba656-5851-47eb-a26c-ef70b92f6885 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:24:04 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-3f0ba656-5851-47eb-a26c-ef70b92f6885 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:24:04 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-3f0ba656-5851-47eb-a26c-ef70b92f6885 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:24:04 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-3f0ba656-5851-47eb-a26c-ef70b92f6885 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:24:04 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-3f0ba656-5851-47eb-a26c-ef70b92f6885 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: db65920b-7872-44c1-a68a-a696681d9d95] Going to try to terminate instance {{(pid=62053) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 16:24:04 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-3f0ba656-5851-47eb-a26c-ef70b92f6885 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/db65920b-7872-44c1-a68a-a696681d9d95" status: 204 len: 0 microversion: 2.1 time: 0.122006 Apr 13 16:24:04 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 95/292] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 16:24:03 2023] DELETE /compute/v2.1/servers/db65920b-7872-44c1-a68a-a696681d9d95 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 16:24:04 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-a2fbc6b3-8b6e-4424-8eac-246821e51f85 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:24:04 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-a2fbc6b3-8b6e-4424-8eac-246821e51f85 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: db65920b-7872-44c1-a68a-a696681d9d95] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:24:04 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-a2fbc6b3-8b6e-4424-8eac-246821e51f85 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:24:04 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-a2fbc6b3-8b6e-4424-8eac-246821e51f85 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:24:04 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-a2fbc6b3-8b6e-4424-8eac-246821e51f85 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:24:04 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-a2fbc6b3-8b6e-4424-8eac-246821e51f85 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:24:04 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-a2fbc6b3-8b6e-4424-8eac-246821e51f85 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:24:04 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-a2fbc6b3-8b6e-4424-8eac-246821e51f85 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:24:04 user devstack@n-api.service[62054]: DEBUG nova.policy [None req-a2fbc6b3-8b6e-4424-8eac-246821e51f85 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e10f63cdd49a9a1ebe1fe4c9de0a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d451e0e239f486aa2b3abe9e273eab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62054) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:24:04 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-a2fbc6b3-8b6e-4424-8eac-246821e51f85 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] 10.0.0.210 "GET /compute/v2.1/servers/db65920b-7872-44c1-a68a-a696681d9d95" status: 200 len: 1384 microversion: 2.1 time: 0.249319 Apr 13 16:24:04 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 100/293] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:24:04 2023] GET /compute/v2.1/servers/db65920b-7872-44c1-a68a-a696681d9d95 => generated 1384 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:24:04 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-9bfcf984-9f9b-48ef-a9ab-d7bf7da5fa25 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:24:04 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-9bfcf984-9f9b-48ef-a9ab-d7bf7da5fa25 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:24:04 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-9bfcf984-9f9b-48ef-a9ab-d7bf7da5fa25 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:24:04 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-9bfcf984-9f9b-48ef-a9ab-d7bf7da5fa25 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:24:04 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-9bfcf984-9f9b-48ef-a9ab-d7bf7da5fa25 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:24:04 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-9bfcf984-9f9b-48ef-a9ab-d7bf7da5fa25 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:24:04 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-9bfcf984-9f9b-48ef-a9ab-d7bf7da5fa25 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:24:04 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-9bfcf984-9f9b-48ef-a9ab-d7bf7da5fa25 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:24:04 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-a1e3594d-d928-41e3-a427-2d9a89e024b7 req-394b0fc3-6d14-4480-81ab-8fbbe5f373af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db65920b-7872-44c1-a68a-a696681d9d95", "name": "network-vif-unplugged", "status": "completed", "tag": "ba686724-ae8a-4e16-9918-d7b2fc64ff62"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:24:04 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-a1e3594d-d928-41e3-a427-2d9a89e024b7 req-394b0fc3-6d14-4480-81ab-8fbbe5f373af service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:24:04 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-a1e3594d-d928-41e3-a427-2d9a89e024b7 req-394b0fc3-6d14-4480-81ab-8fbbe5f373af service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:24:04 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-a1e3594d-d928-41e3-a427-2d9a89e024b7 req-394b0fc3-6d14-4480-81ab-8fbbe5f373af service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:24:04 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-a1e3594d-d928-41e3-a427-2d9a89e024b7 req-394b0fc3-6d14-4480-81ab-8fbbe5f373af service nova] Creating event network-vif-unplugged:ba686724-ae8a-4e16-9918-d7b2fc64ff62 for instance db65920b-7872-44c1-a68a-a696681d9d95 on user Apr 13 16:24:04 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [req-a1e3594d-d928-41e3-a427-2d9a89e024b7 req-394b0fc3-6d14-4480-81ab-8fbbe5f373af service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037485 Apr 13 16:24:04 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 96/294] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:24:04 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:24:05 user devstack@n-api.service[62055]: DEBUG nova.policy [None req-9bfcf984-9f9b-48ef-a9ab-d7bf7da5fa25 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45a882dbafb4ea4976e4f45289eb2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d09a74bf684a9fb1dd1e95d6c23f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62055) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:24:05 user devstack@n-api.service[62055]: DEBUG nova.policy [None req-9bfcf984-9f9b-48ef-a9ab-d7bf7da5fa25 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e45a882dbafb4ea4976e4f45289eb2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d09a74bf684a9fb1dd1e95d6c23f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62055) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:24:05 user devstack@n-api.service[62055]: DEBUG nova.policy [None req-9bfcf984-9f9b-48ef-a9ab-d7bf7da5fa25 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e45a882dbafb4ea4976e4f45289eb2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d09a74bf684a9fb1dd1e95d6c23f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62055) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:24:05 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-9bfcf984-9f9b-48ef-a9ab-d7bf7da5fa25 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] 10.0.0.210 "GET /compute/v2.1/servers/235f827c-7116-48e9-84c5-0c9761c18e1e" status: 200 len: 1769 microversion: 2.87 time: 0.323083 Apr 13 16:24:05 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 99/295] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 16:24:04 2023] GET /compute/v2.1/servers/235f827c-7116-48e9-84c5-0c9761c18e1e => generated 1769 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 16:24:06 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-36a398f5-4a05-4d85-96fb-5387b4439495 req-4cd6ba7e-f243-4c69-ad87-43e4f8287b24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db65920b-7872-44c1-a68a-a696681d9d95", "name": "network-vif-deleted", "tag": "ba686724-ae8a-4e16-9918-d7b2fc64ff62"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:24:06 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-36a398f5-4a05-4d85-96fb-5387b4439495 req-4cd6ba7e-f243-4c69-ad87-43e4f8287b24 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:24:06 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-36a398f5-4a05-4d85-96fb-5387b4439495 req-4cd6ba7e-f243-4c69-ad87-43e4f8287b24 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:24:06 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-36a398f5-4a05-4d85-96fb-5387b4439495 req-4cd6ba7e-f243-4c69-ad87-43e4f8287b24 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:24:06 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-36a398f5-4a05-4d85-96fb-5387b4439495 req-4cd6ba7e-f243-4c69-ad87-43e4f8287b24 service nova] Creating event network-vif-deleted:ba686724-ae8a-4e16-9918-d7b2fc64ff62 for instance db65920b-7872-44c1-a68a-a696681d9d95 on user Apr 13 16:24:06 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [req-36a398f5-4a05-4d85-96fb-5387b4439495 req-4cd6ba7e-f243-4c69-ad87-43e4f8287b24 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029736 Apr 13 16:24:06 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 101/296] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:24:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:24:06 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-b7551a9b-3bd6-4ca2-aa6a-9c09a4835123 req-1faea2d3-7ffe-42bc-967c-01f0f427d148 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db65920b-7872-44c1-a68a-a696681d9d95", "name": "network-vif-plugged", "status": "completed", "tag": "ba686724-ae8a-4e16-9918-d7b2fc64ff62"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:24:06 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-b7551a9b-3bd6-4ca2-aa6a-9c09a4835123 req-1faea2d3-7ffe-42bc-967c-01f0f427d148 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:24:06 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-b7551a9b-3bd6-4ca2-aa6a-9c09a4835123 req-1faea2d3-7ffe-42bc-967c-01f0f427d148 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:24:06 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-b7551a9b-3bd6-4ca2-aa6a-9c09a4835123 req-1faea2d3-7ffe-42bc-967c-01f0f427d148 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:24:06 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-b7551a9b-3bd6-4ca2-aa6a-9c09a4835123 req-1faea2d3-7ffe-42bc-967c-01f0f427d148 service nova] Creating event network-vif-plugged:ba686724-ae8a-4e16-9918-d7b2fc64ff62 for instance db65920b-7872-44c1-a68a-a696681d9d95 on user Apr 13 16:24:06 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [req-b7551a9b-3bd6-4ca2-aa6a-9c09a4835123 req-1faea2d3-7ffe-42bc-967c-01f0f427d148 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034373 Apr 13 16:24:06 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 97/297] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:24:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:24:07 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-18f008b1-8822-4d45-a683-ebacb0d3e18f tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Action: 'create', calling method: .version_select at 0x7f96e4aa2ef0>, body: {"keypair": {"name": "tempest-keypair-1534458766", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBWOy0oVQ9hC0pTOafixaz1QU1E5DFmqkYHL4O9l7OLTdaq0+Nt41+fxYUKgEMEMs0o2pxQBhqAzayIAyGV1IIb01ym4tkG3pd4D4/xbjIzoE586YH9dqYrXgxzYqNSiRA=="}} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:24:07 user devstack@n-api.service[62055]: DEBUG nova.quota [None req-18f008b1-8822-4d45-a683-ebacb0d3e18f tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Getting quotas for project 24904988cf334657b084fd726c7ecf8f. Resources: {'key_pairs'} {{(pid=62055) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 16:24:07 user devstack@n-api.service[62055]: DEBUG nova.quota [None req-18f008b1-8822-4d45-a683-ebacb0d3e18f tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Getting quotas for user 47fab402fb794a5a9281cfb7fe188813 and project 24904988cf334657b084fd726c7ecf8f. Resources: {'key_pairs'} {{(pid=62055) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 16:24:07 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-18f008b1-8822-4d45-a683-ebacb0d3e18f tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.159285 Apr 13 16:24:07 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 100/298] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 13 16:24:07 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:24:08 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-cd45ef09-4353-465c-916c-11a3a2c2eb68 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1335647489", "imageRef": "708622a9-7465-4492-ade8-b827198f7e30", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "79e9ef20-b14d-4850-b298-9d3ed4d10b90"}], "security_groups": [{"name": "tempest-securitygroup--968621569"}], "key_name": "tempest-keypair-1534458766", "user_data": "}} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:24:09 user devstack@n-api.service[62054]: DEBUG nova.network.neutron [None req-cd45ef09-4353-465c-916c-11a3a2c2eb68 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] validate_networks() for [('79e9ef20-b14d-4850-b298-9d3ed4d10b90', None, None, None, None, None)] {{(pid=62054) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 16:24:09 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-1c6abfd7-ed4d-418c-9625-e22883f8d52e tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:24:09 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-1c6abfd7-ed4d-418c-9625-e22883f8d52e tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:24:09 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-1c6abfd7-ed4d-418c-9625-e22883f8d52e tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:24:09 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-1c6abfd7-ed4d-418c-9625-e22883f8d52e tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:24:09 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-1c6abfd7-ed4d-418c-9625-e22883f8d52e tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:24:09 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-1c6abfd7-ed4d-418c-9625-e22883f8d52e tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:24:09 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-1c6abfd7-ed4d-418c-9625-e22883f8d52e tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:24:09 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-1c6abfd7-ed4d-418c-9625-e22883f8d52e tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:24:09 user devstack@n-api.service[62053]: INFO nova.api.openstack.wsgi [None req-1c6abfd7-ed4d-418c-9625-e22883f8d52e tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] HTTP exception thrown: Instance e4ada2d7-7ace-4ed4-86a6-ed121c95e80f could not be found. Apr 13 16:24:09 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-1c6abfd7-ed4d-418c-9625-e22883f8d52e tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Request method failure captured: Apr 13 16:24:09 user devstack@n-api.service[62053]: request: GET /compute/v2.1/servers/e4ada2d7-7ace-4ed4-86a6-ed121c95e80f HTTP/1.1 Apr 13 16:24:09 user devstack@n-api.service[62053]: Accept: application/json Apr 13 16:24:09 user devstack@n-api.service[62053]: Accept-Encoding: identity Apr 13 16:24:09 user devstack@n-api.service[62053]: Connection: close Apr 13 16:24:09 user devstack@n-api.service[62053]: Content-Length: 0 Apr 13 16:24:09 user devstack@n-api.service[62053]: Content-Type: application/json Apr 13 16:24:09 user devstack@n-api.service[62053]: Host: 10.0.0.210 Apr 13 16:24:09 user devstack@n-api.service[62053]: Openstack-System-Scope: None Apr 13 16:24:09 user devstack@n-api.service[62053]: User-Agent: python-urllib3/1.26.15 Apr 13 16:24:09 user devstack@n-api.service[62053]: X-Auth-Token: gAAAAABkOCu-wAxM0Gn4zSDnueR8st1Sg_5YD68vrnbQd6srDw8B0rWyntxDST5WJwwjFtF9f8pCWtyEZgXfnLaDzj7-YlJrNDYzdYb6UZXLmMXC6nNwGSJuYkG1WtfAD8ivnOICOu9q-_aSxLYXqQz2Rj47bbO8aun-CJEzeo6PizEUSRJRqfo Apr 13 16:24:09 user devstack@n-api.service[62053]: X-Domain-Id: None Apr 13 16:24:09 user devstack@n-api.service[62053]: X-Domain-Name: None Apr 13 16:24:09 user devstack@n-api.service[62053]: X-Identity-Status: Confirmed Apr 13 16:24:09 user devstack@n-api.service[62053]: X-Is-Admin-Project: True Apr 13 16:24:09 user devstack@n-api.service[62053]: X-Openstack-Nova-Api-Version: 2.42 Apr 13 16:24:09 user devstack@n-api.service[62053]: X-Project-Domain-Id: default Apr 13 16:24:09 user devstack@n-api.service[62053]: X-Project-Domain-Name: Default Apr 13 16:24:09 user devstack@n-api.service[62053]: X-Project-Id: 7649e366b0164e2fa5b3faa0830b6ea6 Apr 13 16:24:09 user devstack@n-api.service[62053]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1193811043 Apr 13 16:24:09 user devstack@n-api.service[62053]: X-Role: reader,member Apr 13 16:24:09 user devstack@n-api.service[62053]: X-Roles: reader,member Apr 13 16:24:09 user devstack@n-api.service[62053]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/7649e366b0164e2fa5b3faa0830b6ea6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7649e366b0164e2fa5b3faa0830b6ea6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7649e366b0164e2fa5b3faa0830b6ea6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 13 16:24:09 user devstack@n-api.service[62053]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1193811043 Apr 13 16:24:09 user devstack@n-api.service[62053]: X-Tenant-Id: 7649e366b0164e2fa5b3faa0830b6ea6 Apr 13 16:24:09 user devstack@n-api.service[62053]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1193811043 Apr 13 16:24:09 user devstack@n-api.service[62053]: X-User: tempest-TaggedBootDevicesTest_v242-1193811043-project-member Apr 13 16:24:09 user devstack@n-api.service[62053]: X-User-Domain-Id: default Apr 13 16:24:09 user devstack@n-api.service[62053]: X-User-Domain-Name: Default Apr 13 16:24:09 user devstack@n-api.service[62053]: X-User-Id: 7e50bd9d540549a194f706dac48ce93d Apr 13 16:24:09 user devstack@n-api.service[62053]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1193811043-project-member Apr 13 16:24:09 user devstack@n-api.service[62053]: method: > Apr 13 16:24:09 user devstack@n-api.service[62053]: exception: Instance e4ada2d7-7ace-4ed4-86a6-ed121c95e80f could not be found. Apr 13 16:24:09 user devstack@n-api.service[62053]: action_args: {'id': 'e4ada2d7-7ace-4ed4-86a6-ed121c95e80f'} Apr 13 16:24:09 user devstack@n-api.service[62053]: {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 16:24:09 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:24:09 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 16:24:09 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 16:24:09 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 16:24:09 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 16:24:09 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 16:24:09 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 16:24:09 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 16:24:09 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 16:24:09 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4ada2d7-7ace-4ed4-86a6-ed121c95e80f could not be found. Apr 13 16:24:09 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:24:09 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:24:09 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:24:09 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:24:09 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 16:24:09 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 16:24:09 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 16:24:09 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 16:24:09 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 16:24:09 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 16:24:09 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 16:24:09 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 16:24:09 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 16:24:09 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 16:24:09 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 16:24:09 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 16:24:09 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4ada2d7-7ace-4ed4-86a6-ed121c95e80f could not be found. Apr 13 16:24:09 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:24:09 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:24:09 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:24:09 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:24:09 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 16:24:09 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 16:24:09 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 16:24:09 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 16:24:09 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4ada2d7-7ace-4ed4-86a6-ed121c95e80f could not be found. Apr 13 16:24:09 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:24:09 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-1c6abfd7-ed4d-418c-9625-e22883f8d52e tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Returning 404 to user: Instance e4ada2d7-7ace-4ed4-86a6-ed121c95e80f could not be found. {{(pid=62053) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 16:24:09 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-1c6abfd7-ed4d-418c-9625-e22883f8d52e tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e4ada2d7-7ace-4ed4-86a6-ed121c95e80f" status: 404 len: 111 microversion: 2.42 time: 0.038628 Apr 13 16:24:09 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 98/299] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 16:24:09 2023] GET /compute/v2.1/servers/e4ada2d7-7ace-4ed4-86a6-ed121c95e80f => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 13 16:24:09 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-a71dd2f6-b2c6-495c-bac8-54c7d8446505 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Calling method '.version_select at 0x7f96e4aa1a20>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:24:09 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-a71dd2f6-b2c6-495c-bac8-54c7d8446505 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-135831071" status: 204 len: 0 microversion: 2.42 time: 0.025710 Apr 13 16:24:09 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 101/300] 10.0.0.210 () {64 vars in 1336 bytes} [Thu Apr 13 16:24:09 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-135831071 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 13 16:24:09 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-ddea18b4-9976-4470-8e93-e3f1aa5d8862 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:24:09 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-ddea18b4-9976-4470-8e93-e3f1aa5d8862 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:24:09 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-ddea18b4-9976-4470-8e93-e3f1aa5d8862 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:24:09 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-ddea18b4-9976-4470-8e93-e3f1aa5d8862 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:24:09 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-ddea18b4-9976-4470-8e93-e3f1aa5d8862 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:24:09 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-ddea18b4-9976-4470-8e93-e3f1aa5d8862 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:24:09 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-ddea18b4-9976-4470-8e93-e3f1aa5d8862 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:24:09 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-ddea18b4-9976-4470-8e93-e3f1aa5d8862 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:24:09 user devstack@n-api.service[62053]: INFO nova.api.openstack.wsgi [None req-ddea18b4-9976-4470-8e93-e3f1aa5d8862 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] HTTP exception thrown: Instance 2549ba85-4e0a-420e-b711-07cafa8c60e9 could not be found. Apr 13 16:24:09 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-ddea18b4-9976-4470-8e93-e3f1aa5d8862 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Request method failure captured: Apr 13 16:24:09 user devstack@n-api.service[62053]: request: GET /compute/v2.1/servers/2549ba85-4e0a-420e-b711-07cafa8c60e9 HTTP/1.1 Apr 13 16:24:09 user devstack@n-api.service[62053]: Accept: application/json Apr 13 16:24:09 user devstack@n-api.service[62053]: Accept-Encoding: identity Apr 13 16:24:09 user devstack@n-api.service[62053]: Connection: close Apr 13 16:24:09 user devstack@n-api.service[62053]: Content-Length: 0 Apr 13 16:24:09 user devstack@n-api.service[62053]: Content-Type: application/json Apr 13 16:24:09 user devstack@n-api.service[62053]: Host: 10.0.0.210 Apr 13 16:24:09 user devstack@n-api.service[62053]: Openstack-System-Scope: None Apr 13 16:24:09 user devstack@n-api.service[62053]: User-Agent: python-urllib3/1.26.15 Apr 13 16:24:09 user devstack@n-api.service[62053]: X-Auth-Token: gAAAAABkOCvA4uta2umNckq53p52lHtS_qqM3nkYDSSDXN_5FRLHkUwlB0tEoWAN5dLy4Ty2G50HndGjpN0NH-X4_NVyF6jAH0EhQEHJdihx42ssBQFi9mCEYwORrKVlKIwcytv9aCHVcaNadZucBTSK3u3ttVLrJXVQfai-9k_rqig6BBeiX04 Apr 13 16:24:09 user devstack@n-api.service[62053]: X-Domain-Id: None Apr 13 16:24:09 user devstack@n-api.service[62053]: X-Domain-Name: None Apr 13 16:24:09 user devstack@n-api.service[62053]: X-Identity-Status: Confirmed Apr 13 16:24:09 user devstack@n-api.service[62053]: X-Is-Admin-Project: True Apr 13 16:24:09 user devstack@n-api.service[62053]: X-Openstack-Nova-Api-Version: 2.32 Apr 13 16:24:09 user devstack@n-api.service[62053]: X-Project-Domain-Id: default Apr 13 16:24:09 user devstack@n-api.service[62053]: X-Project-Domain-Name: Default Apr 13 16:24:09 user devstack@n-api.service[62053]: X-Project-Id: bbe4e9fb786d4015b035b4d00f75a1ba Apr 13 16:24:09 user devstack@n-api.service[62053]: X-Project-Name: tempest-TaggedBootDevicesTest-1779812468 Apr 13 16:24:09 user devstack@n-api.service[62053]: X-Role: reader,member Apr 13 16:24:09 user devstack@n-api.service[62053]: X-Roles: reader,member Apr 13 16:24:09 user devstack@n-api.service[62053]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/bbe4e9fb786d4015b035b4d00f75a1ba"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bbe4e9fb786d4015b035b4d00f75a1ba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bbe4e9fb786d4015b035b4d00f75a1ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 13 16:24:09 user devstack@n-api.service[62053]: X-Tenant: tempest-TaggedBootDevicesTest-1779812468 Apr 13 16:24:09 user devstack@n-api.service[62053]: X-Tenant-Id: bbe4e9fb786d4015b035b4d00f75a1ba Apr 13 16:24:09 user devstack@n-api.service[62053]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1779812468 Apr 13 16:24:09 user devstack@n-api.service[62053]: X-User: tempest-TaggedBootDevicesTest-1779812468-project-member Apr 13 16:24:09 user devstack@n-api.service[62053]: X-User-Domain-Id: default Apr 13 16:24:09 user devstack@n-api.service[62053]: X-User-Domain-Name: Default Apr 13 16:24:09 user devstack@n-api.service[62053]: X-User-Id: 14566b85d0424c08999726ff72a67634 Apr 13 16:24:09 user devstack@n-api.service[62053]: X-User-Name: tempest-TaggedBootDevicesTest-1779812468-project-member Apr 13 16:24:09 user devstack@n-api.service[62053]: method: > Apr 13 16:24:09 user devstack@n-api.service[62053]: exception: Instance 2549ba85-4e0a-420e-b711-07cafa8c60e9 could not be found. Apr 13 16:24:09 user devstack@n-api.service[62053]: action_args: {'id': '2549ba85-4e0a-420e-b711-07cafa8c60e9'} Apr 13 16:24:09 user devstack@n-api.service[62053]: {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 16:24:09 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:24:09 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 16:24:09 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 16:24:09 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 16:24:09 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 16:24:09 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 16:24:09 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 16:24:09 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 16:24:09 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 16:24:09 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2549ba85-4e0a-420e-b711-07cafa8c60e9 could not be found. Apr 13 16:24:09 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:24:09 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:24:09 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:24:09 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:24:09 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 16:24:09 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 16:24:09 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 16:24:09 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 16:24:09 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 16:24:09 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 16:24:09 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 16:24:09 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 16:24:09 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 16:24:09 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 16:24:09 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 16:24:09 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 16:24:09 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2549ba85-4e0a-420e-b711-07cafa8c60e9 could not be found. Apr 13 16:24:09 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:24:09 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:24:09 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:24:09 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:24:09 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 16:24:09 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 16:24:09 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 16:24:09 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 16:24:09 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2549ba85-4e0a-420e-b711-07cafa8c60e9 could not be found. Apr 13 16:24:09 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:24:09 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-ddea18b4-9976-4470-8e93-e3f1aa5d8862 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Returning 404 to user: Instance 2549ba85-4e0a-420e-b711-07cafa8c60e9 could not be found. {{(pid=62053) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 16:24:09 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-ddea18b4-9976-4470-8e93-e3f1aa5d8862 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2549ba85-4e0a-420e-b711-07cafa8c60e9" status: 404 len: 111 microversion: 2.32 time: 0.041708 Apr 13 16:24:09 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 99/301] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 16:24:09 2023] GET /compute/v2.1/servers/2549ba85-4e0a-420e-b711-07cafa8c60e9 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 13 16:24:09 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-6925deb0-a375-48d9-9d97-1ce50e063d4f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Calling method '.version_select at 0x7f96e4b09990>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:24:09 user devstack@n-api.service[62054]: DEBUG nova.virt.hardware [None req-cd45ef09-4353-465c-916c-11a3a2c2eb68 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Flavor limits 0:0:0 {{(pid=62054) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 16:24:09 user devstack@n-api.service[62054]: DEBUG nova.virt.hardware [None req-cd45ef09-4353-465c-916c-11a3a2c2eb68 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Image limits 0:0:0 {{(pid=62054) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 16:24:09 user devstack@n-api.service[62054]: DEBUG nova.virt.hardware [None req-cd45ef09-4353-465c-916c-11a3a2c2eb68 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Flavor pref 0:0:0 {{(pid=62054) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 16:24:09 user devstack@n-api.service[62054]: DEBUG nova.virt.hardware [None req-cd45ef09-4353-465c-916c-11a3a2c2eb68 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Image pref 0:0:0 {{(pid=62054) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 16:24:09 user devstack@n-api.service[62054]: DEBUG nova.virt.hardware [None req-cd45ef09-4353-465c-916c-11a3a2c2eb68 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62054) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 16:24:09 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-6925deb0-a375-48d9-9d97-1ce50e063d4f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-756136845" status: 204 len: 0 microversion: 2.32 time: 0.027276 Apr 13 16:24:09 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 102/302] 10.0.0.210 () {64 vars in 1336 bytes} [Thu Apr 13 16:24:09 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-756136845 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 13 16:24:09 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-cd45ef09-4353-465c-916c-11a3a2c2eb68 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:24:09 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-cd45ef09-4353-465c-916c-11a3a2c2eb68 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:24:09 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-cd45ef09-4353-465c-916c-11a3a2c2eb68 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:24:09 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-cd45ef09-4353-465c-916c-11a3a2c2eb68 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:24:09 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-cd45ef09-4353-465c-916c-11a3a2c2eb68 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:24:09 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-cd45ef09-4353-465c-916c-11a3a2c2eb68 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:24:09 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-ab845f23-0c54-4e8c-a782-aefa730735db tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:24:09 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-ab845f23-0c54-4e8c-a782-aefa730735db tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] [instance: 8c6d8096-853b-4091-ad82-6faf8ffc85fa] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:24:09 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-ab845f23-0c54-4e8c-a782-aefa730735db tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:24:09 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-ab845f23-0c54-4e8c-a782-aefa730735db tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:24:09 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-ab845f23-0c54-4e8c-a782-aefa730735db tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:24:09 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-ab845f23-0c54-4e8c-a782-aefa730735db tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:24:09 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-ab845f23-0c54-4e8c-a782-aefa730735db tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:24:09 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-ab845f23-0c54-4e8c-a782-aefa730735db tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:24:09 user devstack@n-api.service[62054]: DEBUG nova.quota [None req-cd45ef09-4353-465c-916c-11a3a2c2eb68 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Getting quotas for project 24904988cf334657b084fd726c7ecf8f. Resources: {'instances', 'cores', 'ram'} {{(pid=62054) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 16:24:09 user devstack@n-api.service[62054]: DEBUG nova.quota [None req-cd45ef09-4353-465c-916c-11a3a2c2eb68 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Getting quotas for user 47fab402fb794a5a9281cfb7fe188813 and project 24904988cf334657b084fd726c7ecf8f. Resources: {'instances', 'cores', 'ram'} {{(pid=62054) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 16:24:09 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-cd45ef09-4353-465c-916c-11a3a2c2eb68 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Going to run 1 instances... {{(pid=62054) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 16:24:09 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-ab845f23-0c54-4e8c-a782-aefa730735db tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8c6d8096-853b-4091-ad82-6faf8ffc85fa/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044449 Apr 13 16:24:09 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 100/303] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 16:24:09 2023] GET /compute/v2.1/servers/8c6d8096-853b-4091-ad82-6faf8ffc85fa/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 16:24:09 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-cd45ef09-4353-465c-916c-11a3a2c2eb68 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='708622a9-7465-4492-ade8-b827198f7e30',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=62054) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 16:24:09 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-cd45ef09-4353-465c-916c-11a3a2c2eb68 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 1.100076 Apr 13 16:24:09 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 102/304] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 16:24:08 2023] POST /compute/v2.1/servers => generated 399 bytes in 1109 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 16:24:10 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-985308eb-4012-46e5-8b5c-c7be61401aeb tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:24:10 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-985308eb-4012-46e5-8b5c-c7be61401aeb tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:24:10 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-9f9e25f5-a684-48b1-9aab-64ad24829115 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:24:10 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-9f9e25f5-a684-48b1-9aab-64ad24829115 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] [instance: 8c6d8096-853b-4091-ad82-6faf8ffc85fa] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:24:10 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-9f9e25f5-a684-48b1-9aab-64ad24829115 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:24:10 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-9f9e25f5-a684-48b1-9aab-64ad24829115 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:24:10 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-9f9e25f5-a684-48b1-9aab-64ad24829115 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:24:10 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-9f9e25f5-a684-48b1-9aab-64ad24829115 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:24:10 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-9f9e25f5-a684-48b1-9aab-64ad24829115 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:24:10 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-9f9e25f5-a684-48b1-9aab-64ad24829115 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:24:10 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-9f9e25f5-a684-48b1-9aab-64ad24829115 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] [instance: 8c6d8096-853b-4091-ad82-6faf8ffc85fa] Going to try to terminate instance {{(pid=62053) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 16:24:10 user devstack@n-api.service[62055]: DEBUG nova.policy [None req-985308eb-4012-46e5-8b5c-c7be61401aeb tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fab402fb794a5a9281cfb7fe188813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24904988cf334657b084fd726c7ecf8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62055) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:24:10 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-985308eb-4012-46e5-8b5c-c7be61401aeb tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eaae47b9-a059-49f6-9ae6-d7147003e2f2" status: 200 len: 1232 microversion: 2.1 time: 0.079905 Apr 13 16:24:10 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 103/305] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:24:09 2023] GET /compute/v2.1/servers/eaae47b9-a059-49f6-9ae6-d7147003e2f2 => generated 1232 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:24:10 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-9f9e25f5-a684-48b1-9aab-64ad24829115 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8c6d8096-853b-4091-ad82-6faf8ffc85fa" status: 204 len: 0 microversion: 2.1 time: 0.148729 Apr 13 16:24:10 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 101/306] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 16:24:09 2023] DELETE /compute/v2.1/servers/8c6d8096-853b-4091-ad82-6faf8ffc85fa => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 16:24:10 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-8fbbc0f1-13a6-4132-a656-da97e40baac7 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:24:10 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-8fbbc0f1-13a6-4132-a656-da97e40baac7 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] [instance: 8c6d8096-853b-4091-ad82-6faf8ffc85fa] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:24:10 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-8fbbc0f1-13a6-4132-a656-da97e40baac7 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:24:10 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-8fbbc0f1-13a6-4132-a656-da97e40baac7 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:24:10 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-8fbbc0f1-13a6-4132-a656-da97e40baac7 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:24:10 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-8fbbc0f1-13a6-4132-a656-da97e40baac7 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:24:10 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-8fbbc0f1-13a6-4132-a656-da97e40baac7 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:24:10 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-8fbbc0f1-13a6-4132-a656-da97e40baac7 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:24:10 user devstack@n-api.service[62054]: DEBUG nova.policy [None req-8fbbc0f1-13a6-4132-a656-da97e40baac7 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b5e87b35e0471cafe541fdf224b5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc3e2169a6c44d05b2a2eedbe3a063cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62054) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:24:10 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-8fbbc0f1-13a6-4132-a656-da97e40baac7 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8c6d8096-853b-4091-ad82-6faf8ffc85fa" status: 200 len: 1650 microversion: 2.1 time: 0.367560 Apr 13 16:24:10 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 103/307] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:24:10 2023] GET /compute/v2.1/servers/8c6d8096-853b-4091-ad82-6faf8ffc85fa => generated 1650 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:24:10 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [req-4b8922e3-78a5-48c5-9deb-a87e2af82409 req-7a9cb36d-8f08-4b05-a68b-7800c3ca4fd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c6d8096-853b-4091-ad82-6faf8ffc85fa", "name": "network-vif-unplugged", "status": "completed", "tag": "385dec44-4145-4606-b0af-30fbc721eb2c"}]} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:24:10 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-4b8922e3-78a5-48c5-9deb-a87e2af82409 req-7a9cb36d-8f08-4b05-a68b-7800c3ca4fd1 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:24:10 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-4b8922e3-78a5-48c5-9deb-a87e2af82409 req-7a9cb36d-8f08-4b05-a68b-7800c3ca4fd1 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:24:10 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-4b8922e3-78a5-48c5-9deb-a87e2af82409 req-7a9cb36d-8f08-4b05-a68b-7800c3ca4fd1 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:24:10 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-4b8922e3-78a5-48c5-9deb-a87e2af82409 req-7a9cb36d-8f08-4b05-a68b-7800c3ca4fd1 service nova] Creating event network-vif-unplugged:385dec44-4145-4606-b0af-30fbc721eb2c for instance 8c6d8096-853b-4091-ad82-6faf8ffc85fa on user Apr 13 16:24:10 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [req-4b8922e3-78a5-48c5-9deb-a87e2af82409 req-7a9cb36d-8f08-4b05-a68b-7800c3ca4fd1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045677 Apr 13 16:24:10 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 104/308] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:24:10 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:24:11 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-3b76e5ca-3e3b-4387-8b8a-27eaf320161e tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:24:11 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-3b76e5ca-3e3b-4387-8b8a-27eaf320161e tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:24:11 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-3b76e5ca-3e3b-4387-8b8a-27eaf320161e tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:24:11 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-3b76e5ca-3e3b-4387-8b8a-27eaf320161e tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:24:11 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-3b76e5ca-3e3b-4387-8b8a-27eaf320161e tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:24:11 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-3b76e5ca-3e3b-4387-8b8a-27eaf320161e tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:24:11 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-3b76e5ca-3e3b-4387-8b8a-27eaf320161e tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:24:11 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-3b76e5ca-3e3b-4387-8b8a-27eaf320161e tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:24:12 user devstack@n-api.service[62053]: DEBUG nova.policy [None req-3b76e5ca-3e3b-4387-8b8a-27eaf320161e tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf19848229f45baad45c490cf539508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7061f2f041954ffe90b0c87b422890e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62053) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:24:12 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-3b76e5ca-3e3b-4387-8b8a-27eaf320161e tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bbcccf4b-e861-4254-9be3-a491776214e9" status: 200 len: 1670 microversion: 2.1 time: 0.297629 Apr 13 16:24:12 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 102/309] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:24:11 2023] GET /compute/v2.1/servers/bbcccf4b-e861-4254-9be3-a491776214e9 => generated 1670 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:24:13 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-63931994-bd38-48bc-92d0-bc5593969d2c req-45373634-1ecc-44f5-8787-215454a31626 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c6d8096-853b-4091-ad82-6faf8ffc85fa", "name": "network-vif-plugged", "status": "completed", "tag": "385dec44-4145-4606-b0af-30fbc721eb2c"}, {"server_uuid": "8c6d8096-853b-4091-ad82-6faf8ffc85fa", "name": "network-vif-deleted", "tag": "385dec44-4145-4606-b0af-30fbc721eb2c"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:24:13 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-63931994-bd38-48bc-92d0-bc5593969d2c req-45373634-1ecc-44f5-8787-215454a31626 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:24:13 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-63931994-bd38-48bc-92d0-bc5593969d2c req-45373634-1ecc-44f5-8787-215454a31626 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:24:13 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-63931994-bd38-48bc-92d0-bc5593969d2c req-45373634-1ecc-44f5-8787-215454a31626 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:24:13 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-63931994-bd38-48bc-92d0-bc5593969d2c req-45373634-1ecc-44f5-8787-215454a31626 service nova] Creating event network-vif-plugged:385dec44-4145-4606-b0af-30fbc721eb2c for instance 8c6d8096-853b-4091-ad82-6faf8ffc85fa on user Apr 13 16:24:13 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-63931994-bd38-48bc-92d0-bc5593969d2c req-45373634-1ecc-44f5-8787-215454a31626 service nova] Creating event network-vif-deleted:385dec44-4145-4606-b0af-30fbc721eb2c for instance 8c6d8096-853b-4091-ad82-6faf8ffc85fa on user Apr 13 16:24:13 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [req-63931994-bd38-48bc-92d0-bc5593969d2c req-45373634-1ecc-44f5-8787-215454a31626 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.048623 Apr 13 16:24:13 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 104/310] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:24:13 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:24:13 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-30b22484-126b-40b4-b414-458ea9c9b28b tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dc7649d3-fc59-438d-b230-72c4ce61e722"}} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:24:13 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-30b22484-126b-40b4-b414-458ea9c9b28b tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:24:13 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-30b22484-126b-40b4-b414-458ea9c9b28b tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:24:13 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-30b22484-126b-40b4-b414-458ea9c9b28b tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:24:13 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-30b22484-126b-40b4-b414-458ea9c9b28b tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:24:13 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-30b22484-126b-40b4-b414-458ea9c9b28b tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:24:13 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-30b22484-126b-40b4-b414-458ea9c9b28b tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:24:13 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-30b22484-126b-40b4-b414-458ea9c9b28b tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:24:13 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-12940eac-2163-4dc4-82d0-7f17e820dcc7 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:24:13 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-12940eac-2163-4dc4-82d0-7f17e820dcc7 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:24:13 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-12940eac-2163-4dc4-82d0-7f17e820dcc7 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:24:13 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-12940eac-2163-4dc4-82d0-7f17e820dcc7 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:24:13 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-12940eac-2163-4dc4-82d0-7f17e820dcc7 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:24:13 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-12940eac-2163-4dc4-82d0-7f17e820dcc7 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:24:13 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-12940eac-2163-4dc4-82d0-7f17e820dcc7 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:24:13 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-12940eac-2163-4dc4-82d0-7f17e820dcc7 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:24:13 user devstack@n-api.service[62053]: INFO nova.api.openstack.wsgi [None req-12940eac-2163-4dc4-82d0-7f17e820dcc7 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] HTTP exception thrown: Instance e4ada2d7-7ace-4ed4-86a6-ed121c95e80f could not be found. Apr 13 16:24:13 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-12940eac-2163-4dc4-82d0-7f17e820dcc7 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Request method failure captured: Apr 13 16:24:13 user devstack@n-api.service[62053]: request: DELETE /compute/v2.1/servers/e4ada2d7-7ace-4ed4-86a6-ed121c95e80f HTTP/1.1 Apr 13 16:24:13 user devstack@n-api.service[62053]: Accept: application/json Apr 13 16:24:13 user devstack@n-api.service[62053]: Accept-Encoding: identity Apr 13 16:24:13 user devstack@n-api.service[62053]: Connection: close Apr 13 16:24:13 user devstack@n-api.service[62053]: Content-Length: 0 Apr 13 16:24:13 user devstack@n-api.service[62053]: Content-Type: application/json Apr 13 16:24:13 user devstack@n-api.service[62053]: Host: 10.0.0.210 Apr 13 16:24:13 user devstack@n-api.service[62053]: Openstack-System-Scope: None Apr 13 16:24:13 user devstack@n-api.service[62053]: User-Agent: python-urllib3/1.26.15 Apr 13 16:24:13 user devstack@n-api.service[62053]: X-Auth-Token: gAAAAABkOCu-wAxM0Gn4zSDnueR8st1Sg_5YD68vrnbQd6srDw8B0rWyntxDST5WJwwjFtF9f8pCWtyEZgXfnLaDzj7-YlJrNDYzdYb6UZXLmMXC6nNwGSJuYkG1WtfAD8ivnOICOu9q-_aSxLYXqQz2Rj47bbO8aun-CJEzeo6PizEUSRJRqfo Apr 13 16:24:13 user devstack@n-api.service[62053]: X-Domain-Id: None Apr 13 16:24:13 user devstack@n-api.service[62053]: X-Domain-Name: None Apr 13 16:24:13 user devstack@n-api.service[62053]: X-Identity-Status: Confirmed Apr 13 16:24:13 user devstack@n-api.service[62053]: X-Is-Admin-Project: True Apr 13 16:24:13 user devstack@n-api.service[62053]: X-Openstack-Nova-Api-Version: 2.42 Apr 13 16:24:13 user devstack@n-api.service[62053]: X-Project-Domain-Id: default Apr 13 16:24:13 user devstack@n-api.service[62053]: X-Project-Domain-Name: Default Apr 13 16:24:13 user devstack@n-api.service[62053]: X-Project-Id: 7649e366b0164e2fa5b3faa0830b6ea6 Apr 13 16:24:13 user devstack@n-api.service[62053]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1193811043 Apr 13 16:24:13 user devstack@n-api.service[62053]: X-Role: reader,member Apr 13 16:24:13 user devstack@n-api.service[62053]: X-Roles: reader,member Apr 13 16:24:13 user devstack@n-api.service[62053]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/7649e366b0164e2fa5b3faa0830b6ea6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7649e366b0164e2fa5b3faa0830b6ea6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7649e366b0164e2fa5b3faa0830b6ea6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 13 16:24:13 user devstack@n-api.service[62053]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1193811043 Apr 13 16:24:13 user devstack@n-api.service[62053]: X-Tenant-Id: 7649e366b0164e2fa5b3faa0830b6ea6 Apr 13 16:24:13 user devstack@n-api.service[62053]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1193811043 Apr 13 16:24:13 user devstack@n-api.service[62053]: X-User: tempest-TaggedBootDevicesTest_v242-1193811043-project-member Apr 13 16:24:13 user devstack@n-api.service[62053]: X-User-Domain-Id: default Apr 13 16:24:13 user devstack@n-api.service[62053]: X-User-Domain-Name: Default Apr 13 16:24:13 user devstack@n-api.service[62053]: X-User-Id: 7e50bd9d540549a194f706dac48ce93d Apr 13 16:24:13 user devstack@n-api.service[62053]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1193811043-project-member Apr 13 16:24:13 user devstack@n-api.service[62053]: method: > Apr 13 16:24:13 user devstack@n-api.service[62053]: exception: Instance e4ada2d7-7ace-4ed4-86a6-ed121c95e80f could not be found. Apr 13 16:24:13 user devstack@n-api.service[62053]: action_args: {'id': 'e4ada2d7-7ace-4ed4-86a6-ed121c95e80f'} Apr 13 16:24:13 user devstack@n-api.service[62053]: {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 16:24:13 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:24:13 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 16:24:13 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 16:24:13 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 16:24:13 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 16:24:13 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 16:24:13 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 16:24:13 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 16:24:13 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 16:24:13 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4ada2d7-7ace-4ed4-86a6-ed121c95e80f could not be found. Apr 13 16:24:13 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:24:13 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:24:13 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:24:13 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:24:13 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 16:24:13 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 16:24:13 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 16:24:13 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 16:24:13 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 16:24:13 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 16:24:13 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 16:24:13 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 16:24:13 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 16:24:13 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 16:24:13 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 16:24:13 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 16:24:13 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 16:24:13 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 16:24:13 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4ada2d7-7ace-4ed4-86a6-ed121c95e80f could not be found. Apr 13 16:24:13 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:24:13 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:24:13 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:24:13 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:24:13 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 16:24:13 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 16:24:13 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 16:24:13 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 16:24:13 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4ada2d7-7ace-4ed4-86a6-ed121c95e80f could not be found. Apr 13 16:24:13 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:24:13 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-12940eac-2163-4dc4-82d0-7f17e820dcc7 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Returning 404 to user: Instance e4ada2d7-7ace-4ed4-86a6-ed121c95e80f could not be found. {{(pid=62053) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 16:24:13 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-12940eac-2163-4dc4-82d0-7f17e820dcc7 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e4ada2d7-7ace-4ed4-86a6-ed121c95e80f" status: 404 len: 111 microversion: 2.42 time: 0.036874 Apr 13 16:24:13 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 103/311] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 13 16:24:13 2023] DELETE /compute/v2.1/servers/e4ada2d7-7ace-4ed4-86a6-ed121c95e80f => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 13 16:24:13 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-d0597aa8-6e07-4079-8b78-1ce52b377796 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:24:13 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-d0597aa8-6e07-4079-8b78-1ce52b377796 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:24:13 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-d0597aa8-6e07-4079-8b78-1ce52b377796 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:24:13 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-d0597aa8-6e07-4079-8b78-1ce52b377796 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:24:13 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-d0597aa8-6e07-4079-8b78-1ce52b377796 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:24:13 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-d0597aa8-6e07-4079-8b78-1ce52b377796 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:24:13 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-d0597aa8-6e07-4079-8b78-1ce52b377796 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:24:13 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-d0597aa8-6e07-4079-8b78-1ce52b377796 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:24:13 user devstack@n-api.service[62054]: INFO nova.api.openstack.wsgi [None req-d0597aa8-6e07-4079-8b78-1ce52b377796 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] HTTP exception thrown: Instance e4ada2d7-7ace-4ed4-86a6-ed121c95e80f could not be found. Apr 13 16:24:13 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-d0597aa8-6e07-4079-8b78-1ce52b377796 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Request method failure captured: Apr 13 16:24:13 user devstack@n-api.service[62054]: request: GET /compute/v2.1/servers/e4ada2d7-7ace-4ed4-86a6-ed121c95e80f HTTP/1.1 Apr 13 16:24:13 user devstack@n-api.service[62054]: Accept: application/json Apr 13 16:24:13 user devstack@n-api.service[62054]: Accept-Encoding: identity Apr 13 16:24:13 user devstack@n-api.service[62054]: Connection: close Apr 13 16:24:13 user devstack@n-api.service[62054]: Content-Length: 0 Apr 13 16:24:13 user devstack@n-api.service[62054]: Content-Type: application/json Apr 13 16:24:13 user devstack@n-api.service[62054]: Host: 10.0.0.210 Apr 13 16:24:13 user devstack@n-api.service[62054]: Openstack-System-Scope: None Apr 13 16:24:13 user devstack@n-api.service[62054]: User-Agent: python-urllib3/1.26.15 Apr 13 16:24:13 user devstack@n-api.service[62054]: X-Auth-Token: gAAAAABkOCu-wAxM0Gn4zSDnueR8st1Sg_5YD68vrnbQd6srDw8B0rWyntxDST5WJwwjFtF9f8pCWtyEZgXfnLaDzj7-YlJrNDYzdYb6UZXLmMXC6nNwGSJuYkG1WtfAD8ivnOICOu9q-_aSxLYXqQz2Rj47bbO8aun-CJEzeo6PizEUSRJRqfo Apr 13 16:24:13 user devstack@n-api.service[62054]: X-Domain-Id: None Apr 13 16:24:13 user devstack@n-api.service[62054]: X-Domain-Name: None Apr 13 16:24:13 user devstack@n-api.service[62054]: X-Identity-Status: Confirmed Apr 13 16:24:13 user devstack@n-api.service[62054]: X-Is-Admin-Project: True Apr 13 16:24:13 user devstack@n-api.service[62054]: X-Openstack-Nova-Api-Version: 2.42 Apr 13 16:24:13 user devstack@n-api.service[62054]: X-Project-Domain-Id: default Apr 13 16:24:13 user devstack@n-api.service[62054]: X-Project-Domain-Name: Default Apr 13 16:24:13 user devstack@n-api.service[62054]: X-Project-Id: 7649e366b0164e2fa5b3faa0830b6ea6 Apr 13 16:24:13 user devstack@n-api.service[62054]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1193811043 Apr 13 16:24:13 user devstack@n-api.service[62054]: X-Role: reader,member Apr 13 16:24:13 user devstack@n-api.service[62054]: X-Roles: reader,member Apr 13 16:24:13 user devstack@n-api.service[62054]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/7649e366b0164e2fa5b3faa0830b6ea6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7649e366b0164e2fa5b3faa0830b6ea6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7649e366b0164e2fa5b3faa0830b6ea6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 13 16:24:13 user devstack@n-api.service[62054]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1193811043 Apr 13 16:24:13 user devstack@n-api.service[62054]: X-Tenant-Id: 7649e366b0164e2fa5b3faa0830b6ea6 Apr 13 16:24:13 user devstack@n-api.service[62054]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1193811043 Apr 13 16:24:13 user devstack@n-api.service[62054]: X-User: tempest-TaggedBootDevicesTest_v242-1193811043-project-member Apr 13 16:24:13 user devstack@n-api.service[62054]: X-User-Domain-Id: default Apr 13 16:24:13 user devstack@n-api.service[62054]: X-User-Domain-Name: Default Apr 13 16:24:13 user devstack@n-api.service[62054]: X-User-Id: 7e50bd9d540549a194f706dac48ce93d Apr 13 16:24:13 user devstack@n-api.service[62054]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1193811043-project-member Apr 13 16:24:13 user devstack@n-api.service[62054]: method: > Apr 13 16:24:13 user devstack@n-api.service[62054]: exception: Instance e4ada2d7-7ace-4ed4-86a6-ed121c95e80f could not be found. Apr 13 16:24:13 user devstack@n-api.service[62054]: action_args: {'id': 'e4ada2d7-7ace-4ed4-86a6-ed121c95e80f'} Apr 13 16:24:13 user devstack@n-api.service[62054]: {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 16:24:13 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:24:13 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 16:24:13 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 16:24:13 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 16:24:13 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 16:24:13 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 16:24:13 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 16:24:13 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 16:24:13 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 16:24:13 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4ada2d7-7ace-4ed4-86a6-ed121c95e80f could not be found. Apr 13 16:24:13 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:24:13 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:24:13 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:24:13 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:24:13 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 16:24:13 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 16:24:13 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 16:24:13 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 16:24:13 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 16:24:13 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 16:24:13 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 16:24:13 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 16:24:13 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 16:24:13 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 16:24:13 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 16:24:13 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 16:24:13 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4ada2d7-7ace-4ed4-86a6-ed121c95e80f could not be found. Apr 13 16:24:13 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:24:13 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:24:13 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:24:13 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:24:13 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 16:24:13 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 16:24:13 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 16:24:13 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 16:24:13 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4ada2d7-7ace-4ed4-86a6-ed121c95e80f could not be found. Apr 13 16:24:13 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:24:13 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-d0597aa8-6e07-4079-8b78-1ce52b377796 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Returning 404 to user: Instance e4ada2d7-7ace-4ed4-86a6-ed121c95e80f could not be found. {{(pid=62054) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 16:24:13 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-d0597aa8-6e07-4079-8b78-1ce52b377796 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e4ada2d7-7ace-4ed4-86a6-ed121c95e80f" status: 404 len: 111 microversion: 2.42 time: 0.033863 Apr 13 16:24:13 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 105/312] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 16:24:13 2023] GET /compute/v2.1/servers/e4ada2d7-7ace-4ed4-86a6-ed121c95e80f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 13 16:24:13 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-f0135f9f-de65-4c94-a910-b1e7e567457f req-0462d9a4-b88a-4eac-bd0b-2f1e24aed93f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eaae47b9-a059-49f6-9ae6-d7147003e2f2", "tag": "e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:24:13 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-f0135f9f-de65-4c94-a910-b1e7e567457f req-0462d9a4-b88a-4eac-bd0b-2f1e24aed93f service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:24:13 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-f0135f9f-de65-4c94-a910-b1e7e567457f req-0462d9a4-b88a-4eac-bd0b-2f1e24aed93f service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:24:13 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-f0135f9f-de65-4c94-a910-b1e7e567457f req-0462d9a4-b88a-4eac-bd0b-2f1e24aed93f service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:24:13 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-f0135f9f-de65-4c94-a910-b1e7e567457f req-0462d9a4-b88a-4eac-bd0b-2f1e24aed93f service nova] Creating event network-changed:e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae for instance eaae47b9-a059-49f6-9ae6-d7147003e2f2 on user Apr 13 16:24:13 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [req-f0135f9f-de65-4c94-a910-b1e7e567457f req-0462d9a4-b88a-4eac-bd0b-2f1e24aed93f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033498 Apr 13 16:24:13 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 104/313] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:24:13 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:24:13 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-30b22484-126b-40b4-b414-458ea9c9b28b tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] 10.0.0.210 "POST /compute/v2.1/servers/bbcccf4b-e861-4254-9be3-a491776214e9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.339794 Apr 13 16:24:13 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 105/314] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 16:24:13 2023] POST /compute/v2.1/servers/bbcccf4b-e861-4254-9be3-a491776214e9/os-volume_attachments => generated 194 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:24:15 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-e75961cd-6637-4bde-9885-8cfe89a6573d tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:24:15 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-e75961cd-6637-4bde-9885-8cfe89a6573d tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:24:15 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-e75961cd-6637-4bde-9885-8cfe89a6573d tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:24:15 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-e75961cd-6637-4bde-9885-8cfe89a6573d tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:24:15 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-e75961cd-6637-4bde-9885-8cfe89a6573d tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:24:15 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-e75961cd-6637-4bde-9885-8cfe89a6573d tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:24:15 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-e75961cd-6637-4bde-9885-8cfe89a6573d tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:24:15 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-e75961cd-6637-4bde-9885-8cfe89a6573d tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:24:15 user devstack@n-api.service[62054]: INFO nova.api.openstack.wsgi [None req-e75961cd-6637-4bde-9885-8cfe89a6573d tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] HTTP exception thrown: Instance 2549ba85-4e0a-420e-b711-07cafa8c60e9 could not be found. Apr 13 16:24:15 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-e75961cd-6637-4bde-9885-8cfe89a6573d tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Request method failure captured: Apr 13 16:24:15 user devstack@n-api.service[62054]: request: DELETE /compute/v2.1/servers/2549ba85-4e0a-420e-b711-07cafa8c60e9 HTTP/1.1 Apr 13 16:24:15 user devstack@n-api.service[62054]: Accept: application/json Apr 13 16:24:15 user devstack@n-api.service[62054]: Accept-Encoding: identity Apr 13 16:24:15 user devstack@n-api.service[62054]: Connection: close Apr 13 16:24:15 user devstack@n-api.service[62054]: Content-Length: 0 Apr 13 16:24:15 user devstack@n-api.service[62054]: Content-Type: application/json Apr 13 16:24:15 user devstack@n-api.service[62054]: Host: 10.0.0.210 Apr 13 16:24:15 user devstack@n-api.service[62054]: Openstack-System-Scope: None Apr 13 16:24:15 user devstack@n-api.service[62054]: User-Agent: python-urllib3/1.26.15 Apr 13 16:24:15 user devstack@n-api.service[62054]: X-Auth-Token: gAAAAABkOCvA4uta2umNckq53p52lHtS_qqM3nkYDSSDXN_5FRLHkUwlB0tEoWAN5dLy4Ty2G50HndGjpN0NH-X4_NVyF6jAH0EhQEHJdihx42ssBQFi9mCEYwORrKVlKIwcytv9aCHVcaNadZucBTSK3u3ttVLrJXVQfai-9k_rqig6BBeiX04 Apr 13 16:24:15 user devstack@n-api.service[62054]: X-Domain-Id: None Apr 13 16:24:15 user devstack@n-api.service[62054]: X-Domain-Name: None Apr 13 16:24:15 user devstack@n-api.service[62054]: X-Identity-Status: Confirmed Apr 13 16:24:15 user devstack@n-api.service[62054]: X-Is-Admin-Project: True Apr 13 16:24:15 user devstack@n-api.service[62054]: X-Openstack-Nova-Api-Version: 2.32 Apr 13 16:24:15 user devstack@n-api.service[62054]: X-Project-Domain-Id: default Apr 13 16:24:15 user devstack@n-api.service[62054]: X-Project-Domain-Name: Default Apr 13 16:24:15 user devstack@n-api.service[62054]: X-Project-Id: bbe4e9fb786d4015b035b4d00f75a1ba Apr 13 16:24:15 user devstack@n-api.service[62054]: X-Project-Name: tempest-TaggedBootDevicesTest-1779812468 Apr 13 16:24:15 user devstack@n-api.service[62054]: X-Role: reader,member Apr 13 16:24:15 user devstack@n-api.service[62054]: X-Roles: reader,member Apr 13 16:24:15 user devstack@n-api.service[62054]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/bbe4e9fb786d4015b035b4d00f75a1ba"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bbe4e9fb786d4015b035b4d00f75a1ba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bbe4e9fb786d4015b035b4d00f75a1ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 13 16:24:15 user devstack@n-api.service[62054]: X-Tenant: tempest-TaggedBootDevicesTest-1779812468 Apr 13 16:24:15 user devstack@n-api.service[62054]: X-Tenant-Id: bbe4e9fb786d4015b035b4d00f75a1ba Apr 13 16:24:15 user devstack@n-api.service[62054]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1779812468 Apr 13 16:24:15 user devstack@n-api.service[62054]: X-User: tempest-TaggedBootDevicesTest-1779812468-project-member Apr 13 16:24:15 user devstack@n-api.service[62054]: X-User-Domain-Id: default Apr 13 16:24:15 user devstack@n-api.service[62054]: X-User-Domain-Name: Default Apr 13 16:24:15 user devstack@n-api.service[62054]: X-User-Id: 14566b85d0424c08999726ff72a67634 Apr 13 16:24:15 user devstack@n-api.service[62054]: X-User-Name: tempest-TaggedBootDevicesTest-1779812468-project-member Apr 13 16:24:15 user devstack@n-api.service[62054]: method: > Apr 13 16:24:15 user devstack@n-api.service[62054]: exception: Instance 2549ba85-4e0a-420e-b711-07cafa8c60e9 could not be found. Apr 13 16:24:15 user devstack@n-api.service[62054]: action_args: {'id': '2549ba85-4e0a-420e-b711-07cafa8c60e9'} Apr 13 16:24:15 user devstack@n-api.service[62054]: {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 16:24:15 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:24:15 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 16:24:15 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 16:24:15 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 16:24:15 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 16:24:15 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 16:24:15 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 16:24:15 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 16:24:15 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 16:24:15 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2549ba85-4e0a-420e-b711-07cafa8c60e9 could not be found. Apr 13 16:24:15 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:24:15 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:24:15 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:24:15 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:24:15 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 16:24:15 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 16:24:15 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 16:24:15 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 16:24:15 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 16:24:15 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 16:24:15 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 16:24:15 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 16:24:15 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 16:24:15 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 16:24:15 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 16:24:15 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 16:24:15 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 16:24:15 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 16:24:15 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2549ba85-4e0a-420e-b711-07cafa8c60e9 could not be found. Apr 13 16:24:15 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:24:15 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:24:15 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:24:15 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:24:15 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 16:24:15 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 16:24:15 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 16:24:15 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 16:24:15 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2549ba85-4e0a-420e-b711-07cafa8c60e9 could not be found. Apr 13 16:24:15 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:24:15 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-e75961cd-6637-4bde-9885-8cfe89a6573d tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Returning 404 to user: Instance 2549ba85-4e0a-420e-b711-07cafa8c60e9 could not be found. {{(pid=62054) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 16:24:15 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-e75961cd-6637-4bde-9885-8cfe89a6573d tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/2549ba85-4e0a-420e-b711-07cafa8c60e9" status: 404 len: 111 microversion: 2.32 time: 0.039251 Apr 13 16:24:15 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 106/315] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 13 16:24:15 2023] DELETE /compute/v2.1/servers/2549ba85-4e0a-420e-b711-07cafa8c60e9 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 13 16:24:15 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-0dd7cfe1-b3da-43e8-bd0b-9a7daa904a0d tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:24:15 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-0dd7cfe1-b3da-43e8-bd0b-9a7daa904a0d tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:24:15 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-0dd7cfe1-b3da-43e8-bd0b-9a7daa904a0d tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:24:15 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-0dd7cfe1-b3da-43e8-bd0b-9a7daa904a0d tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:24:15 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-0dd7cfe1-b3da-43e8-bd0b-9a7daa904a0d tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:24:15 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-0dd7cfe1-b3da-43e8-bd0b-9a7daa904a0d tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:24:15 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-0dd7cfe1-b3da-43e8-bd0b-9a7daa904a0d tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:24:15 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-0dd7cfe1-b3da-43e8-bd0b-9a7daa904a0d tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:24:15 user devstack@n-api.service[62053]: INFO nova.api.openstack.wsgi [None req-0dd7cfe1-b3da-43e8-bd0b-9a7daa904a0d tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] HTTP exception thrown: Instance 2549ba85-4e0a-420e-b711-07cafa8c60e9 could not be found. Apr 13 16:24:15 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-0dd7cfe1-b3da-43e8-bd0b-9a7daa904a0d tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Request method failure captured: Apr 13 16:24:15 user devstack@n-api.service[62053]: request: GET /compute/v2.1/servers/2549ba85-4e0a-420e-b711-07cafa8c60e9 HTTP/1.1 Apr 13 16:24:15 user devstack@n-api.service[62053]: Accept: application/json Apr 13 16:24:15 user devstack@n-api.service[62053]: Accept-Encoding: identity Apr 13 16:24:15 user devstack@n-api.service[62053]: Connection: close Apr 13 16:24:15 user devstack@n-api.service[62053]: Content-Length: 0 Apr 13 16:24:15 user devstack@n-api.service[62053]: Content-Type: application/json Apr 13 16:24:15 user devstack@n-api.service[62053]: Host: 10.0.0.210 Apr 13 16:24:15 user devstack@n-api.service[62053]: Openstack-System-Scope: None Apr 13 16:24:15 user devstack@n-api.service[62053]: User-Agent: python-urllib3/1.26.15 Apr 13 16:24:15 user devstack@n-api.service[62053]: X-Auth-Token: gAAAAABkOCvA4uta2umNckq53p52lHtS_qqM3nkYDSSDXN_5FRLHkUwlB0tEoWAN5dLy4Ty2G50HndGjpN0NH-X4_NVyF6jAH0EhQEHJdihx42ssBQFi9mCEYwORrKVlKIwcytv9aCHVcaNadZucBTSK3u3ttVLrJXVQfai-9k_rqig6BBeiX04 Apr 13 16:24:15 user devstack@n-api.service[62053]: X-Domain-Id: None Apr 13 16:24:15 user devstack@n-api.service[62053]: X-Domain-Name: None Apr 13 16:24:15 user devstack@n-api.service[62053]: X-Identity-Status: Confirmed Apr 13 16:24:15 user devstack@n-api.service[62053]: X-Is-Admin-Project: True Apr 13 16:24:15 user devstack@n-api.service[62053]: X-Openstack-Nova-Api-Version: 2.32 Apr 13 16:24:15 user devstack@n-api.service[62053]: X-Project-Domain-Id: default Apr 13 16:24:15 user devstack@n-api.service[62053]: X-Project-Domain-Name: Default Apr 13 16:24:15 user devstack@n-api.service[62053]: X-Project-Id: bbe4e9fb786d4015b035b4d00f75a1ba Apr 13 16:24:15 user devstack@n-api.service[62053]: X-Project-Name: tempest-TaggedBootDevicesTest-1779812468 Apr 13 16:24:15 user devstack@n-api.service[62053]: X-Role: reader,member Apr 13 16:24:15 user devstack@n-api.service[62053]: X-Roles: reader,member Apr 13 16:24:15 user devstack@n-api.service[62053]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/bbe4e9fb786d4015b035b4d00f75a1ba"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bbe4e9fb786d4015b035b4d00f75a1ba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bbe4e9fb786d4015b035b4d00f75a1ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 13 16:24:15 user devstack@n-api.service[62053]: X-Tenant: tempest-TaggedBootDevicesTest-1779812468 Apr 13 16:24:15 user devstack@n-api.service[62053]: X-Tenant-Id: bbe4e9fb786d4015b035b4d00f75a1ba Apr 13 16:24:15 user devstack@n-api.service[62053]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1779812468 Apr 13 16:24:15 user devstack@n-api.service[62053]: X-User: tempest-TaggedBootDevicesTest-1779812468-project-member Apr 13 16:24:15 user devstack@n-api.service[62053]: X-User-Domain-Id: default Apr 13 16:24:15 user devstack@n-api.service[62053]: X-User-Domain-Name: Default Apr 13 16:24:15 user devstack@n-api.service[62053]: X-User-Id: 14566b85d0424c08999726ff72a67634 Apr 13 16:24:15 user devstack@n-api.service[62053]: X-User-Name: tempest-TaggedBootDevicesTest-1779812468-project-member Apr 13 16:24:15 user devstack@n-api.service[62053]: method: > Apr 13 16:24:15 user devstack@n-api.service[62053]: exception: Instance 2549ba85-4e0a-420e-b711-07cafa8c60e9 could not be found. Apr 13 16:24:15 user devstack@n-api.service[62053]: action_args: {'id': '2549ba85-4e0a-420e-b711-07cafa8c60e9'} Apr 13 16:24:15 user devstack@n-api.service[62053]: {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 16:24:15 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:24:15 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 16:24:15 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 16:24:15 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 16:24:15 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 16:24:15 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 16:24:15 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 16:24:15 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 16:24:15 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 16:24:15 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2549ba85-4e0a-420e-b711-07cafa8c60e9 could not be found. Apr 13 16:24:15 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:24:15 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:24:15 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:24:15 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:24:15 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 16:24:15 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 16:24:15 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 16:24:15 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 16:24:15 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 16:24:15 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 16:24:15 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 16:24:15 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 16:24:15 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 16:24:15 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 16:24:15 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 16:24:15 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 16:24:15 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2549ba85-4e0a-420e-b711-07cafa8c60e9 could not be found. Apr 13 16:24:15 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:24:15 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:24:15 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:24:15 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:24:15 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 16:24:15 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 16:24:15 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 16:24:15 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 16:24:15 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2549ba85-4e0a-420e-b711-07cafa8c60e9 could not be found. Apr 13 16:24:15 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:24:15 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-0dd7cfe1-b3da-43e8-bd0b-9a7daa904a0d tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Returning 404 to user: Instance 2549ba85-4e0a-420e-b711-07cafa8c60e9 could not be found. {{(pid=62053) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 16:24:15 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-0dd7cfe1-b3da-43e8-bd0b-9a7daa904a0d tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2549ba85-4e0a-420e-b711-07cafa8c60e9" status: 404 len: 111 microversion: 2.32 time: 0.042081 Apr 13 16:24:15 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 105/316] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 16:24:15 2023] GET /compute/v2.1/servers/2549ba85-4e0a-420e-b711-07cafa8c60e9 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 13 16:24:15 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [req-c6ff5f66-089e-4e0a-94df-2532b16b6015 req-e240cdeb-b861-4638-832e-7df1c76c6054 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eaae47b9-a059-49f6-9ae6-d7147003e2f2", "name": "network-vif-plugged", "status": "completed", "tag": "e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae"}]} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:24:16 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-c6ff5f66-089e-4e0a-94df-2532b16b6015 req-e240cdeb-b861-4638-832e-7df1c76c6054 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:24:16 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-c6ff5f66-089e-4e0a-94df-2532b16b6015 req-e240cdeb-b861-4638-832e-7df1c76c6054 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:24:16 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-c6ff5f66-089e-4e0a-94df-2532b16b6015 req-e240cdeb-b861-4638-832e-7df1c76c6054 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:24:16 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-c6ff5f66-089e-4e0a-94df-2532b16b6015 req-e240cdeb-b861-4638-832e-7df1c76c6054 service nova] Creating event network-vif-plugged:e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae for instance eaae47b9-a059-49f6-9ae6-d7147003e2f2 on user Apr 13 16:24:16 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [req-c6ff5f66-089e-4e0a-94df-2532b16b6015 req-e240cdeb-b861-4638-832e-7df1c76c6054 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059970 Apr 13 16:24:16 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 106/317] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:24:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:24:18 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-3010c500-35e5-4308-b97f-1a7aa2460409 req-0f83497c-3aba-41da-a0f5-c85430440c88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eaae47b9-a059-49f6-9ae6-d7147003e2f2", "name": "network-vif-plugged", "status": "completed", "tag": "e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:24:18 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:24:18 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-3010c500-35e5-4308-b97f-1a7aa2460409 req-0f83497c-3aba-41da-a0f5-c85430440c88 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:24:18 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-3010c500-35e5-4308-b97f-1a7aa2460409 req-0f83497c-3aba-41da-a0f5-c85430440c88 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:24:18 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-3010c500-35e5-4308-b97f-1a7aa2460409 req-0f83497c-3aba-41da-a0f5-c85430440c88 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:24:18 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:24:18 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-3010c500-35e5-4308-b97f-1a7aa2460409 req-0f83497c-3aba-41da-a0f5-c85430440c88 service nova] Creating event network-vif-plugged:e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae for instance eaae47b9-a059-49f6-9ae6-d7147003e2f2 on user Apr 13 16:24:18 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [req-3010c500-35e5-4308-b97f-1a7aa2460409 req-0f83497c-3aba-41da-a0f5-c85430440c88 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044204 Apr 13 16:24:18 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 107/318] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:24:18 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:24:20 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-3755b739-e2a4-466e-80a5-b987c1d387ca tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:24:20 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-3755b739-e2a4-466e-80a5-b987c1d387ca tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:24:20 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-3755b739-e2a4-466e-80a5-b987c1d387ca tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:24:20 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-3755b739-e2a4-466e-80a5-b987c1d387ca tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:24:20 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-3755b739-e2a4-466e-80a5-b987c1d387ca tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:24:20 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-3755b739-e2a4-466e-80a5-b987c1d387ca tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:24:20 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-3755b739-e2a4-466e-80a5-b987c1d387ca tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:24:20 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-3755b739-e2a4-466e-80a5-b987c1d387ca tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:24:20 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_cell1:SELECT=79,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:24:20 user devstack@n-api.service[62053]: DEBUG nova.policy [None req-3755b739-e2a4-466e-80a5-b987c1d387ca tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6a4bf1a7794af2958c3d53ea1e19c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed94fa5d89c2486b8e2951e608e6630f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62053) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:24:20 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-3755b739-e2a4-466e-80a5-b987c1d387ca tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bf350da4-9cc2-4900-adf0-506e44984b42" status: 200 len: 1497 microversion: 2.1 time: 0.215683 Apr 13 16:24:20 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 106/319] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:24:20 2023] GET /compute/v2.1/servers/bf350da4-9cc2-4900-adf0-506e44984b42 => generated 1497 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:24:21 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_cell0:SELECT=6 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:24:21 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-c59aef75-fef8-4210-84c0-80f2cc4308a1 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Action: 'action', calling method: >, body: {"rescue": {"rescue_image_ref": "fe56253b-3d7f-43e5-9008-6d9c17385e97"}} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:24:21 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-c59aef75-fef8-4210-84c0-80f2cc4308a1 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:24:21 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:INSERT=1,nova_api:DELETE=2 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:24:21 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-c59aef75-fef8-4210-84c0-80f2cc4308a1 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:24:21 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-c59aef75-fef8-4210-84c0-80f2cc4308a1 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:24:21 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-c59aef75-fef8-4210-84c0-80f2cc4308a1 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:24:21 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-c59aef75-fef8-4210-84c0-80f2cc4308a1 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:24:21 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-c59aef75-fef8-4210-84c0-80f2cc4308a1 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:24:21 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-c59aef75-fef8-4210-84c0-80f2cc4308a1 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:24:21 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:24:21 user devstack@n-api.service[62055]: DEBUG nova.objects.instance [None req-c59aef75-fef8-4210-84c0-80f2cc4308a1 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Lazy-loading 'flavor' on Instance uuid bbcccf4b-e861-4254-9be3-a491776214e9 {{(pid=62055) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 16:24:21 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-c59aef75-fef8-4210-84c0-80f2cc4308a1 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] 10.0.0.210 "POST /compute/v2.1/servers/bbcccf4b-e861-4254-9be3-a491776214e9/action" status: 200 len: 29 microversion: 2.1 time: 0.243711 Apr 13 16:24:21 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 107/320] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 16:24:21 2023] POST /compute/v2.1/servers/bbcccf4b-e861-4254-9be3-a491776214e9/action => generated 29 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 16:24:21 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_cell0:SELECT=2 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:24:21 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_cell0:SELECT=6 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:24:21 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-ac948093-fff9-4011-9633-296167a31b2e tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:24:21 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-ac948093-fff9-4011-9633-296167a31b2e tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:24:21 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-ac948093-fff9-4011-9633-296167a31b2e tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:24:21 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-ac948093-fff9-4011-9633-296167a31b2e tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:24:21 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-ac948093-fff9-4011-9633-296167a31b2e tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:24:21 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-ac948093-fff9-4011-9633-296167a31b2e tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:24:21 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-ac948093-fff9-4011-9633-296167a31b2e tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:24:21 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-ac948093-fff9-4011-9633-296167a31b2e tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:24:21 user devstack@n-api.service[62054]: DEBUG nova.policy [None req-ac948093-fff9-4011-9633-296167a31b2e tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf19848229f45baad45c490cf539508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7061f2f041954ffe90b0c87b422890e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62054) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:24:21 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-ac948093-fff9-4011-9633-296167a31b2e tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bbcccf4b-e861-4254-9be3-a491776214e9" status: 200 len: 1722 microversion: 2.1 time: 0.184030 Apr 13 16:24:21 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 108/321] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:24:21 2023] GET /compute/v2.1/servers/bbcccf4b-e861-4254-9be3-a491776214e9 => generated 1722 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:24:22 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-9fe30790-07da-4ff5-9e6c-69f187755605 req-f81a6b0d-76e2-42b2-a3d3-2c1fb64d7641 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbcccf4b-e861-4254-9be3-a491776214e9", "name": "network-vif-unplugged", "status": "completed", "tag": "dbb2bf27-5de3-499c-ba4d-87867912a143"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:24:22 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-9fe30790-07da-4ff5-9e6c-69f187755605 req-f81a6b0d-76e2-42b2-a3d3-2c1fb64d7641 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:24:22 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-9fe30790-07da-4ff5-9e6c-69f187755605 req-f81a6b0d-76e2-42b2-a3d3-2c1fb64d7641 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:24:22 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-9fe30790-07da-4ff5-9e6c-69f187755605 req-f81a6b0d-76e2-42b2-a3d3-2c1fb64d7641 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:24:22 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-9fe30790-07da-4ff5-9e6c-69f187755605 req-f81a6b0d-76e2-42b2-a3d3-2c1fb64d7641 service nova] Creating event network-vif-unplugged:dbb2bf27-5de3-499c-ba4d-87867912a143 for instance bbcccf4b-e861-4254-9be3-a491776214e9 on user Apr 13 16:24:22 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [req-9fe30790-07da-4ff5-9e6c-69f187755605 req-f81a6b0d-76e2-42b2-a3d3-2c1fb64d7641 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037933 Apr 13 16:24:22 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 107/322] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:24:22 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:24:23 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-bc73445b-6983-4463-a4c3-d4c14dc21ba6 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:24:23 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-bc73445b-6983-4463-a4c3-d4c14dc21ba6 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] [instance: 94a2b8c9-388d-454c-88a1-54d7a8506511] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:24:23 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-bc73445b-6983-4463-a4c3-d4c14dc21ba6 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:24:23 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-bc73445b-6983-4463-a4c3-d4c14dc21ba6 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:24:23 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-bc73445b-6983-4463-a4c3-d4c14dc21ba6 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:24:23 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-bc73445b-6983-4463-a4c3-d4c14dc21ba6 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:24:23 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-bc73445b-6983-4463-a4c3-d4c14dc21ba6 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:24:23 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-bc73445b-6983-4463-a4c3-d4c14dc21ba6 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:24:23 user devstack@n-api.service[62055]: DEBUG nova.policy [None req-bc73445b-6983-4463-a4c3-d4c14dc21ba6 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cf399757f544649fed18ee5a31d50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ded8a69b7e941f9bcdc502cfeed79db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62055) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:24:23 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-bc73445b-6983-4463-a4c3-d4c14dc21ba6 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] 10.0.0.210 "GET /compute/v2.1/servers/94a2b8c9-388d-454c-88a1-54d7a8506511" status: 200 len: 1497 microversion: 2.1 time: 0.162572 Apr 13 16:24:23 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 108/323] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:24:23 2023] GET /compute/v2.1/servers/94a2b8c9-388d-454c-88a1-54d7a8506511 => generated 1497 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:24:24 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-bdd3a409-88f6-4d3c-b631-1f9c02bc4d39 req-6ba1115f-f3e0-4236-9f3e-061b7cf8f1f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbcccf4b-e861-4254-9be3-a491776214e9", "name": "network-vif-plugged", "status": "completed", "tag": "dbb2bf27-5de3-499c-ba4d-87867912a143"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:24:24 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-bdd3a409-88f6-4d3c-b631-1f9c02bc4d39 req-6ba1115f-f3e0-4236-9f3e-061b7cf8f1f9 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:24:24 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-bdd3a409-88f6-4d3c-b631-1f9c02bc4d39 req-6ba1115f-f3e0-4236-9f3e-061b7cf8f1f9 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:24:24 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-bdd3a409-88f6-4d3c-b631-1f9c02bc4d39 req-6ba1115f-f3e0-4236-9f3e-061b7cf8f1f9 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:24:24 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-bdd3a409-88f6-4d3c-b631-1f9c02bc4d39 req-6ba1115f-f3e0-4236-9f3e-061b7cf8f1f9 service nova] Creating event network-vif-plugged:dbb2bf27-5de3-499c-ba4d-87867912a143 for instance bbcccf4b-e861-4254-9be3-a491776214e9 on user Apr 13 16:24:24 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [req-bdd3a409-88f6-4d3c-b631-1f9c02bc4d39 req-6ba1115f-f3e0-4236-9f3e-061b7cf8f1f9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047637 Apr 13 16:24:24 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 109/324] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:24:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:24:26 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-58dd711f-d3fe-4123-baeb-46c206a0dfe1 req-c0a161bd-cc9a-4d74-a753-4bbac26256df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbcccf4b-e861-4254-9be3-a491776214e9", "name": "network-vif-plugged", "status": "completed", "tag": "dbb2bf27-5de3-499c-ba4d-87867912a143"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:24:26 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-58dd711f-d3fe-4123-baeb-46c206a0dfe1 req-c0a161bd-cc9a-4d74-a753-4bbac26256df service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:24:26 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-58dd711f-d3fe-4123-baeb-46c206a0dfe1 req-c0a161bd-cc9a-4d74-a753-4bbac26256df service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:24:26 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-58dd711f-d3fe-4123-baeb-46c206a0dfe1 req-c0a161bd-cc9a-4d74-a753-4bbac26256df service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:24:26 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-58dd711f-d3fe-4123-baeb-46c206a0dfe1 req-c0a161bd-cc9a-4d74-a753-4bbac26256df service nova] Creating event network-vif-plugged:dbb2bf27-5de3-499c-ba4d-87867912a143 for instance bbcccf4b-e861-4254-9be3-a491776214e9 on user Apr 13 16:24:26 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [req-58dd711f-d3fe-4123-baeb-46c206a0dfe1 req-c0a161bd-cc9a-4d74-a753-4bbac26256df service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061376 Apr 13 16:24:26 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 108/325] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:24:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:24:29 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [req-78491418-97db-40ed-a83f-34f3ca74139d req-eb4653ea-884a-4ace-9f43-eb92c6eac277 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbcccf4b-e861-4254-9be3-a491776214e9", "name": "network-vif-plugged", "status": "completed", "tag": "dbb2bf27-5de3-499c-ba4d-87867912a143"}]} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:24:29 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-78491418-97db-40ed-a83f-34f3ca74139d req-eb4653ea-884a-4ace-9f43-eb92c6eac277 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:24:29 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-78491418-97db-40ed-a83f-34f3ca74139d req-eb4653ea-884a-4ace-9f43-eb92c6eac277 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:24:29 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-78491418-97db-40ed-a83f-34f3ca74139d req-eb4653ea-884a-4ace-9f43-eb92c6eac277 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:24:29 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-78491418-97db-40ed-a83f-34f3ca74139d req-eb4653ea-884a-4ace-9f43-eb92c6eac277 service nova] Creating event network-vif-plugged:dbb2bf27-5de3-499c-ba4d-87867912a143 for instance bbcccf4b-e861-4254-9be3-a491776214e9 on user Apr 13 16:24:29 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [req-78491418-97db-40ed-a83f-34f3ca74139d req-eb4653ea-884a-4ace-9f43-eb92c6eac277 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037916 Apr 13 16:24:29 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 109/326] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:24:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:24:31 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-7a48f37a-78fa-43c5-87a1-66f36bc0453b tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:24:31 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-7a48f37a-78fa-43c5-87a1-66f36bc0453b tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:24:31 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-7a48f37a-78fa-43c5-87a1-66f36bc0453b tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:24:31 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-7a48f37a-78fa-43c5-87a1-66f36bc0453b tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:24:31 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-7a48f37a-78fa-43c5-87a1-66f36bc0453b tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:24:31 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-7a48f37a-78fa-43c5-87a1-66f36bc0453b tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:24:31 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-7a48f37a-78fa-43c5-87a1-66f36bc0453b tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:24:31 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-7a48f37a-78fa-43c5-87a1-66f36bc0453b tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:24:31 user devstack@n-api.service[62054]: DEBUG nova.policy [None req-7a48f37a-78fa-43c5-87a1-66f36bc0453b tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b3df1c5c5d441819bcef89ed6966815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980559734a504574a83224deb7423c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62054) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:24:31 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-7a48f37a-78fa-43c5-87a1-66f36bc0453b tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] 10.0.0.210 "GET /compute/v2.1/servers/acbcaee0-a47b-4fee-8765-9b1c9597d515" status: 200 len: 1540 microversion: 2.1 time: 0.279924 Apr 13 16:24:31 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 110/327] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:24:31 2023] GET /compute/v2.1/servers/acbcaee0-a47b-4fee-8765-9b1c9597d515 => generated 1540 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:24:34 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-3c300310-faf5-410b-970c-7b692efdbc27 tempest-VolumesNegativeTest-643526956 tempest-VolumesNegativeTest-643526956-project-member] Action: 'create', calling method: .version_select at 0x7f96e4974c10>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1200392734", "metadata": {"Type": "work"}}} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:24:34 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-3c300310-faf5-410b-970c-7b692efdbc27 tempest-VolumesNegativeTest-643526956 tempest-VolumesNegativeTest-643526956-project-member] Request method failure captured: Apr 13 16:24:34 user devstack@n-api.service[62053]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 13 16:24:34 user devstack@n-api.service[62053]: Accept: application/json Apr 13 16:24:34 user devstack@n-api.service[62053]: Accept-Encoding: identity Apr 13 16:24:34 user devstack@n-api.service[62053]: Connection: close Apr 13 16:24:34 user devstack@n-api.service[62053]: Content-Length: 122 Apr 13 16:24:34 user devstack@n-api.service[62053]: Content-Type: application/json Apr 13 16:24:34 user devstack@n-api.service[62053]: Host: 10.0.0.210 Apr 13 16:24:34 user devstack@n-api.service[62053]: Openstack-System-Scope: None Apr 13 16:24:34 user devstack@n-api.service[62053]: User-Agent: python-urllib3/1.26.15 Apr 13 16:24:34 user devstack@n-api.service[62053]: X-Auth-Token: gAAAAABkOCzCeSOkm4i3u1bkenxzH-ulEk_kQRCEBmwRsjf3nW3w80vybGa62qFBzPRc-Ez8-HighgZOjcJ2OWNJJAU37wDS3NOTzhZ0K9F76XVEzxErId027aHy-vfeAqvREgrJMkgkyAdTKV5SZVkMosoYy38T_Hbhexk7SzL-SZbsp7m1TaQ Apr 13 16:24:34 user devstack@n-api.service[62053]: X-Domain-Id: None Apr 13 16:24:34 user devstack@n-api.service[62053]: X-Domain-Name: None Apr 13 16:24:34 user devstack@n-api.service[62053]: X-Identity-Status: Confirmed Apr 13 16:24:34 user devstack@n-api.service[62053]: X-Is-Admin-Project: True Apr 13 16:24:34 user devstack@n-api.service[62053]: X-Project-Domain-Id: default Apr 13 16:24:34 user devstack@n-api.service[62053]: X-Project-Domain-Name: Default Apr 13 16:24:34 user devstack@n-api.service[62053]: X-Project-Id: cc516f0a1f864d45bec1d132ddcee952 Apr 13 16:24:34 user devstack@n-api.service[62053]: X-Project-Name: tempest-VolumesNegativeTest-643526956 Apr 13 16:24:34 user devstack@n-api.service[62053]: X-Role: reader,member Apr 13 16:24:34 user devstack@n-api.service[62053]: X-Roles: reader,member Apr 13 16:24:34 user devstack@n-api.service[62053]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/cc516f0a1f864d45bec1d132ddcee952"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cc516f0a1f864d45bec1d132ddcee952"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cc516f0a1f864d45bec1d132ddcee952"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 13 16:24:34 user devstack@n-api.service[62053]: X-Tenant: tempest-VolumesNegativeTest-643526956 Apr 13 16:24:34 user devstack@n-api.service[62053]: X-Tenant-Id: cc516f0a1f864d45bec1d132ddcee952 Apr 13 16:24:34 user devstack@n-api.service[62053]: X-Tenant-Name: tempest-VolumesNegativeTest-643526956 Apr 13 16:24:34 user devstack@n-api.service[62053]: X-User: tempest-VolumesNegativeTest-643526956-project-member Apr 13 16:24:34 user devstack@n-api.service[62053]: X-User-Domain-Id: default Apr 13 16:24:34 user devstack@n-api.service[62053]: X-User-Domain-Name: Default Apr 13 16:24:34 user devstack@n-api.service[62053]: X-User-Id: 1df72b14c6f7470aa9b24618379533c2 Apr 13 16:24:34 user devstack@n-api.service[62053]: X-User-Name: tempest-VolumesNegativeTest-643526956-project-member Apr 13 16:24:34 user devstack@n-api.service[62053]: Apr 13 16:24:34 user devstack@n-api.service[62053]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1200392734", "metadata": {"Type": "work"}}} Apr 13 16:24:34 user devstack@n-api.service[62053]: method: Apr 13 16:24:34 user devstack@n-api.service[62053]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 13 16:24:34 user devstack@n-api.service[62053]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1200392734', 'metadata': {'Type': 'work'}}}} Apr 13 16:24:34 user devstack@n-api.service[62053]: {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi raise error Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi '#$%' Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:24:34 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-3c300310-faf5-410b-970c-7b692efdbc27 tempest-VolumesNegativeTest-643526956 tempest-VolumesNegativeTest-643526956-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=62053) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 16:24:34 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-3c300310-faf5-410b-970c-7b692efdbc27 tempest-VolumesNegativeTest-643526956 tempest-VolumesNegativeTest-643526956-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.115335 Apr 13 16:24:34 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 109/328] 10.0.0.210 () {64 vars in 1233 bytes} [Thu Apr 13 16:24:34 2023] POST /compute/v2.1/os-volumes => generated 127 bytes in 117 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Apr 13 16:24:34 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-73796aef-607d-4eb8-b84c-49a4839fe5d8 tempest-VolumesNegativeTest-643526956 tempest-VolumesNegativeTest-643526956-project-member] Action: 'create', calling method: .version_select at 0x7f96e4aa3f40>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-918555173", "metadata": {"Type": "work"}}} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:24:34 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-73796aef-607d-4eb8-b84c-49a4839fe5d8 tempest-VolumesNegativeTest-643526956 tempest-VolumesNegativeTest-643526956-project-member] Request method failure captured: Apr 13 16:24:34 user devstack@n-api.service[62055]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 13 16:24:34 user devstack@n-api.service[62055]: Accept: application/json Apr 13 16:24:34 user devstack@n-api.service[62055]: Accept-Encoding: identity Apr 13 16:24:34 user devstack@n-api.service[62055]: Connection: close Apr 13 16:24:34 user devstack@n-api.service[62055]: Content-Length: 119 Apr 13 16:24:34 user devstack@n-api.service[62055]: Content-Type: application/json Apr 13 16:24:34 user devstack@n-api.service[62055]: Host: 10.0.0.210 Apr 13 16:24:34 user devstack@n-api.service[62055]: Openstack-System-Scope: None Apr 13 16:24:34 user devstack@n-api.service[62055]: User-Agent: python-urllib3/1.26.15 Apr 13 16:24:34 user devstack@n-api.service[62055]: X-Auth-Token: gAAAAABkOCzCeSOkm4i3u1bkenxzH-ulEk_kQRCEBmwRsjf3nW3w80vybGa62qFBzPRc-Ez8-HighgZOjcJ2OWNJJAU37wDS3NOTzhZ0K9F76XVEzxErId027aHy-vfeAqvREgrJMkgkyAdTKV5SZVkMosoYy38T_Hbhexk7SzL-SZbsp7m1TaQ Apr 13 16:24:34 user devstack@n-api.service[62055]: X-Domain-Id: None Apr 13 16:24:34 user devstack@n-api.service[62055]: X-Domain-Name: None Apr 13 16:24:34 user devstack@n-api.service[62055]: X-Identity-Status: Confirmed Apr 13 16:24:34 user devstack@n-api.service[62055]: X-Is-Admin-Project: True Apr 13 16:24:34 user devstack@n-api.service[62055]: X-Project-Domain-Id: default Apr 13 16:24:34 user devstack@n-api.service[62055]: X-Project-Domain-Name: Default Apr 13 16:24:34 user devstack@n-api.service[62055]: X-Project-Id: cc516f0a1f864d45bec1d132ddcee952 Apr 13 16:24:34 user devstack@n-api.service[62055]: X-Project-Name: tempest-VolumesNegativeTest-643526956 Apr 13 16:24:34 user devstack@n-api.service[62055]: X-Role: reader,member Apr 13 16:24:34 user devstack@n-api.service[62055]: X-Roles: reader,member Apr 13 16:24:34 user devstack@n-api.service[62055]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/cc516f0a1f864d45bec1d132ddcee952"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cc516f0a1f864d45bec1d132ddcee952"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cc516f0a1f864d45bec1d132ddcee952"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 13 16:24:34 user devstack@n-api.service[62055]: X-Tenant: tempest-VolumesNegativeTest-643526956 Apr 13 16:24:34 user devstack@n-api.service[62055]: X-Tenant-Id: cc516f0a1f864d45bec1d132ddcee952 Apr 13 16:24:34 user devstack@n-api.service[62055]: X-Tenant-Name: tempest-VolumesNegativeTest-643526956 Apr 13 16:24:34 user devstack@n-api.service[62055]: X-User: tempest-VolumesNegativeTest-643526956-project-member Apr 13 16:24:34 user devstack@n-api.service[62055]: X-User-Domain-Id: default Apr 13 16:24:34 user devstack@n-api.service[62055]: X-User-Domain-Name: Default Apr 13 16:24:34 user devstack@n-api.service[62055]: X-User-Id: 1df72b14c6f7470aa9b24618379533c2 Apr 13 16:24:34 user devstack@n-api.service[62055]: X-User-Name: tempest-VolumesNegativeTest-643526956-project-member Apr 13 16:24:34 user devstack@n-api.service[62055]: Apr 13 16:24:34 user devstack@n-api.service[62055]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-918555173", "metadata": {"Type": "work"}}} Apr 13 16:24:34 user devstack@n-api.service[62055]: method: Apr 13 16:24:34 user devstack@n-api.service[62055]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 13 16:24:34 user devstack@n-api.service[62055]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-918555173', 'metadata': {'Type': 'work'}}}} Apr 13 16:24:34 user devstack@n-api.service[62055]: {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 16:24:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:24:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 13 16:24:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 13 16:24:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 13 16:24:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi raise error Apr 13 16:24:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Apr 13 16:24:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:24:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Apr 13 16:24:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 13 16:24:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:24:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 13 16:24:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi '0' Apr 13 16:24:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:24:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:24:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:24:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:24:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 16:24:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 16:24:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 16:24:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 16:24:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 13 16:24:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 13 16:24:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 16:24:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 16:24:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 13 16:24:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 13 16:24:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 13 16:24:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 13 16:24:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 13 16:24:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 13 16:24:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 13 16:24:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:24:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:24:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:24:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:24:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 16:24:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 16:24:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 13 16:24:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 13 16:24:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 13 16:24:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:24:34 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-73796aef-607d-4eb8-b84c-49a4839fe5d8 tempest-VolumesNegativeTest-643526956 tempest-VolumesNegativeTest-643526956-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=62055) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 16:24:34 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-73796aef-607d-4eb8-b84c-49a4839fe5d8 tempest-VolumesNegativeTest-643526956 tempest-VolumesNegativeTest-643526956-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.012253 Apr 13 16:24:34 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 110/329] 10.0.0.210 () {64 vars in 1233 bytes} [Thu Apr 13 16:24:34 2023] POST /compute/v2.1/os-volumes => generated 125 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 13 16:24:34 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-f9c7128b-bfb4-4192-9075-8a4df8c999f5 tempest-VolumesNegativeTest-643526956 tempest-VolumesNegativeTest-643526956-project-member] Action: 'create', calling method: .version_select at 0x7f96e4a62e60>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1691736672", "metadata": {"Type": "work"}}} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:24:34 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-f9c7128b-bfb4-4192-9075-8a4df8c999f5 tempest-VolumesNegativeTest-643526956 tempest-VolumesNegativeTest-643526956-project-member] Request method failure captured: Apr 13 16:24:34 user devstack@n-api.service[62054]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 13 16:24:34 user devstack@n-api.service[62054]: Accept: application/json Apr 13 16:24:34 user devstack@n-api.service[62054]: Accept-Encoding: identity Apr 13 16:24:34 user devstack@n-api.service[62054]: Connection: close Apr 13 16:24:34 user devstack@n-api.service[62054]: Content-Length: 119 Apr 13 16:24:34 user devstack@n-api.service[62054]: Content-Type: application/json Apr 13 16:24:34 user devstack@n-api.service[62054]: Host: 10.0.0.210 Apr 13 16:24:34 user devstack@n-api.service[62054]: Openstack-System-Scope: None Apr 13 16:24:34 user devstack@n-api.service[62054]: User-Agent: python-urllib3/1.26.15 Apr 13 16:24:34 user devstack@n-api.service[62054]: X-Auth-Token: gAAAAABkOCzCeSOkm4i3u1bkenxzH-ulEk_kQRCEBmwRsjf3nW3w80vybGa62qFBzPRc-Ez8-HighgZOjcJ2OWNJJAU37wDS3NOTzhZ0K9F76XVEzxErId027aHy-vfeAqvREgrJMkgkyAdTKV5SZVkMosoYy38T_Hbhexk7SzL-SZbsp7m1TaQ Apr 13 16:24:34 user devstack@n-api.service[62054]: X-Domain-Id: None Apr 13 16:24:34 user devstack@n-api.service[62054]: X-Domain-Name: None Apr 13 16:24:34 user devstack@n-api.service[62054]: X-Identity-Status: Confirmed Apr 13 16:24:34 user devstack@n-api.service[62054]: X-Is-Admin-Project: True Apr 13 16:24:34 user devstack@n-api.service[62054]: X-Project-Domain-Id: default Apr 13 16:24:34 user devstack@n-api.service[62054]: X-Project-Domain-Name: Default Apr 13 16:24:34 user devstack@n-api.service[62054]: X-Project-Id: cc516f0a1f864d45bec1d132ddcee952 Apr 13 16:24:34 user devstack@n-api.service[62054]: X-Project-Name: tempest-VolumesNegativeTest-643526956 Apr 13 16:24:34 user devstack@n-api.service[62054]: X-Role: reader,member Apr 13 16:24:34 user devstack@n-api.service[62054]: X-Roles: reader,member Apr 13 16:24:34 user devstack@n-api.service[62054]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/cc516f0a1f864d45bec1d132ddcee952"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cc516f0a1f864d45bec1d132ddcee952"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cc516f0a1f864d45bec1d132ddcee952"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 13 16:24:34 user devstack@n-api.service[62054]: X-Tenant: tempest-VolumesNegativeTest-643526956 Apr 13 16:24:34 user devstack@n-api.service[62054]: X-Tenant-Id: cc516f0a1f864d45bec1d132ddcee952 Apr 13 16:24:34 user devstack@n-api.service[62054]: X-Tenant-Name: tempest-VolumesNegativeTest-643526956 Apr 13 16:24:34 user devstack@n-api.service[62054]: X-User: tempest-VolumesNegativeTest-643526956-project-member Apr 13 16:24:34 user devstack@n-api.service[62054]: X-User-Domain-Id: default Apr 13 16:24:34 user devstack@n-api.service[62054]: X-User-Domain-Name: Default Apr 13 16:24:34 user devstack@n-api.service[62054]: X-User-Id: 1df72b14c6f7470aa9b24618379533c2 Apr 13 16:24:34 user devstack@n-api.service[62054]: X-User-Name: tempest-VolumesNegativeTest-643526956-project-member Apr 13 16:24:34 user devstack@n-api.service[62054]: Apr 13 16:24:34 user devstack@n-api.service[62054]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1691736672", "metadata": {"Type": "work"}}} Apr 13 16:24:34 user devstack@n-api.service[62054]: method: Apr 13 16:24:34 user devstack@n-api.service[62054]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 13 16:24:34 user devstack@n-api.service[62054]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1691736672', 'metadata': {'Type': 'work'}}}} Apr 13 16:24:34 user devstack@n-api.service[62054]: {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 16:24:34 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:24:34 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 13 16:24:34 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 13 16:24:34 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 13 16:24:34 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi raise error Apr 13 16:24:34 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Apr 13 16:24:34 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:24:34 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Apr 13 16:24:34 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 13 16:24:34 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:24:34 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 13 16:24:34 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi '' Apr 13 16:24:34 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:24:34 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:24:34 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:24:34 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:24:34 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 16:24:34 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 16:24:34 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 16:24:34 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 16:24:34 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 13 16:24:34 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 13 16:24:34 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 16:24:34 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 16:24:34 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 13 16:24:34 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 13 16:24:34 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 13 16:24:34 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 13 16:24:34 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 13 16:24:34 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 13 16:24:34 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 13 16:24:34 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:24:34 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:24:34 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:24:34 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:24:34 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 16:24:34 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 16:24:34 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 13 16:24:34 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 13 16:24:34 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 13 16:24:34 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:24:34 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-f9c7128b-bfb4-4192-9075-8a4df8c999f5 tempest-VolumesNegativeTest-643526956 tempest-VolumesNegativeTest-643526956-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=62054) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 16:24:34 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-f9c7128b-bfb4-4192-9075-8a4df8c999f5 tempest-VolumesNegativeTest-643526956 tempest-VolumesNegativeTest-643526956-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.013587 Apr 13 16:24:34 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 111/330] 10.0.0.210 () {64 vars in 1233 bytes} [Thu Apr 13 16:24:34 2023] POST /compute/v2.1/os-volumes => generated 121 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 13 16:24:34 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-9098936a-94b5-4623-afa9-d95cada0555b tempest-VolumesNegativeTest-643526956 tempest-VolumesNegativeTest-643526956-project-member] Calling method '.version_select at 0x7f96e49d57e0>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:24:34 user devstack@n-api.service[62053]: INFO nova.api.openstack.wsgi [None req-9098936a-94b5-4623-afa9-d95cada0555b tempest-VolumesNegativeTest-643526956 tempest-VolumesNegativeTest-643526956-project-member] HTTP exception thrown: Volume tempest-invalid-211319182 could not be found. Apr 13 16:24:34 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-9098936a-94b5-4623-afa9-d95cada0555b tempest-VolumesNegativeTest-643526956 tempest-VolumesNegativeTest-643526956-project-member] Request method failure captured: Apr 13 16:24:34 user devstack@n-api.service[62053]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-211319182 HTTP/1.1 Apr 13 16:24:34 user devstack@n-api.service[62053]: Accept: application/json Apr 13 16:24:34 user devstack@n-api.service[62053]: Accept-Encoding: identity Apr 13 16:24:34 user devstack@n-api.service[62053]: Connection: close Apr 13 16:24:34 user devstack@n-api.service[62053]: Content-Length: 0 Apr 13 16:24:34 user devstack@n-api.service[62053]: Content-Type: application/json Apr 13 16:24:34 user devstack@n-api.service[62053]: Host: 10.0.0.210 Apr 13 16:24:34 user devstack@n-api.service[62053]: Openstack-System-Scope: None Apr 13 16:24:34 user devstack@n-api.service[62053]: User-Agent: python-urllib3/1.26.15 Apr 13 16:24:34 user devstack@n-api.service[62053]: X-Auth-Token: gAAAAABkOCzCeSOkm4i3u1bkenxzH-ulEk_kQRCEBmwRsjf3nW3w80vybGa62qFBzPRc-Ez8-HighgZOjcJ2OWNJJAU37wDS3NOTzhZ0K9F76XVEzxErId027aHy-vfeAqvREgrJMkgkyAdTKV5SZVkMosoYy38T_Hbhexk7SzL-SZbsp7m1TaQ Apr 13 16:24:34 user devstack@n-api.service[62053]: X-Domain-Id: None Apr 13 16:24:34 user devstack@n-api.service[62053]: X-Domain-Name: None Apr 13 16:24:34 user devstack@n-api.service[62053]: X-Identity-Status: Confirmed Apr 13 16:24:34 user devstack@n-api.service[62053]: X-Is-Admin-Project: True Apr 13 16:24:34 user devstack@n-api.service[62053]: X-Project-Domain-Id: default Apr 13 16:24:34 user devstack@n-api.service[62053]: X-Project-Domain-Name: Default Apr 13 16:24:34 user devstack@n-api.service[62053]: X-Project-Id: cc516f0a1f864d45bec1d132ddcee952 Apr 13 16:24:34 user devstack@n-api.service[62053]: X-Project-Name: tempest-VolumesNegativeTest-643526956 Apr 13 16:24:34 user devstack@n-api.service[62053]: X-Role: reader,member Apr 13 16:24:34 user devstack@n-api.service[62053]: X-Roles: reader,member Apr 13 16:24:34 user devstack@n-api.service[62053]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/cc516f0a1f864d45bec1d132ddcee952"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cc516f0a1f864d45bec1d132ddcee952"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cc516f0a1f864d45bec1d132ddcee952"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 13 16:24:34 user devstack@n-api.service[62053]: X-Tenant: tempest-VolumesNegativeTest-643526956 Apr 13 16:24:34 user devstack@n-api.service[62053]: X-Tenant-Id: cc516f0a1f864d45bec1d132ddcee952 Apr 13 16:24:34 user devstack@n-api.service[62053]: X-Tenant-Name: tempest-VolumesNegativeTest-643526956 Apr 13 16:24:34 user devstack@n-api.service[62053]: X-User: tempest-VolumesNegativeTest-643526956-project-member Apr 13 16:24:34 user devstack@n-api.service[62053]: X-User-Domain-Id: default Apr 13 16:24:34 user devstack@n-api.service[62053]: X-User-Domain-Name: Default Apr 13 16:24:34 user devstack@n-api.service[62053]: X-User-Id: 1df72b14c6f7470aa9b24618379533c2 Apr 13 16:24:34 user devstack@n-api.service[62053]: X-User-Name: tempest-VolumesNegativeTest-643526956-project-member Apr 13 16:24:34 user devstack@n-api.service[62053]: method: Apr 13 16:24:34 user devstack@n-api.service[62053]: exception: Volume tempest-invalid-211319182 could not be found. Apr 13 16:24:34 user devstack@n-api.service[62053]: action_args: {'id': 'tempest-invalid-211319182'} Apr 13 16:24:34 user devstack@n-api.service[62053]: {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-211319182 could not be found. (HTTP 404) (Request-ID: req-848341a2-5fbd-4179-8fb3-a6baa138d428) Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-211319182 could not be found. Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-211319182 could not be found. Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-211319182 could not be found. Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:24:34 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-9098936a-94b5-4623-afa9-d95cada0555b tempest-VolumesNegativeTest-643526956 tempest-VolumesNegativeTest-643526956-project-member] Returning 404 to user: Volume tempest-invalid-211319182 could not be found. {{(pid=62053) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 16:24:34 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-9098936a-94b5-4623-afa9-d95cada0555b tempest-VolumesNegativeTest-643526956 tempest-VolumesNegativeTest-643526956-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/tempest-invalid-211319182" status: 404 len: 98 microversion: 2.1 time: 0.044369 Apr 13 16:24:34 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 110/331] 10.0.0.210 () {62 vars in 1292 bytes} [Thu Apr 13 16:24:34 2023] DELETE /compute/v2.1/os-volumes/tempest-invalid-211319182 => generated 98 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 13 16:24:34 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-38476335-c6cb-4d22-8506-5ded5103459b tempest-VolumesNegativeTest-643526956 tempest-VolumesNegativeTest-643526956-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005287 Apr 13 16:24:34 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 111/332] 10.0.0.210 () {62 vars in 1217 bytes} [Thu Apr 13 16:24:34 2023] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 13 16:24:34 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-3772db60-4b27-47e4-bcb8-b77c37052bd3 tempest-VolumesNegativeTest-643526956 tempest-VolumesNegativeTest-643526956-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004387 Apr 13 16:24:34 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 112/333] 10.0.0.210 () {62 vars in 1214 bytes} [Thu Apr 13 16:24:34 2023] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 13 16:24:34 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-7d9b1850-3aac-425c-8272-2fbfa751b33e tempest-VolumesNegativeTest-643526956 tempest-VolumesNegativeTest-643526956-project-member] Calling method '.version_select at 0x7f96e4975000>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:24:34 user devstack@n-api.service[62053]: INFO nova.api.openstack.wsgi [None req-7d9b1850-3aac-425c-8272-2fbfa751b33e tempest-VolumesNegativeTest-643526956 tempest-VolumesNegativeTest-643526956-project-member] HTTP exception thrown: Volume 9b8fb66c-1234-4268-b454-a4b2aaa17ce8 could not be found. Apr 13 16:24:34 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-7d9b1850-3aac-425c-8272-2fbfa751b33e tempest-VolumesNegativeTest-643526956 tempest-VolumesNegativeTest-643526956-project-member] Request method failure captured: Apr 13 16:24:34 user devstack@n-api.service[62053]: request: DELETE /compute/v2.1/os-volumes/9b8fb66c-1234-4268-b454-a4b2aaa17ce8 HTTP/1.1 Apr 13 16:24:34 user devstack@n-api.service[62053]: Accept: application/json Apr 13 16:24:34 user devstack@n-api.service[62053]: Accept-Encoding: identity Apr 13 16:24:34 user devstack@n-api.service[62053]: Connection: close Apr 13 16:24:34 user devstack@n-api.service[62053]: Content-Length: 0 Apr 13 16:24:34 user devstack@n-api.service[62053]: Content-Type: application/json Apr 13 16:24:34 user devstack@n-api.service[62053]: Host: 10.0.0.210 Apr 13 16:24:34 user devstack@n-api.service[62053]: Openstack-System-Scope: None Apr 13 16:24:34 user devstack@n-api.service[62053]: User-Agent: python-urllib3/1.26.15 Apr 13 16:24:34 user devstack@n-api.service[62053]: X-Auth-Token: gAAAAABkOCzCeSOkm4i3u1bkenxzH-ulEk_kQRCEBmwRsjf3nW3w80vybGa62qFBzPRc-Ez8-HighgZOjcJ2OWNJJAU37wDS3NOTzhZ0K9F76XVEzxErId027aHy-vfeAqvREgrJMkgkyAdTKV5SZVkMosoYy38T_Hbhexk7SzL-SZbsp7m1TaQ Apr 13 16:24:34 user devstack@n-api.service[62053]: X-Domain-Id: None Apr 13 16:24:34 user devstack@n-api.service[62053]: X-Domain-Name: None Apr 13 16:24:34 user devstack@n-api.service[62053]: X-Identity-Status: Confirmed Apr 13 16:24:34 user devstack@n-api.service[62053]: X-Is-Admin-Project: True Apr 13 16:24:34 user devstack@n-api.service[62053]: X-Project-Domain-Id: default Apr 13 16:24:34 user devstack@n-api.service[62053]: X-Project-Domain-Name: Default Apr 13 16:24:34 user devstack@n-api.service[62053]: X-Project-Id: cc516f0a1f864d45bec1d132ddcee952 Apr 13 16:24:34 user devstack@n-api.service[62053]: X-Project-Name: tempest-VolumesNegativeTest-643526956 Apr 13 16:24:34 user devstack@n-api.service[62053]: X-Role: reader,member Apr 13 16:24:34 user devstack@n-api.service[62053]: X-Roles: reader,member Apr 13 16:24:34 user devstack@n-api.service[62053]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/cc516f0a1f864d45bec1d132ddcee952"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cc516f0a1f864d45bec1d132ddcee952"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cc516f0a1f864d45bec1d132ddcee952"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 13 16:24:34 user devstack@n-api.service[62053]: X-Tenant: tempest-VolumesNegativeTest-643526956 Apr 13 16:24:34 user devstack@n-api.service[62053]: X-Tenant-Id: cc516f0a1f864d45bec1d132ddcee952 Apr 13 16:24:34 user devstack@n-api.service[62053]: X-Tenant-Name: tempest-VolumesNegativeTest-643526956 Apr 13 16:24:34 user devstack@n-api.service[62053]: X-User: tempest-VolumesNegativeTest-643526956-project-member Apr 13 16:24:34 user devstack@n-api.service[62053]: X-User-Domain-Id: default Apr 13 16:24:34 user devstack@n-api.service[62053]: X-User-Domain-Name: Default Apr 13 16:24:34 user devstack@n-api.service[62053]: X-User-Id: 1df72b14c6f7470aa9b24618379533c2 Apr 13 16:24:34 user devstack@n-api.service[62053]: X-User-Name: tempest-VolumesNegativeTest-643526956-project-member Apr 13 16:24:34 user devstack@n-api.service[62053]: method: Apr 13 16:24:34 user devstack@n-api.service[62053]: exception: Volume 9b8fb66c-1234-4268-b454-a4b2aaa17ce8 could not be found. Apr 13 16:24:34 user devstack@n-api.service[62053]: action_args: {'id': '9b8fb66c-1234-4268-b454-a4b2aaa17ce8'} Apr 13 16:24:34 user devstack@n-api.service[62053]: {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9b8fb66c-1234-4268-b454-a4b2aaa17ce8 could not be found. (HTTP 404) (Request-ID: req-c6235481-c32f-4da4-b2ba-1ee9b0e63f19) Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9b8fb66c-1234-4268-b454-a4b2aaa17ce8 could not be found. Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9b8fb66c-1234-4268-b454-a4b2aaa17ce8 could not be found. Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9b8fb66c-1234-4268-b454-a4b2aaa17ce8 could not be found. Apr 13 16:24:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:24:34 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-7d9b1850-3aac-425c-8272-2fbfa751b33e tempest-VolumesNegativeTest-643526956 tempest-VolumesNegativeTest-643526956-project-member] Returning 404 to user: Volume 9b8fb66c-1234-4268-b454-a4b2aaa17ce8 could not be found. {{(pid=62053) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 16:24:34 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-7d9b1850-3aac-425c-8272-2fbfa751b33e tempest-VolumesNegativeTest-643526956 tempest-VolumesNegativeTest-643526956-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/9b8fb66c-1234-4268-b454-a4b2aaa17ce8" status: 404 len: 109 microversion: 2.1 time: 0.035572 Apr 13 16:24:34 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 111/334] 10.0.0.210 () {62 vars in 1325 bytes} [Thu Apr 13 16:24:34 2023] DELETE /compute/v2.1/os-volumes/9b8fb66c-1234-4268-b454-a4b2aaa17ce8 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 16:24:34 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-830d2014-6641-48d8-b0d8-c22aceb60716 tempest-VolumesNegativeTest-643526956 tempest-VolumesNegativeTest-643526956-project-member] Calling method '.version_select at 0x7f96e4915240>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:24:34 user devstack@n-api.service[62055]: INFO nova.api.openstack.wsgi [None req-830d2014-6641-48d8-b0d8-c22aceb60716 tempest-VolumesNegativeTest-643526956 tempest-VolumesNegativeTest-643526956-project-member] HTTP exception thrown: Volume 0b025d66-dfdf-4b34-9679-e4abdd7ebc36 could not be found. Apr 13 16:24:34 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-830d2014-6641-48d8-b0d8-c22aceb60716 tempest-VolumesNegativeTest-643526956 tempest-VolumesNegativeTest-643526956-project-member] Request method failure captured: Apr 13 16:24:34 user devstack@n-api.service[62055]: request: GET /compute/v2.1/os-volumes/0b025d66-dfdf-4b34-9679-e4abdd7ebc36 HTTP/1.1 Apr 13 16:24:34 user devstack@n-api.service[62055]: Accept: application/json Apr 13 16:24:34 user devstack@n-api.service[62055]: Accept-Encoding: identity Apr 13 16:24:34 user devstack@n-api.service[62055]: Connection: close Apr 13 16:24:34 user devstack@n-api.service[62055]: Content-Length: 0 Apr 13 16:24:34 user devstack@n-api.service[62055]: Content-Type: application/json Apr 13 16:24:34 user devstack@n-api.service[62055]: Host: 10.0.0.210 Apr 13 16:24:34 user devstack@n-api.service[62055]: Openstack-System-Scope: None Apr 13 16:24:34 user devstack@n-api.service[62055]: User-Agent: python-urllib3/1.26.15 Apr 13 16:24:34 user devstack@n-api.service[62055]: X-Auth-Token: gAAAAABkOCzCeSOkm4i3u1bkenxzH-ulEk_kQRCEBmwRsjf3nW3w80vybGa62qFBzPRc-Ez8-HighgZOjcJ2OWNJJAU37wDS3NOTzhZ0K9F76XVEzxErId027aHy-vfeAqvREgrJMkgkyAdTKV5SZVkMosoYy38T_Hbhexk7SzL-SZbsp7m1TaQ Apr 13 16:24:34 user devstack@n-api.service[62055]: X-Domain-Id: None Apr 13 16:24:34 user devstack@n-api.service[62055]: X-Domain-Name: None Apr 13 16:24:34 user devstack@n-api.service[62055]: X-Identity-Status: Confirmed Apr 13 16:24:34 user devstack@n-api.service[62055]: X-Is-Admin-Project: True Apr 13 16:24:34 user devstack@n-api.service[62055]: X-Project-Domain-Id: default Apr 13 16:24:34 user devstack@n-api.service[62055]: X-Project-Domain-Name: Default Apr 13 16:24:34 user devstack@n-api.service[62055]: X-Project-Id: cc516f0a1f864d45bec1d132ddcee952 Apr 13 16:24:34 user devstack@n-api.service[62055]: X-Project-Name: tempest-VolumesNegativeTest-643526956 Apr 13 16:24:34 user devstack@n-api.service[62055]: X-Role: reader,member Apr 13 16:24:34 user devstack@n-api.service[62055]: X-Roles: reader,member Apr 13 16:24:34 user devstack@n-api.service[62055]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/cc516f0a1f864d45bec1d132ddcee952"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cc516f0a1f864d45bec1d132ddcee952"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cc516f0a1f864d45bec1d132ddcee952"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 13 16:24:34 user devstack@n-api.service[62055]: X-Tenant: tempest-VolumesNegativeTest-643526956 Apr 13 16:24:34 user devstack@n-api.service[62055]: X-Tenant-Id: cc516f0a1f864d45bec1d132ddcee952 Apr 13 16:24:34 user devstack@n-api.service[62055]: X-Tenant-Name: tempest-VolumesNegativeTest-643526956 Apr 13 16:24:34 user devstack@n-api.service[62055]: X-User: tempest-VolumesNegativeTest-643526956-project-member Apr 13 16:24:34 user devstack@n-api.service[62055]: X-User-Domain-Id: default Apr 13 16:24:34 user devstack@n-api.service[62055]: X-User-Domain-Name: Default Apr 13 16:24:34 user devstack@n-api.service[62055]: X-User-Id: 1df72b14c6f7470aa9b24618379533c2 Apr 13 16:24:34 user devstack@n-api.service[62055]: X-User-Name: tempest-VolumesNegativeTest-643526956-project-member Apr 13 16:24:34 user devstack@n-api.service[62055]: method: Apr 13 16:24:34 user devstack@n-api.service[62055]: exception: Volume 0b025d66-dfdf-4b34-9679-e4abdd7ebc36 could not be found. Apr 13 16:24:34 user devstack@n-api.service[62055]: action_args: {'id': '0b025d66-dfdf-4b34-9679-e4abdd7ebc36'} Apr 13 16:24:34 user devstack@n-api.service[62055]: {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 16:24:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:24:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 13 16:24:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 13 16:24:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 13 16:24:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 13 16:24:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 13 16:24:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 13 16:24:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 13 16:24:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 13 16:24:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 13 16:24:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 13 16:24:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 16:24:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 16:24:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 16:24:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 16:24:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0b025d66-dfdf-4b34-9679-e4abdd7ebc36 could not be found. (HTTP 404) (Request-ID: req-3f8ae48d-db0e-4ff9-9792-6815e0d02f3e) Apr 13 16:24:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:24:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:24:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:24:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:24:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 13 16:24:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 13 16:24:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 13 16:24:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 13 16:24:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 13 16:24:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 13 16:24:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 13 16:24:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 13 16:24:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 13 16:24:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 13 16:24:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 13 16:24:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 13 16:24:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 13 16:24:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 13 16:24:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 13 16:24:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 13 16:24:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 13 16:24:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 13 16:24:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 16:24:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 16:24:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 16:24:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 16:24:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0b025d66-dfdf-4b34-9679-e4abdd7ebc36 could not be found. Apr 13 16:24:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:24:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:24:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:24:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:24:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 16:24:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 16:24:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 16:24:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 16:24:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 13 16:24:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 13 16:24:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 16:24:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 16:24:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 13 16:24:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 16:24:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0b025d66-dfdf-4b34-9679-e4abdd7ebc36 could not be found. Apr 13 16:24:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:24:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:24:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:24:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:24:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 16:24:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 16:24:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 16:24:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 16:24:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0b025d66-dfdf-4b34-9679-e4abdd7ebc36 could not be found. Apr 13 16:24:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:24:34 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-830d2014-6641-48d8-b0d8-c22aceb60716 tempest-VolumesNegativeTest-643526956 tempest-VolumesNegativeTest-643526956-project-member] Returning 404 to user: Volume 0b025d66-dfdf-4b34-9679-e4abdd7ebc36 could not be found. {{(pid=62055) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 16:24:34 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-830d2014-6641-48d8-b0d8-c22aceb60716 tempest-VolumesNegativeTest-643526956 tempest-VolumesNegativeTest-643526956-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/0b025d66-dfdf-4b34-9679-e4abdd7ebc36" status: 404 len: 109 microversion: 2.1 time: 0.040259 Apr 13 16:24:34 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 112/335] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 16:24:34 2023] GET /compute/v2.1/os-volumes/0b025d66-dfdf-4b34-9679-e4abdd7ebc36 => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 16:24:38 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-bc6e3f5f-9b82-4aa3-b2ca-7ee2a71842d9 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:24:38 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-bc6e3f5f-9b82-4aa3-b2ca-7ee2a71842d9 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] [instance: 031c7939-a53c-4f7d-9f36-4ec1d06e2717] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:24:38 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-bc6e3f5f-9b82-4aa3-b2ca-7ee2a71842d9 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:24:38 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-bc6e3f5f-9b82-4aa3-b2ca-7ee2a71842d9 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:24:38 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-bc6e3f5f-9b82-4aa3-b2ca-7ee2a71842d9 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:24:38 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-bc6e3f5f-9b82-4aa3-b2ca-7ee2a71842d9 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:24:38 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-bc6e3f5f-9b82-4aa3-b2ca-7ee2a71842d9 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:24:38 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-bc6e3f5f-9b82-4aa3-b2ca-7ee2a71842d9 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:24:38 user devstack@n-api.service[62054]: INFO nova.api.openstack.wsgi [None req-bc6e3f5f-9b82-4aa3-b2ca-7ee2a71842d9 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] HTTP exception thrown: Instance 031c7939-a53c-4f7d-9f36-4ec1d06e2717 could not be found. Apr 13 16:24:38 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-bc6e3f5f-9b82-4aa3-b2ca-7ee2a71842d9 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Request method failure captured: Apr 13 16:24:38 user devstack@n-api.service[62054]: request: GET /compute/v2.1/servers/031c7939-a53c-4f7d-9f36-4ec1d06e2717 HTTP/1.1 Apr 13 16:24:38 user devstack@n-api.service[62054]: Accept: application/json Apr 13 16:24:38 user devstack@n-api.service[62054]: Accept-Encoding: identity Apr 13 16:24:38 user devstack@n-api.service[62054]: Connection: close Apr 13 16:24:38 user devstack@n-api.service[62054]: Content-Length: 0 Apr 13 16:24:38 user devstack@n-api.service[62054]: Content-Type: application/json Apr 13 16:24:38 user devstack@n-api.service[62054]: Host: 10.0.0.210 Apr 13 16:24:38 user devstack@n-api.service[62054]: Openstack-System-Scope: None Apr 13 16:24:38 user devstack@n-api.service[62054]: User-Agent: python-urllib3/1.26.15 Apr 13 16:24:38 user devstack@n-api.service[62054]: X-Auth-Token: gAAAAABkOCwICdOYUNMq2XTmp7fPKYYIL47DO4DENTPMQgSht1dTIG82lfhuFgnIu6iB7daPqHja3Py6WVNbrBjN3hDOqRAAzSqG19kmoaiRDqbakCSeoYbYikmNwRUJ98ykgNk0e17tG9DgLJTrzwzEBheVJvyMaVu4E8WtXpnuwa8gWkFLrhA Apr 13 16:24:38 user devstack@n-api.service[62054]: X-Domain-Id: None Apr 13 16:24:38 user devstack@n-api.service[62054]: X-Domain-Name: None Apr 13 16:24:38 user devstack@n-api.service[62054]: X-Identity-Status: Confirmed Apr 13 16:24:38 user devstack@n-api.service[62054]: X-Is-Admin-Project: True Apr 13 16:24:38 user devstack@n-api.service[62054]: X-Project-Domain-Id: default Apr 13 16:24:38 user devstack@n-api.service[62054]: X-Project-Domain-Name: Default Apr 13 16:24:38 user devstack@n-api.service[62054]: X-Project-Id: e7395d2408a44cc88cf88eb49d5f8503 Apr 13 16:24:38 user devstack@n-api.service[62054]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1985397600 Apr 13 16:24:38 user devstack@n-api.service[62054]: X-Role: reader,member Apr 13 16:24:38 user devstack@n-api.service[62054]: X-Roles: reader,member Apr 13 16:24:38 user devstack@n-api.service[62054]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e7395d2408a44cc88cf88eb49d5f8503"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e7395d2408a44cc88cf88eb49d5f8503"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e7395d2408a44cc88cf88eb49d5f8503"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 13 16:24:38 user devstack@n-api.service[62054]: X-Tenant: tempest-VolumesSnapshotTestJSON-1985397600 Apr 13 16:24:38 user devstack@n-api.service[62054]: X-Tenant-Id: e7395d2408a44cc88cf88eb49d5f8503 Apr 13 16:24:38 user devstack@n-api.service[62054]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1985397600 Apr 13 16:24:38 user devstack@n-api.service[62054]: X-User: tempest-VolumesSnapshotTestJSON-1985397600-project-member Apr 13 16:24:38 user devstack@n-api.service[62054]: X-User-Domain-Id: default Apr 13 16:24:38 user devstack@n-api.service[62054]: X-User-Domain-Name: Default Apr 13 16:24:38 user devstack@n-api.service[62054]: X-User-Id: 9223a3efe4bc4e37946c8ed718100de4 Apr 13 16:24:38 user devstack@n-api.service[62054]: X-User-Name: tempest-VolumesSnapshotTestJSON-1985397600-project-member Apr 13 16:24:38 user devstack@n-api.service[62054]: method: > Apr 13 16:24:38 user devstack@n-api.service[62054]: exception: Instance 031c7939-a53c-4f7d-9f36-4ec1d06e2717 could not be found. Apr 13 16:24:38 user devstack@n-api.service[62054]: action_args: {'id': '031c7939-a53c-4f7d-9f36-4ec1d06e2717'} Apr 13 16:24:38 user devstack@n-api.service[62054]: {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 16:24:38 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:24:38 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 16:24:38 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 16:24:38 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 16:24:38 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 16:24:38 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 16:24:38 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 16:24:38 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 16:24:38 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 16:24:38 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 031c7939-a53c-4f7d-9f36-4ec1d06e2717 could not be found. Apr 13 16:24:38 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:24:38 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:24:38 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:24:38 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:24:38 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 16:24:38 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 16:24:38 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 16:24:38 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 16:24:38 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 16:24:38 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 16:24:38 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 16:24:38 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 16:24:38 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 16:24:38 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 16:24:38 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 16:24:38 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 16:24:38 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 031c7939-a53c-4f7d-9f36-4ec1d06e2717 could not be found. Apr 13 16:24:38 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:24:38 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:24:38 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:24:38 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:24:38 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 16:24:38 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 16:24:38 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 16:24:38 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 16:24:38 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 031c7939-a53c-4f7d-9f36-4ec1d06e2717 could not be found. Apr 13 16:24:38 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:24:38 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-bc6e3f5f-9b82-4aa3-b2ca-7ee2a71842d9 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Returning 404 to user: Instance 031c7939-a53c-4f7d-9f36-4ec1d06e2717 could not be found. {{(pid=62054) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 16:24:38 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-bc6e3f5f-9b82-4aa3-b2ca-7ee2a71842d9 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] 10.0.0.210 "GET /compute/v2.1/servers/031c7939-a53c-4f7d-9f36-4ec1d06e2717" status: 404 len: 111 microversion: 2.1 time: 0.037809 Apr 13 16:24:38 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 113/336] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:24:38 2023] GET /compute/v2.1/servers/031c7939-a53c-4f7d-9f36-4ec1d06e2717 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 16:24:46 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=2 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:24:46 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_cell1:SELECT=9 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:24:46 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-2864da8b-9dbe-4b18-b8d1-8dc15ab7abe1 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:24:46 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-2864da8b-9dbe-4b18-b8d1-8dc15ab7abe1 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] [instance: 0e731607-fce1-4f19-9e4b-5b892e760179] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:24:46 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-2864da8b-9dbe-4b18-b8d1-8dc15ab7abe1 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:24:46 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-2864da8b-9dbe-4b18-b8d1-8dc15ab7abe1 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:24:46 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-2864da8b-9dbe-4b18-b8d1-8dc15ab7abe1 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:24:46 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-2864da8b-9dbe-4b18-b8d1-8dc15ab7abe1 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:24:46 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-2864da8b-9dbe-4b18-b8d1-8dc15ab7abe1 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:24:46 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-2864da8b-9dbe-4b18-b8d1-8dc15ab7abe1 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:24:46 user devstack@n-api.service[62053]: INFO nova.api.openstack.wsgi [None req-2864da8b-9dbe-4b18-b8d1-8dc15ab7abe1 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] HTTP exception thrown: Instance 0e731607-fce1-4f19-9e4b-5b892e760179 could not be found. Apr 13 16:24:46 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-2864da8b-9dbe-4b18-b8d1-8dc15ab7abe1 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Request method failure captured: Apr 13 16:24:46 user devstack@n-api.service[62053]: request: GET /compute/v2.1/servers/0e731607-fce1-4f19-9e4b-5b892e760179 HTTP/1.1 Apr 13 16:24:46 user devstack@n-api.service[62053]: Accept: application/json Apr 13 16:24:46 user devstack@n-api.service[62053]: Accept-Encoding: identity Apr 13 16:24:46 user devstack@n-api.service[62053]: Connection: close Apr 13 16:24:46 user devstack@n-api.service[62053]: Content-Length: 0 Apr 13 16:24:46 user devstack@n-api.service[62053]: Content-Type: application/json Apr 13 16:24:46 user devstack@n-api.service[62053]: Host: 10.0.0.210 Apr 13 16:24:46 user devstack@n-api.service[62053]: Openstack-System-Scope: None Apr 13 16:24:46 user devstack@n-api.service[62053]: User-Agent: python-urllib3/1.26.15 Apr 13 16:24:46 user devstack@n-api.service[62053]: X-Auth-Token: gAAAAABkOCu7xvmudBrBXBLs2SCBDcK71oPknaVoa5c212HJ1YH5D1qqQ770FnyyQ769HR4gN3MWc8D4DgjQEtN69nkpO07yNpJgb9N95gGXJDJugJy1OfGoQrI6zjE_4e0z9MJFRRuCNbIXu0Si5G6jJIciNJHiNV9wx9koSjgJs77kT-szNSc Apr 13 16:24:46 user devstack@n-api.service[62053]: X-Domain-Id: None Apr 13 16:24:46 user devstack@n-api.service[62053]: X-Domain-Name: None Apr 13 16:24:46 user devstack@n-api.service[62053]: X-Identity-Status: Confirmed Apr 13 16:24:46 user devstack@n-api.service[62053]: X-Is-Admin-Project: True Apr 13 16:24:46 user devstack@n-api.service[62053]: X-Project-Domain-Id: default Apr 13 16:24:46 user devstack@n-api.service[62053]: X-Project-Domain-Name: Default Apr 13 16:24:46 user devstack@n-api.service[62053]: X-Project-Id: 5554aa7f1b4d471b8807a845ab1ea33f Apr 13 16:24:46 user devstack@n-api.service[62053]: X-Project-Name: tempest-ServersNegativeTestJSON-1820659348 Apr 13 16:24:46 user devstack@n-api.service[62053]: X-Role: reader,member Apr 13 16:24:46 user devstack@n-api.service[62053]: X-Roles: reader,member Apr 13 16:24:46 user devstack@n-api.service[62053]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5554aa7f1b4d471b8807a845ab1ea33f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5554aa7f1b4d471b8807a845ab1ea33f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5554aa7f1b4d471b8807a845ab1ea33f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 13 16:24:46 user devstack@n-api.service[62053]: X-Tenant: tempest-ServersNegativeTestJSON-1820659348 Apr 13 16:24:46 user devstack@n-api.service[62053]: X-Tenant-Id: 5554aa7f1b4d471b8807a845ab1ea33f Apr 13 16:24:46 user devstack@n-api.service[62053]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1820659348 Apr 13 16:24:46 user devstack@n-api.service[62053]: X-User: tempest-ServersNegativeTestJSON-1820659348-project-member Apr 13 16:24:46 user devstack@n-api.service[62053]: X-User-Domain-Id: default Apr 13 16:24:46 user devstack@n-api.service[62053]: X-User-Domain-Name: Default Apr 13 16:24:46 user devstack@n-api.service[62053]: X-User-Id: 4ddd547d240b43ccb213e9d459082309 Apr 13 16:24:46 user devstack@n-api.service[62053]: X-User-Name: tempest-ServersNegativeTestJSON-1820659348-project-member Apr 13 16:24:46 user devstack@n-api.service[62053]: method: > Apr 13 16:24:46 user devstack@n-api.service[62053]: exception: Instance 0e731607-fce1-4f19-9e4b-5b892e760179 could not be found. Apr 13 16:24:46 user devstack@n-api.service[62053]: action_args: {'id': '0e731607-fce1-4f19-9e4b-5b892e760179'} Apr 13 16:24:46 user devstack@n-api.service[62053]: {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 16:24:46 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:24:46 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 16:24:46 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 16:24:46 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 16:24:46 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 16:24:46 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 16:24:46 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 16:24:46 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 16:24:46 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 16:24:46 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e731607-fce1-4f19-9e4b-5b892e760179 could not be found. Apr 13 16:24:46 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:24:46 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:24:46 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:24:46 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:24:46 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 16:24:46 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 16:24:46 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 16:24:46 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 16:24:46 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 16:24:46 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 16:24:46 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 16:24:46 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 16:24:46 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 16:24:46 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 16:24:46 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 16:24:46 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 16:24:46 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e731607-fce1-4f19-9e4b-5b892e760179 could not be found. Apr 13 16:24:46 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:24:46 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:24:46 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:24:46 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:24:46 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 16:24:46 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 16:24:46 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 16:24:46 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 16:24:46 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e731607-fce1-4f19-9e4b-5b892e760179 could not be found. Apr 13 16:24:46 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:24:46 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-2864da8b-9dbe-4b18-b8d1-8dc15ab7abe1 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Returning 404 to user: Instance 0e731607-fce1-4f19-9e4b-5b892e760179 could not be found. {{(pid=62053) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 16:24:46 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-2864da8b-9dbe-4b18-b8d1-8dc15ab7abe1 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0e731607-fce1-4f19-9e4b-5b892e760179" status: 404 len: 111 microversion: 2.1 time: 0.043285 Apr 13 16:24:46 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 112/337] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:24:46 2023] GET /compute/v2.1/servers/0e731607-fce1-4f19-9e4b-5b892e760179 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 16:24:46 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_api:SELECT=5 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:24:46 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:24:46 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-b607c19c-9c71-4818-a7e5-b88db0f9567c tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:24:46 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-b607c19c-9c71-4818-a7e5-b88db0f9567c tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] [instance: 7973e93b-6311-44ed-91ff-e861c32d0277] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:24:46 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-b607c19c-9c71-4818-a7e5-b88db0f9567c tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:24:46 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-b607c19c-9c71-4818-a7e5-b88db0f9567c tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:24:46 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-b607c19c-9c71-4818-a7e5-b88db0f9567c tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:24:46 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-b607c19c-9c71-4818-a7e5-b88db0f9567c tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:24:46 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-b607c19c-9c71-4818-a7e5-b88db0f9567c tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:24:46 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-b607c19c-9c71-4818-a7e5-b88db0f9567c tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:24:46 user devstack@n-api.service[62055]: DEBUG nova.policy [None req-b607c19c-9c71-4818-a7e5-b88db0f9567c tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ddd547d240b43ccb213e9d459082309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5554aa7f1b4d471b8807a845ab1ea33f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62055) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:24:46 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-b607c19c-9c71-4818-a7e5-b88db0f9567c tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7973e93b-6311-44ed-91ff-e861c32d0277" status: 200 len: 1493 microversion: 2.1 time: 0.163825 Apr 13 16:24:46 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 113/338] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:24:46 2023] GET /compute/v2.1/servers/7973e93b-6311-44ed-91ff-e861c32d0277 => generated 1493 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:24:47 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-b288e352-c9e2-4f5b-beb0-bb59284c59f7 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1443848210", "imageRef": "708622a9-7465-4492-ade8-b827198f7e30", "flavorRef": "42", "networks": [{"uuid": "aa17b8d5-dffb-42ba-bb7e-8909e5894bfb"}]}} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:24:47 user devstack@n-api.service[62054]: DEBUG nova.network.neutron [None req-b288e352-c9e2-4f5b-beb0-bb59284c59f7 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] validate_networks() for [('aa17b8d5-dffb-42ba-bb7e-8909e5894bfb', None, None, None, None, None)] {{(pid=62054) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 16:24:47 user devstack@n-api.service[62054]: DEBUG nova.virt.hardware [None req-b288e352-c9e2-4f5b-beb0-bb59284c59f7 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Flavor limits 0:0:0 {{(pid=62054) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 16:24:47 user devstack@n-api.service[62054]: DEBUG nova.virt.hardware [None req-b288e352-c9e2-4f5b-beb0-bb59284c59f7 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Image limits 0:0:0 {{(pid=62054) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 16:24:47 user devstack@n-api.service[62054]: DEBUG nova.virt.hardware [None req-b288e352-c9e2-4f5b-beb0-bb59284c59f7 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Flavor pref 0:0:0 {{(pid=62054) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 16:24:47 user devstack@n-api.service[62054]: DEBUG nova.virt.hardware [None req-b288e352-c9e2-4f5b-beb0-bb59284c59f7 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Image pref 0:0:0 {{(pid=62054) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 16:24:47 user devstack@n-api.service[62054]: DEBUG nova.virt.hardware [None req-b288e352-c9e2-4f5b-beb0-bb59284c59f7 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62054) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 16:24:47 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-b288e352-c9e2-4f5b-beb0-bb59284c59f7 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:24:47 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-b288e352-c9e2-4f5b-beb0-bb59284c59f7 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:24:47 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-b288e352-c9e2-4f5b-beb0-bb59284c59f7 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:24:47 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-b288e352-c9e2-4f5b-beb0-bb59284c59f7 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:24:47 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-b288e352-c9e2-4f5b-beb0-bb59284c59f7 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:24:47 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-b288e352-c9e2-4f5b-beb0-bb59284c59f7 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:24:48 user devstack@n-api.service[62054]: DEBUG nova.quota [None req-b288e352-c9e2-4f5b-beb0-bb59284c59f7 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Getting quotas for project e7395d2408a44cc88cf88eb49d5f8503. Resources: {'instances', 'cores', 'ram'} {{(pid=62054) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 16:24:48 user devstack@n-api.service[62054]: DEBUG nova.quota [None req-b288e352-c9e2-4f5b-beb0-bb59284c59f7 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Getting quotas for user 9223a3efe4bc4e37946c8ed718100de4 and project e7395d2408a44cc88cf88eb49d5f8503. Resources: {'instances', 'cores', 'ram'} {{(pid=62054) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 16:24:48 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-b288e352-c9e2-4f5b-beb0-bb59284c59f7 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Going to run 1 instances... {{(pid=62054) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 16:24:48 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-b288e352-c9e2-4f5b-beb0-bb59284c59f7 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] [instance: 902e4077-e0d6-4b61-a861-883be253f1e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='708622a9-7465-4492-ade8-b827198f7e30',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=62054) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 16:24:48 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-b288e352-c9e2-4f5b-beb0-bb59284c59f7 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.598408 Apr 13 16:24:48 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 114/339] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 16:24:47 2023] POST /compute/v2.1/servers => generated 378 bytes in 600 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 16:24:48 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-79411a76-6260-4884-bde0-784375e9c9a5 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:24:48 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-79411a76-6260-4884-bde0-784375e9c9a5 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] [instance: 902e4077-e0d6-4b61-a861-883be253f1e0] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:24:48 user devstack@n-api.service[62053]: DEBUG nova.policy [None req-79411a76-6260-4884-bde0-784375e9c9a5 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9223a3efe4bc4e37946c8ed718100de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7395d2408a44cc88cf88eb49d5f8503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62053) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:24:48 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-79411a76-6260-4884-bde0-784375e9c9a5 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] 10.0.0.210 "GET /compute/v2.1/servers/902e4077-e0d6-4b61-a861-883be253f1e0" status: 200 len: 1213 microversion: 2.1 time: 0.066427 Apr 13 16:24:48 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 113/340] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:24:48 2023] GET /compute/v2.1/servers/902e4077-e0d6-4b61-a861-883be253f1e0 => generated 1213 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:24:50 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [req-46b1d8ec-8d69-4d1d-8863-d660096f8303 req-f28916ac-e0d7-4a46-980b-675f8a0ff5b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "902e4077-e0d6-4b61-a861-883be253f1e0", "tag": "58b69a6e-8c04-42e5-931a-0947d9c0f78d"}]} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:24:50 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-46b1d8ec-8d69-4d1d-8863-d660096f8303 req-f28916ac-e0d7-4a46-980b-675f8a0ff5b5 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:24:50 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-46b1d8ec-8d69-4d1d-8863-d660096f8303 req-f28916ac-e0d7-4a46-980b-675f8a0ff5b5 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:24:50 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-46b1d8ec-8d69-4d1d-8863-d660096f8303 req-f28916ac-e0d7-4a46-980b-675f8a0ff5b5 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:24:50 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-46b1d8ec-8d69-4d1d-8863-d660096f8303 req-f28916ac-e0d7-4a46-980b-675f8a0ff5b5 service nova] Creating event network-changed:58b69a6e-8c04-42e5-931a-0947d9c0f78d for instance 902e4077-e0d6-4b61-a861-883be253f1e0 on user Apr 13 16:24:50 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [req-46b1d8ec-8d69-4d1d-8863-d660096f8303 req-f28916ac-e0d7-4a46-980b-675f8a0ff5b5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030363 Apr 13 16:24:50 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 114/341] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:24:50 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:24:52 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-a4e25b34-46f5-4624-bff7-166e3962be97 req-e7bb7d83-6184-472e-9465-5e36c87c5220 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "902e4077-e0d6-4b61-a861-883be253f1e0", "name": "network-vif-plugged", "status": "completed", "tag": "58b69a6e-8c04-42e5-931a-0947d9c0f78d"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:24:52 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_api:SELECT=23,nova_api:INSERT=3 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:24:52 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-a4e25b34-46f5-4624-bff7-166e3962be97 req-e7bb7d83-6184-472e-9465-5e36c87c5220 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:24:52 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-a4e25b34-46f5-4624-bff7-166e3962be97 req-e7bb7d83-6184-472e-9465-5e36c87c5220 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:24:52 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-a4e25b34-46f5-4624-bff7-166e3962be97 req-e7bb7d83-6184-472e-9465-5e36c87c5220 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:24:52 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_cell1:SELECT=20 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:24:52 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-a4e25b34-46f5-4624-bff7-166e3962be97 req-e7bb7d83-6184-472e-9465-5e36c87c5220 service nova] Creating event network-vif-plugged:58b69a6e-8c04-42e5-931a-0947d9c0f78d for instance 902e4077-e0d6-4b61-a861-883be253f1e0 on user Apr 13 16:24:52 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [req-a4e25b34-46f5-4624-bff7-166e3962be97 req-e7bb7d83-6184-472e-9465-5e36c87c5220 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037727 Apr 13 16:24:52 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 115/342] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:24:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:24:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-e110ef43-bc08-4d04-98a0-15c56bb668f3 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:24:54 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-e110ef43-bc08-4d04-98a0-15c56bb668f3 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: db65920b-7872-44c1-a68a-a696681d9d95] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:24:54 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-e110ef43-bc08-4d04-98a0-15c56bb668f3 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:24:54 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-e110ef43-bc08-4d04-98a0-15c56bb668f3 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:24:54 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-e110ef43-bc08-4d04-98a0-15c56bb668f3 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:24:54 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-e110ef43-bc08-4d04-98a0-15c56bb668f3 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:24:54 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-e110ef43-bc08-4d04-98a0-15c56bb668f3 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:24:54 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-e110ef43-bc08-4d04-98a0-15c56bb668f3 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:24:54 user devstack@n-api.service[62053]: INFO nova.api.openstack.wsgi [None req-e110ef43-bc08-4d04-98a0-15c56bb668f3 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] HTTP exception thrown: Instance db65920b-7872-44c1-a68a-a696681d9d95 could not be found. Apr 13 16:24:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-e110ef43-bc08-4d04-98a0-15c56bb668f3 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Request method failure captured: Apr 13 16:24:54 user devstack@n-api.service[62053]: request: GET /compute/v2.1/servers/db65920b-7872-44c1-a68a-a696681d9d95 HTTP/1.1 Apr 13 16:24:54 user devstack@n-api.service[62053]: Accept: application/json Apr 13 16:24:54 user devstack@n-api.service[62053]: Accept-Encoding: identity Apr 13 16:24:54 user devstack@n-api.service[62053]: Connection: close Apr 13 16:24:54 user devstack@n-api.service[62053]: Content-Length: 0 Apr 13 16:24:54 user devstack@n-api.service[62053]: Content-Type: application/json Apr 13 16:24:54 user devstack@n-api.service[62053]: Host: 10.0.0.210 Apr 13 16:24:54 user devstack@n-api.service[62053]: Openstack-System-Scope: None Apr 13 16:24:54 user devstack@n-api.service[62053]: User-Agent: python-urllib3/1.26.15 Apr 13 16:24:54 user devstack@n-api.service[62053]: X-Auth-Token: gAAAAABkOCwkI2hCVv3q2RMbn5sWNaNksO2jlEae5ib0A_n2-4Ip_Pl-WyakKOiBGyr1g-8idBZHWfWrP88wr7DW2Z-7RXK4r2oTVrS71NZCSisAoUDBhj4KwKB40I0svywhzMPIjrB1h0EwajlcYKhM2GYo5FTaZ-MnJbSWEwEZAY8gyi1eSaE Apr 13 16:24:54 user devstack@n-api.service[62053]: X-Domain-Id: None Apr 13 16:24:54 user devstack@n-api.service[62053]: X-Domain-Name: None Apr 13 16:24:54 user devstack@n-api.service[62053]: X-Identity-Status: Confirmed Apr 13 16:24:54 user devstack@n-api.service[62053]: X-Is-Admin-Project: True Apr 13 16:24:54 user devstack@n-api.service[62053]: X-Project-Domain-Id: default Apr 13 16:24:54 user devstack@n-api.service[62053]: X-Project-Domain-Name: Default Apr 13 16:24:54 user devstack@n-api.service[62053]: X-Project-Id: 8d451e0e239f486aa2b3abe9e273eab3 Apr 13 16:24:54 user devstack@n-api.service[62053]: X-Project-Name: tempest-TestVolumeBootPattern-438786227 Apr 13 16:24:54 user devstack@n-api.service[62053]: X-Role: reader,member Apr 13 16:24:54 user devstack@n-api.service[62053]: X-Roles: reader,member Apr 13 16:24:54 user devstack@n-api.service[62053]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8d451e0e239f486aa2b3abe9e273eab3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8d451e0e239f486aa2b3abe9e273eab3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8d451e0e239f486aa2b3abe9e273eab3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 13 16:24:54 user devstack@n-api.service[62053]: X-Tenant: tempest-TestVolumeBootPattern-438786227 Apr 13 16:24:54 user devstack@n-api.service[62053]: X-Tenant-Id: 8d451e0e239f486aa2b3abe9e273eab3 Apr 13 16:24:54 user devstack@n-api.service[62053]: X-Tenant-Name: tempest-TestVolumeBootPattern-438786227 Apr 13 16:24:54 user devstack@n-api.service[62053]: X-User: tempest-TestVolumeBootPattern-438786227-project-member Apr 13 16:24:54 user devstack@n-api.service[62053]: X-User-Domain-Id: default Apr 13 16:24:54 user devstack@n-api.service[62053]: X-User-Domain-Name: Default Apr 13 16:24:54 user devstack@n-api.service[62053]: X-User-Id: d70e10f63cdd49a9a1ebe1fe4c9de0a2 Apr 13 16:24:54 user devstack@n-api.service[62053]: X-User-Name: tempest-TestVolumeBootPattern-438786227-project-member Apr 13 16:24:54 user devstack@n-api.service[62053]: method: > Apr 13 16:24:54 user devstack@n-api.service[62053]: exception: Instance db65920b-7872-44c1-a68a-a696681d9d95 could not be found. Apr 13 16:24:54 user devstack@n-api.service[62053]: action_args: {'id': 'db65920b-7872-44c1-a68a-a696681d9d95'} Apr 13 16:24:54 user devstack@n-api.service[62053]: {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 16:24:54 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:24:54 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 16:24:54 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 16:24:54 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 16:24:54 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 16:24:54 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 16:24:54 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 16:24:54 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 16:24:54 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 16:24:54 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db65920b-7872-44c1-a68a-a696681d9d95 could not be found. Apr 13 16:24:54 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:24:54 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:24:54 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:24:54 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:24:54 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 16:24:54 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 16:24:54 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 16:24:54 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 16:24:54 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 16:24:54 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 16:24:54 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 16:24:54 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 16:24:54 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 16:24:54 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 16:24:54 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 16:24:54 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 16:24:54 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db65920b-7872-44c1-a68a-a696681d9d95 could not be found. Apr 13 16:24:54 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:24:54 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:24:54 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:24:54 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:24:54 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 16:24:54 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 16:24:54 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 16:24:54 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 16:24:54 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db65920b-7872-44c1-a68a-a696681d9d95 could not be found. Apr 13 16:24:54 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:24:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-e110ef43-bc08-4d04-98a0-15c56bb668f3 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Returning 404 to user: Instance db65920b-7872-44c1-a68a-a696681d9d95 could not be found. {{(pid=62053) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 16:24:54 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-e110ef43-bc08-4d04-98a0-15c56bb668f3 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] 10.0.0.210 "GET /compute/v2.1/servers/db65920b-7872-44c1-a68a-a696681d9d95" status: 404 len: 111 microversion: 2.1 time: 0.032308 Apr 13 16:24:54 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 114/343] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:24:54 2023] GET /compute/v2.1/servers/db65920b-7872-44c1-a68a-a696681d9d95 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 16:24:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-a8bb9b97-d72c-4f21-ba13-20ae0786e4b4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:24:54 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-a8bb9b97-d72c-4f21-ba13-20ae0786e4b4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: db65920b-7872-44c1-a68a-a696681d9d95] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:24:54 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-a8bb9b97-d72c-4f21-ba13-20ae0786e4b4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:24:54 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-a8bb9b97-d72c-4f21-ba13-20ae0786e4b4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:24:54 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-a8bb9b97-d72c-4f21-ba13-20ae0786e4b4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:24:54 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-a8bb9b97-d72c-4f21-ba13-20ae0786e4b4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:24:54 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-a8bb9b97-d72c-4f21-ba13-20ae0786e4b4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:24:54 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-a8bb9b97-d72c-4f21-ba13-20ae0786e4b4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:24:54 user devstack@n-api.service[62055]: INFO nova.api.openstack.wsgi [None req-a8bb9b97-d72c-4f21-ba13-20ae0786e4b4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] HTTP exception thrown: Instance db65920b-7872-44c1-a68a-a696681d9d95 could not be found. Apr 13 16:24:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-a8bb9b97-d72c-4f21-ba13-20ae0786e4b4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Request method failure captured: Apr 13 16:24:54 user devstack@n-api.service[62055]: request: DELETE /compute/v2.1/servers/db65920b-7872-44c1-a68a-a696681d9d95 HTTP/1.1 Apr 13 16:24:54 user devstack@n-api.service[62055]: Accept: application/json Apr 13 16:24:54 user devstack@n-api.service[62055]: Accept-Encoding: identity Apr 13 16:24:54 user devstack@n-api.service[62055]: Connection: close Apr 13 16:24:54 user devstack@n-api.service[62055]: Content-Length: 0 Apr 13 16:24:54 user devstack@n-api.service[62055]: Content-Type: application/json Apr 13 16:24:54 user devstack@n-api.service[62055]: Host: 10.0.0.210 Apr 13 16:24:54 user devstack@n-api.service[62055]: Openstack-System-Scope: None Apr 13 16:24:54 user devstack@n-api.service[62055]: User-Agent: python-urllib3/1.26.15 Apr 13 16:24:54 user devstack@n-api.service[62055]: X-Auth-Token: gAAAAABkOCwkI2hCVv3q2RMbn5sWNaNksO2jlEae5ib0A_n2-4Ip_Pl-WyakKOiBGyr1g-8idBZHWfWrP88wr7DW2Z-7RXK4r2oTVrS71NZCSisAoUDBhj4KwKB40I0svywhzMPIjrB1h0EwajlcYKhM2GYo5FTaZ-MnJbSWEwEZAY8gyi1eSaE Apr 13 16:24:54 user devstack@n-api.service[62055]: X-Domain-Id: None Apr 13 16:24:54 user devstack@n-api.service[62055]: X-Domain-Name: None Apr 13 16:24:54 user devstack@n-api.service[62055]: X-Identity-Status: Confirmed Apr 13 16:24:54 user devstack@n-api.service[62055]: X-Is-Admin-Project: True Apr 13 16:24:54 user devstack@n-api.service[62055]: X-Project-Domain-Id: default Apr 13 16:24:54 user devstack@n-api.service[62055]: X-Project-Domain-Name: Default Apr 13 16:24:54 user devstack@n-api.service[62055]: X-Project-Id: 8d451e0e239f486aa2b3abe9e273eab3 Apr 13 16:24:54 user devstack@n-api.service[62055]: X-Project-Name: tempest-TestVolumeBootPattern-438786227 Apr 13 16:24:54 user devstack@n-api.service[62055]: X-Role: reader,member Apr 13 16:24:54 user devstack@n-api.service[62055]: X-Roles: reader,member Apr 13 16:24:54 user devstack@n-api.service[62055]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8d451e0e239f486aa2b3abe9e273eab3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8d451e0e239f486aa2b3abe9e273eab3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8d451e0e239f486aa2b3abe9e273eab3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 13 16:24:54 user devstack@n-api.service[62055]: X-Tenant: tempest-TestVolumeBootPattern-438786227 Apr 13 16:24:54 user devstack@n-api.service[62055]: X-Tenant-Id: 8d451e0e239f486aa2b3abe9e273eab3 Apr 13 16:24:54 user devstack@n-api.service[62055]: X-Tenant-Name: tempest-TestVolumeBootPattern-438786227 Apr 13 16:24:54 user devstack@n-api.service[62055]: X-User: tempest-TestVolumeBootPattern-438786227-project-member Apr 13 16:24:54 user devstack@n-api.service[62055]: X-User-Domain-Id: default Apr 13 16:24:54 user devstack@n-api.service[62055]: X-User-Domain-Name: Default Apr 13 16:24:54 user devstack@n-api.service[62055]: X-User-Id: d70e10f63cdd49a9a1ebe1fe4c9de0a2 Apr 13 16:24:54 user devstack@n-api.service[62055]: X-User-Name: tempest-TestVolumeBootPattern-438786227-project-member Apr 13 16:24:54 user devstack@n-api.service[62055]: method: > Apr 13 16:24:54 user devstack@n-api.service[62055]: exception: Instance db65920b-7872-44c1-a68a-a696681d9d95 could not be found. Apr 13 16:24:54 user devstack@n-api.service[62055]: action_args: {'id': 'db65920b-7872-44c1-a68a-a696681d9d95'} Apr 13 16:24:54 user devstack@n-api.service[62055]: {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 16:24:54 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:24:54 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 16:24:54 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 16:24:54 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 16:24:54 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 16:24:54 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 16:24:54 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 16:24:54 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 16:24:54 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 16:24:54 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db65920b-7872-44c1-a68a-a696681d9d95 could not be found. Apr 13 16:24:54 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:24:54 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:24:54 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:24:54 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:24:54 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 16:24:54 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 16:24:54 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 16:24:54 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 16:24:54 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 16:24:54 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 16:24:54 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 16:24:54 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 16:24:54 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 16:24:54 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 16:24:54 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 16:24:54 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 16:24:54 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 16:24:54 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 16:24:54 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db65920b-7872-44c1-a68a-a696681d9d95 could not be found. Apr 13 16:24:54 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:24:54 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:24:54 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:24:54 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:24:54 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 16:24:54 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 16:24:54 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 16:24:54 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 16:24:54 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db65920b-7872-44c1-a68a-a696681d9d95 could not be found. Apr 13 16:24:54 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:24:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-a8bb9b97-d72c-4f21-ba13-20ae0786e4b4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Returning 404 to user: Instance db65920b-7872-44c1-a68a-a696681d9d95 could not be found. {{(pid=62055) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 16:24:54 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-a8bb9b97-d72c-4f21-ba13-20ae0786e4b4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/db65920b-7872-44c1-a68a-a696681d9d95" status: 404 len: 111 microversion: 2.1 time: 0.030124 Apr 13 16:24:54 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 115/344] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 16:24:54 2023] DELETE /compute/v2.1/servers/db65920b-7872-44c1-a68a-a696681d9d95 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 16:24:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-d9ed8b05-f34e-491f-ad59-d482c2a58c66 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:24:54 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-d9ed8b05-f34e-491f-ad59-d482c2a58c66 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: db65920b-7872-44c1-a68a-a696681d9d95] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:24:54 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-d9ed8b05-f34e-491f-ad59-d482c2a58c66 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:24:54 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-d9ed8b05-f34e-491f-ad59-d482c2a58c66 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:24:54 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-d9ed8b05-f34e-491f-ad59-d482c2a58c66 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:24:54 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-d9ed8b05-f34e-491f-ad59-d482c2a58c66 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:24:54 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-d9ed8b05-f34e-491f-ad59-d482c2a58c66 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:24:54 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-d9ed8b05-f34e-491f-ad59-d482c2a58c66 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:24:54 user devstack@n-api.service[62054]: INFO nova.api.openstack.wsgi [None req-d9ed8b05-f34e-491f-ad59-d482c2a58c66 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] HTTP exception thrown: Instance db65920b-7872-44c1-a68a-a696681d9d95 could not be found. Apr 13 16:24:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-d9ed8b05-f34e-491f-ad59-d482c2a58c66 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Request method failure captured: Apr 13 16:24:54 user devstack@n-api.service[62054]: request: GET /compute/v2.1/servers/db65920b-7872-44c1-a68a-a696681d9d95 HTTP/1.1 Apr 13 16:24:54 user devstack@n-api.service[62054]: Accept: application/json Apr 13 16:24:54 user devstack@n-api.service[62054]: Accept-Encoding: identity Apr 13 16:24:54 user devstack@n-api.service[62054]: Connection: close Apr 13 16:24:54 user devstack@n-api.service[62054]: Content-Length: 0 Apr 13 16:24:54 user devstack@n-api.service[62054]: Content-Type: application/json Apr 13 16:24:54 user devstack@n-api.service[62054]: Host: 10.0.0.210 Apr 13 16:24:54 user devstack@n-api.service[62054]: Openstack-System-Scope: None Apr 13 16:24:54 user devstack@n-api.service[62054]: User-Agent: python-urllib3/1.26.15 Apr 13 16:24:54 user devstack@n-api.service[62054]: X-Auth-Token: gAAAAABkOCwkI2hCVv3q2RMbn5sWNaNksO2jlEae5ib0A_n2-4Ip_Pl-WyakKOiBGyr1g-8idBZHWfWrP88wr7DW2Z-7RXK4r2oTVrS71NZCSisAoUDBhj4KwKB40I0svywhzMPIjrB1h0EwajlcYKhM2GYo5FTaZ-MnJbSWEwEZAY8gyi1eSaE Apr 13 16:24:54 user devstack@n-api.service[62054]: X-Domain-Id: None Apr 13 16:24:54 user devstack@n-api.service[62054]: X-Domain-Name: None Apr 13 16:24:54 user devstack@n-api.service[62054]: X-Identity-Status: Confirmed Apr 13 16:24:54 user devstack@n-api.service[62054]: X-Is-Admin-Project: True Apr 13 16:24:54 user devstack@n-api.service[62054]: X-Project-Domain-Id: default Apr 13 16:24:54 user devstack@n-api.service[62054]: X-Project-Domain-Name: Default Apr 13 16:24:54 user devstack@n-api.service[62054]: X-Project-Id: 8d451e0e239f486aa2b3abe9e273eab3 Apr 13 16:24:54 user devstack@n-api.service[62054]: X-Project-Name: tempest-TestVolumeBootPattern-438786227 Apr 13 16:24:54 user devstack@n-api.service[62054]: X-Role: reader,member Apr 13 16:24:54 user devstack@n-api.service[62054]: X-Roles: reader,member Apr 13 16:24:54 user devstack@n-api.service[62054]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8d451e0e239f486aa2b3abe9e273eab3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8d451e0e239f486aa2b3abe9e273eab3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8d451e0e239f486aa2b3abe9e273eab3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 13 16:24:54 user devstack@n-api.service[62054]: X-Tenant: tempest-TestVolumeBootPattern-438786227 Apr 13 16:24:54 user devstack@n-api.service[62054]: X-Tenant-Id: 8d451e0e239f486aa2b3abe9e273eab3 Apr 13 16:24:54 user devstack@n-api.service[62054]: X-Tenant-Name: tempest-TestVolumeBootPattern-438786227 Apr 13 16:24:54 user devstack@n-api.service[62054]: X-User: tempest-TestVolumeBootPattern-438786227-project-member Apr 13 16:24:54 user devstack@n-api.service[62054]: X-User-Domain-Id: default Apr 13 16:24:54 user devstack@n-api.service[62054]: X-User-Domain-Name: Default Apr 13 16:24:54 user devstack@n-api.service[62054]: X-User-Id: d70e10f63cdd49a9a1ebe1fe4c9de0a2 Apr 13 16:24:54 user devstack@n-api.service[62054]: X-User-Name: tempest-TestVolumeBootPattern-438786227-project-member Apr 13 16:24:54 user devstack@n-api.service[62054]: method: > Apr 13 16:24:54 user devstack@n-api.service[62054]: exception: Instance db65920b-7872-44c1-a68a-a696681d9d95 could not be found. Apr 13 16:24:54 user devstack@n-api.service[62054]: action_args: {'id': 'db65920b-7872-44c1-a68a-a696681d9d95'} Apr 13 16:24:54 user devstack@n-api.service[62054]: {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 16:24:54 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:24:54 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 16:24:54 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 16:24:54 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 16:24:54 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 16:24:54 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 16:24:54 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 16:24:54 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 16:24:54 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 16:24:54 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db65920b-7872-44c1-a68a-a696681d9d95 could not be found. Apr 13 16:24:54 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:24:54 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:24:54 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:24:54 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:24:54 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 16:24:54 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 16:24:54 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 16:24:54 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 16:24:54 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 16:24:54 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 16:24:54 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 16:24:54 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 16:24:54 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 16:24:54 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 16:24:54 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 16:24:54 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 16:24:54 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db65920b-7872-44c1-a68a-a696681d9d95 could not be found. Apr 13 16:24:54 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:24:54 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:24:54 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:24:54 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:24:54 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 16:24:54 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 16:24:54 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 16:24:54 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 16:24:54 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db65920b-7872-44c1-a68a-a696681d9d95 could not be found. Apr 13 16:24:54 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:24:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-d9ed8b05-f34e-491f-ad59-d482c2a58c66 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Returning 404 to user: Instance db65920b-7872-44c1-a68a-a696681d9d95 could not be found. {{(pid=62054) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 16:24:54 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-d9ed8b05-f34e-491f-ad59-d482c2a58c66 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] 10.0.0.210 "GET /compute/v2.1/servers/db65920b-7872-44c1-a68a-a696681d9d95" status: 404 len: 111 microversion: 2.1 time: 0.028803 Apr 13 16:24:54 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 116/345] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:24:54 2023] GET /compute/v2.1/servers/db65920b-7872-44c1-a68a-a696681d9d95 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 16:24:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-c757016d-2799-4d0b-a2ee-99944ee64efc req-b75d7c90-0397-4fb3-a6e9-3b50188d6ed0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "902e4077-e0d6-4b61-a861-883be253f1e0", "name": "network-vif-plugged", "status": "completed", "tag": "58b69a6e-8c04-42e5-931a-0947d9c0f78d"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:24:54 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-c757016d-2799-4d0b-a2ee-99944ee64efc req-b75d7c90-0397-4fb3-a6e9-3b50188d6ed0 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:24:54 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-c757016d-2799-4d0b-a2ee-99944ee64efc req-b75d7c90-0397-4fb3-a6e9-3b50188d6ed0 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:24:54 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-c757016d-2799-4d0b-a2ee-99944ee64efc req-b75d7c90-0397-4fb3-a6e9-3b50188d6ed0 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:24:54 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-c757016d-2799-4d0b-a2ee-99944ee64efc req-b75d7c90-0397-4fb3-a6e9-3b50188d6ed0 service nova] Creating event network-vif-plugged:58b69a6e-8c04-42e5-931a-0947d9c0f78d for instance 902e4077-e0d6-4b61-a861-883be253f1e0 on user Apr 13 16:24:54 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [req-c757016d-2799-4d0b-a2ee-99944ee64efc req-b75d7c90-0397-4fb3-a6e9-3b50188d6ed0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033989 Apr 13 16:24:54 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 115/346] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:24:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:25:00 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-cc9b81dd-92ac-463a-ab7d-58dc2c773b3d tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:25:00 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-cc9b81dd-92ac-463a-ab7d-58dc2c773b3d tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:25:00 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-cc9b81dd-92ac-463a-ab7d-58dc2c773b3d tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:25:00 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-cc9b81dd-92ac-463a-ab7d-58dc2c773b3d tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:25:00 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-cc9b81dd-92ac-463a-ab7d-58dc2c773b3d tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:25:00 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-cc9b81dd-92ac-463a-ab7d-58dc2c773b3d tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:25:00 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-cc9b81dd-92ac-463a-ab7d-58dc2c773b3d tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:25:00 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-cc9b81dd-92ac-463a-ab7d-58dc2c773b3d tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:25:00 user devstack@n-api.service[62055]: DEBUG nova.policy [None req-cc9b81dd-92ac-463a-ab7d-58dc2c773b3d tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fab402fb794a5a9281cfb7fe188813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24904988cf334657b084fd726c7ecf8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62055) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:25:00 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-cc9b81dd-92ac-463a-ab7d-58dc2c773b3d tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eaae47b9-a059-49f6-9ae6-d7147003e2f2" status: 200 len: 1537 microversion: 2.1 time: 0.377545 Apr 13 16:25:00 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 116/347] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:25:00 2023] GET /compute/v2.1/servers/eaae47b9-a059-49f6-9ae6-d7147003e2f2 => generated 1537 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:25:00 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-e133c1ca-d9d4-4a95-891d-b642f71ff971 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:25:00 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-e133c1ca-d9d4-4a95-891d-b642f71ff971 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] [instance: 8c6d8096-853b-4091-ad82-6faf8ffc85fa] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:25:00 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_cell0:SELECT=2 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:25:00 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_cell0:SELECT=6 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:25:00 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-e133c1ca-d9d4-4a95-891d-b642f71ff971 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:25:00 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-e133c1ca-d9d4-4a95-891d-b642f71ff971 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:25:00 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-e133c1ca-d9d4-4a95-891d-b642f71ff971 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:25:00 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-e133c1ca-d9d4-4a95-891d-b642f71ff971 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:25:00 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-e133c1ca-d9d4-4a95-891d-b642f71ff971 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:25:00 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-e133c1ca-d9d4-4a95-891d-b642f71ff971 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:25:00 user devstack@n-api.service[62054]: INFO nova.api.openstack.wsgi [None req-e133c1ca-d9d4-4a95-891d-b642f71ff971 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] HTTP exception thrown: Instance 8c6d8096-853b-4091-ad82-6faf8ffc85fa could not be found. Apr 13 16:25:00 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-e133c1ca-d9d4-4a95-891d-b642f71ff971 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Request method failure captured: Apr 13 16:25:00 user devstack@n-api.service[62054]: request: GET /compute/v2.1/servers/8c6d8096-853b-4091-ad82-6faf8ffc85fa HTTP/1.1 Apr 13 16:25:00 user devstack@n-api.service[62054]: Accept: application/json Apr 13 16:25:00 user devstack@n-api.service[62054]: Accept-Encoding: identity Apr 13 16:25:00 user devstack@n-api.service[62054]: Connection: close Apr 13 16:25:00 user devstack@n-api.service[62054]: Content-Length: 0 Apr 13 16:25:00 user devstack@n-api.service[62054]: Content-Type: application/json Apr 13 16:25:00 user devstack@n-api.service[62054]: Host: 10.0.0.210 Apr 13 16:25:00 user devstack@n-api.service[62054]: Openstack-System-Scope: None Apr 13 16:25:00 user devstack@n-api.service[62054]: User-Agent: python-urllib3/1.26.15 Apr 13 16:25:00 user devstack@n-api.service[62054]: X-Auth-Token: gAAAAABkOCvENi-Ng3Ks3FyRwoeqWV8dUwCUJ_tLKtww2Qm4M_XhpV-tgl7rzW6-w9ixceOQR_C1iijksS4ljlb1zNNVnFAnRO05FwUk6dJ178kAEQAccwJQfybXzCyOPrY9v4aS3euZjMuK2ARqJenjkyWP-tygrjIau1vzvbEEMT3NcNkGywQ Apr 13 16:25:00 user devstack@n-api.service[62054]: X-Domain-Id: None Apr 13 16:25:00 user devstack@n-api.service[62054]: X-Domain-Name: None Apr 13 16:25:00 user devstack@n-api.service[62054]: X-Identity-Status: Confirmed Apr 13 16:25:00 user devstack@n-api.service[62054]: X-Is-Admin-Project: True Apr 13 16:25:00 user devstack@n-api.service[62054]: X-Project-Domain-Id: default Apr 13 16:25:00 user devstack@n-api.service[62054]: X-Project-Domain-Name: Default Apr 13 16:25:00 user devstack@n-api.service[62054]: X-Project-Id: dc3e2169a6c44d05b2a2eedbe3a063cb Apr 13 16:25:00 user devstack@n-api.service[62054]: X-Project-Name: tempest-TestVolumeSwap-2131472698 Apr 13 16:25:00 user devstack@n-api.service[62054]: X-Role: reader,member Apr 13 16:25:00 user devstack@n-api.service[62054]: X-Roles: reader,member Apr 13 16:25:00 user devstack@n-api.service[62054]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/dc3e2169a6c44d05b2a2eedbe3a063cb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/dc3e2169a6c44d05b2a2eedbe3a063cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/dc3e2169a6c44d05b2a2eedbe3a063cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 13 16:25:00 user devstack@n-api.service[62054]: X-Tenant: tempest-TestVolumeSwap-2131472698 Apr 13 16:25:00 user devstack@n-api.service[62054]: X-Tenant-Id: dc3e2169a6c44d05b2a2eedbe3a063cb Apr 13 16:25:00 user devstack@n-api.service[62054]: X-Tenant-Name: tempest-TestVolumeSwap-2131472698 Apr 13 16:25:00 user devstack@n-api.service[62054]: X-User: tempest-TestVolumeSwap-2131472698-project-member Apr 13 16:25:00 user devstack@n-api.service[62054]: X-User-Domain-Id: default Apr 13 16:25:00 user devstack@n-api.service[62054]: X-User-Domain-Name: Default Apr 13 16:25:00 user devstack@n-api.service[62054]: X-User-Id: 25b5e87b35e0471cafe541fdf224b5bd Apr 13 16:25:00 user devstack@n-api.service[62054]: X-User-Name: tempest-TestVolumeSwap-2131472698-project-member Apr 13 16:25:00 user devstack@n-api.service[62054]: method: > Apr 13 16:25:00 user devstack@n-api.service[62054]: exception: Instance 8c6d8096-853b-4091-ad82-6faf8ffc85fa could not be found. Apr 13 16:25:00 user devstack@n-api.service[62054]: action_args: {'id': '8c6d8096-853b-4091-ad82-6faf8ffc85fa'} Apr 13 16:25:00 user devstack@n-api.service[62054]: {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 16:25:00 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:25:00 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 16:25:00 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 16:25:00 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 16:25:00 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 16:25:00 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 16:25:00 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 16:25:00 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 16:25:00 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 16:25:00 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c6d8096-853b-4091-ad82-6faf8ffc85fa could not be found. Apr 13 16:25:00 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:25:00 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:25:00 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:25:00 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:25:00 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 16:25:00 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 16:25:00 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 16:25:00 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 16:25:00 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 16:25:00 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 16:25:00 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 16:25:00 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 16:25:00 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 16:25:00 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 16:25:00 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 16:25:00 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 16:25:00 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c6d8096-853b-4091-ad82-6faf8ffc85fa could not be found. Apr 13 16:25:00 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:25:00 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:25:00 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:25:00 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:25:00 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 16:25:00 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 16:25:00 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 16:25:00 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 16:25:00 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c6d8096-853b-4091-ad82-6faf8ffc85fa could not be found. Apr 13 16:25:00 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:25:00 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-e133c1ca-d9d4-4a95-891d-b642f71ff971 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Returning 404 to user: Instance 8c6d8096-853b-4091-ad82-6faf8ffc85fa could not be found. {{(pid=62054) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 16:25:00 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-e133c1ca-d9d4-4a95-891d-b642f71ff971 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8c6d8096-853b-4091-ad82-6faf8ffc85fa" status: 404 len: 111 microversion: 2.1 time: 0.031046 Apr 13 16:25:00 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 117/348] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:25:00 2023] GET /compute/v2.1/servers/8c6d8096-853b-4091-ad82-6faf8ffc85fa => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 16:25:00 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_cell0:SELECT=2 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:25:00 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-047be5cc-0297-42a1-a1a8-664e07b27ec2 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Calling method '.version_select at 0x7f96e4ae9990>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:25:00 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-047be5cc-0297-42a1-a1a8-664e07b27ec2 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1417187439" status: 202 len: 0 microversion: 2.1 time: 0.026917 Apr 13 16:25:00 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 116/349] 10.0.0.210 () {62 vars in 1298 bytes} [Thu Apr 13 16:25:00 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1417187439 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 16:25:02 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-ff8d934f-c58d-4bef-a206-c51e6e19922a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-1961905208", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"uuid": "e4317bfd-71c2-4c48-a0f0-e3c795f262a8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "d36bc206-f629-4d6e-8a3f-458061d7b525"}]}} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:25:02 user devstack@n-api.service[62055]: DEBUG nova.network.neutron [None req-ff8d934f-c58d-4bef-a206-c51e6e19922a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] validate_networks() for [('d36bc206-f629-4d6e-8a3f-458061d7b525', None, None, None, None, None)] {{(pid=62055) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 16:25:03 user devstack@n-api.service[62055]: DEBUG nova.virt.hardware [None req-ff8d934f-c58d-4bef-a206-c51e6e19922a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Flavor limits 0:0:0 {{(pid=62055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 16:25:03 user devstack@n-api.service[62055]: DEBUG nova.virt.hardware [None req-ff8d934f-c58d-4bef-a206-c51e6e19922a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Image limits 0:0:0 {{(pid=62055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 16:25:03 user devstack@n-api.service[62055]: DEBUG nova.virt.hardware [None req-ff8d934f-c58d-4bef-a206-c51e6e19922a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Flavor pref 0:0:0 {{(pid=62055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 16:25:03 user devstack@n-api.service[62055]: DEBUG nova.virt.hardware [None req-ff8d934f-c58d-4bef-a206-c51e6e19922a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Image pref 0:0:0 {{(pid=62055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 16:25:03 user devstack@n-api.service[62055]: DEBUG nova.virt.hardware [None req-ff8d934f-c58d-4bef-a206-c51e6e19922a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 16:25:03 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-ff8d934f-c58d-4bef-a206-c51e6e19922a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:25:03 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-ff8d934f-c58d-4bef-a206-c51e6e19922a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:25:03 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-ff8d934f-c58d-4bef-a206-c51e6e19922a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:25:03 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-ff8d934f-c58d-4bef-a206-c51e6e19922a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:25:03 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-ff8d934f-c58d-4bef-a206-c51e6e19922a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:25:03 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-ff8d934f-c58d-4bef-a206-c51e6e19922a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:25:03 user devstack@n-api.service[62055]: DEBUG nova.quota [None req-ff8d934f-c58d-4bef-a206-c51e6e19922a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Getting quotas for project 8d451e0e239f486aa2b3abe9e273eab3. Resources: {'instances', 'cores', 'ram'} {{(pid=62055) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 16:25:03 user devstack@n-api.service[62055]: DEBUG nova.quota [None req-ff8d934f-c58d-4bef-a206-c51e6e19922a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Getting quotas for user d70e10f63cdd49a9a1ebe1fe4c9de0a2 and project 8d451e0e239f486aa2b3abe9e273eab3. Resources: {'instances', 'cores', 'ram'} {{(pid=62055) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 16:25:03 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-ff8d934f-c58d-4bef-a206-c51e6e19922a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Going to run 1 instances... {{(pid=62055) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 16:25:03 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-ff8d934f-c58d-4bef-a206-c51e6e19922a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 5ea4ab6a-6501-4a2f-a8f7-04090024747d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e4317bfd-71c2-4c48-a0f0-e3c795f262a8',volume_size=None,volume_type=None)] {{(pid=62055) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 16:25:03 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-ff8d934f-c58d-4bef-a206-c51e6e19922a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.877346 Apr 13 16:25:03 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 117/350] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 16:25:02 2023] POST /compute/v2.1/servers => generated 378 bytes in 879 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 16:25:03 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-bf418b8e-4d17-4017-a39b-427110ede584 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:25:03 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-bf418b8e-4d17-4017-a39b-427110ede584 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 5ea4ab6a-6501-4a2f-a8f7-04090024747d] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:25:03 user devstack@n-api.service[62054]: DEBUG nova.policy [None req-bf418b8e-4d17-4017-a39b-427110ede584 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e10f63cdd49a9a1ebe1fe4c9de0a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d451e0e239f486aa2b3abe9e273eab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62054) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:25:03 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-bf418b8e-4d17-4017-a39b-427110ede584 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5ea4ab6a-6501-4a2f-a8f7-04090024747d" status: 200 len: 1066 microversion: 2.1 time: 0.173918 Apr 13 16:25:03 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 118/351] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:25:03 2023] GET /compute/v2.1/servers/5ea4ab6a-6501-4a2f-a8f7-04090024747d => generated 1066 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:25:05 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_cell1:SELECT=6 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:25:05 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-a82bcc4a-8f0d-440e-8e98-b31ad960faf4 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Action: 'action', calling method: >, body: {"rescue": {"rescue_image_ref": "1471081c-1dcc-4e86-af15-c22b3918bd0a"}} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:25:05 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-a82bcc4a-8f0d-440e-8e98-b31ad960faf4 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:25:05 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-a82bcc4a-8f0d-440e-8e98-b31ad960faf4 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:25:05 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-a82bcc4a-8f0d-440e-8e98-b31ad960faf4 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:25:05 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-a82bcc4a-8f0d-440e-8e98-b31ad960faf4 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:25:05 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-a82bcc4a-8f0d-440e-8e98-b31ad960faf4 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:25:05 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-a82bcc4a-8f0d-440e-8e98-b31ad960faf4 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:25:05 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-a82bcc4a-8f0d-440e-8e98-b31ad960faf4 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:25:05 user devstack@n-api.service[62053]: DEBUG nova.objects.instance [None req-a82bcc4a-8f0d-440e-8e98-b31ad960faf4 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lazy-loading 'flavor' on Instance uuid 235f827c-7116-48e9-84c5-0c9761c18e1e {{(pid=62053) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 16:25:06 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-a82bcc4a-8f0d-440e-8e98-b31ad960faf4 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] 10.0.0.210 "POST /compute/v2.1/servers/235f827c-7116-48e9-84c5-0c9761c18e1e/action" status: 200 len: 29 microversion: 2.87 time: 0.916083 Apr 13 16:25:06 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 117/352] 10.0.0.210 () {66 vars in 1396 bytes} [Thu Apr 13 16:25:05 2023] POST /compute/v2.1/servers/235f827c-7116-48e9-84c5-0c9761c18e1e/action => generated 29 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:25:06 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-843b7905-b2be-455d-aec5-5c5975d5f2da tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:25:06 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-843b7905-b2be-455d-aec5-5c5975d5f2da tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:25:06 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-843b7905-b2be-455d-aec5-5c5975d5f2da tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:25:06 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-843b7905-b2be-455d-aec5-5c5975d5f2da tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:25:06 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-843b7905-b2be-455d-aec5-5c5975d5f2da tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:25:06 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-843b7905-b2be-455d-aec5-5c5975d5f2da tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:25:06 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-843b7905-b2be-455d-aec5-5c5975d5f2da tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:25:06 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-843b7905-b2be-455d-aec5-5c5975d5f2da tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:25:06 user devstack@n-api.service[62055]: DEBUG nova.policy [None req-843b7905-b2be-455d-aec5-5c5975d5f2da tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45a882dbafb4ea4976e4f45289eb2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d09a74bf684a9fb1dd1e95d6c23f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62055) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:25:06 user devstack@n-api.service[62055]: DEBUG nova.policy [None req-843b7905-b2be-455d-aec5-5c5975d5f2da tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e45a882dbafb4ea4976e4f45289eb2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d09a74bf684a9fb1dd1e95d6c23f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62055) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:25:06 user devstack@n-api.service[62055]: DEBUG nova.policy [None req-843b7905-b2be-455d-aec5-5c5975d5f2da tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e45a882dbafb4ea4976e4f45289eb2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d09a74bf684a9fb1dd1e95d6c23f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62055) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:25:06 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-843b7905-b2be-455d-aec5-5c5975d5f2da tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] 10.0.0.210 "GET /compute/v2.1/servers/235f827c-7116-48e9-84c5-0c9761c18e1e" status: 200 len: 1775 microversion: 2.87 time: 0.198033 Apr 13 16:25:06 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 118/353] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 16:25:06 2023] GET /compute/v2.1/servers/235f827c-7116-48e9-84c5-0c9761c18e1e => generated 1775 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 16:25:06 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-07fe3e76-f4b0-46b5-b749-64cff9c77905 req-3c9144cf-dc30-4d14-9304-112a46d39aeb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ea4ab6a-6501-4a2f-a8f7-04090024747d", "tag": "8a5c66fa-4693-4162-b5a8-2c80b33cf979"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:25:06 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-07fe3e76-f4b0-46b5-b749-64cff9c77905 req-3c9144cf-dc30-4d14-9304-112a46d39aeb service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:25:06 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-07fe3e76-f4b0-46b5-b749-64cff9c77905 req-3c9144cf-dc30-4d14-9304-112a46d39aeb service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:25:06 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-07fe3e76-f4b0-46b5-b749-64cff9c77905 req-3c9144cf-dc30-4d14-9304-112a46d39aeb service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:25:06 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-07fe3e76-f4b0-46b5-b749-64cff9c77905 req-3c9144cf-dc30-4d14-9304-112a46d39aeb service nova] Creating event network-changed:8a5c66fa-4693-4162-b5a8-2c80b33cf979 for instance 5ea4ab6a-6501-4a2f-a8f7-04090024747d on user Apr 13 16:25:06 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [req-07fe3e76-f4b0-46b5-b749-64cff9c77905 req-3c9144cf-dc30-4d14-9304-112a46d39aeb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034806 Apr 13 16:25:06 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 119/354] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:25:06 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:25:08 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-f05bad11-245b-4ab0-8ee6-1eb2b9b4c115 req-67eb36d8-9a32-4b03-bf0b-fd4c2f76843f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "235f827c-7116-48e9-84c5-0c9761c18e1e", "name": "network-vif-unplugged", "status": "completed", "tag": "b72a6c8b-7244-41c2-a4f7-6da43b4944b8"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:25:08 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-f05bad11-245b-4ab0-8ee6-1eb2b9b4c115 req-67eb36d8-9a32-4b03-bf0b-fd4c2f76843f service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:25:08 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-f05bad11-245b-4ab0-8ee6-1eb2b9b4c115 req-67eb36d8-9a32-4b03-bf0b-fd4c2f76843f service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:25:08 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-f05bad11-245b-4ab0-8ee6-1eb2b9b4c115 req-67eb36d8-9a32-4b03-bf0b-fd4c2f76843f service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:25:08 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-f05bad11-245b-4ab0-8ee6-1eb2b9b4c115 req-67eb36d8-9a32-4b03-bf0b-fd4c2f76843f service nova] Creating event network-vif-unplugged:b72a6c8b-7244-41c2-a4f7-6da43b4944b8 for instance 235f827c-7116-48e9-84c5-0c9761c18e1e on user Apr 13 16:25:08 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [req-f05bad11-245b-4ab0-8ee6-1eb2b9b4c115 req-67eb36d8-9a32-4b03-bf0b-fd4c2f76843f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041153 Apr 13 16:25:08 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 118/355] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:25:08 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:25:10 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [req-8f4c34b7-c789-4048-9ee3-2dfa4918dd13 req-ab7a3bd3-d39f-48da-b458-94a0b430b44a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "235f827c-7116-48e9-84c5-0c9761c18e1e", "name": "network-vif-plugged", "status": "completed", "tag": "b72a6c8b-7244-41c2-a4f7-6da43b4944b8"}]} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:25:10 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-8f4c34b7-c789-4048-9ee3-2dfa4918dd13 req-ab7a3bd3-d39f-48da-b458-94a0b430b44a service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:25:10 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-8f4c34b7-c789-4048-9ee3-2dfa4918dd13 req-ab7a3bd3-d39f-48da-b458-94a0b430b44a service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:25:10 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-8f4c34b7-c789-4048-9ee3-2dfa4918dd13 req-ab7a3bd3-d39f-48da-b458-94a0b430b44a service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:25:10 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-8f4c34b7-c789-4048-9ee3-2dfa4918dd13 req-ab7a3bd3-d39f-48da-b458-94a0b430b44a service nova] Creating event network-vif-plugged:b72a6c8b-7244-41c2-a4f7-6da43b4944b8 for instance 235f827c-7116-48e9-84c5-0c9761c18e1e on user Apr 13 16:25:10 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [req-8f4c34b7-c789-4048-9ee3-2dfa4918dd13 req-ab7a3bd3-d39f-48da-b458-94a0b430b44a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036827 Apr 13 16:25:10 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 119/356] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:25:10 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:25:12 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-433548c7-0150-4b54-9b7a-cad7743cb355 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:25:12 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-433548c7-0150-4b54-9b7a-cad7743cb355 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:25:12 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-433548c7-0150-4b54-9b7a-cad7743cb355 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:25:12 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-433548c7-0150-4b54-9b7a-cad7743cb355 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:25:12 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-433548c7-0150-4b54-9b7a-cad7743cb355 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:25:12 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-433548c7-0150-4b54-9b7a-cad7743cb355 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:25:12 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-433548c7-0150-4b54-9b7a-cad7743cb355 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:25:12 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-433548c7-0150-4b54-9b7a-cad7743cb355 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:25:12 user devstack@n-api.service[62054]: DEBUG nova.policy [None req-433548c7-0150-4b54-9b7a-cad7743cb355 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf19848229f45baad45c490cf539508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7061f2f041954ffe90b0c87b422890e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62054) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:25:12 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-433548c7-0150-4b54-9b7a-cad7743cb355 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bbcccf4b-e861-4254-9be3-a491776214e9" status: 200 len: 1702 microversion: 2.1 time: 0.270651 Apr 13 16:25:12 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 120/357] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:25:12 2023] GET /compute/v2.1/servers/bbcccf4b-e861-4254-9be3-a491776214e9 => generated 1702 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:25:14 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-d4df9bc1-5355-4984-95aa-43303a9466f4 req-ac93f023-ba39-4024-a5b5-0bfe54c6255d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ea4ab6a-6501-4a2f-a8f7-04090024747d", "name": "network-vif-plugged", "status": "completed", "tag": "8a5c66fa-4693-4162-b5a8-2c80b33cf979"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:25:14 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-d4df9bc1-5355-4984-95aa-43303a9466f4 req-ac93f023-ba39-4024-a5b5-0bfe54c6255d service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:25:14 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-d4df9bc1-5355-4984-95aa-43303a9466f4 req-ac93f023-ba39-4024-a5b5-0bfe54c6255d service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:25:14 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-d4df9bc1-5355-4984-95aa-43303a9466f4 req-ac93f023-ba39-4024-a5b5-0bfe54c6255d service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:25:14 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-d4df9bc1-5355-4984-95aa-43303a9466f4 req-ac93f023-ba39-4024-a5b5-0bfe54c6255d service nova] Creating event network-vif-plugged:8a5c66fa-4693-4162-b5a8-2c80b33cf979 for instance 5ea4ab6a-6501-4a2f-a8f7-04090024747d on user Apr 13 16:25:14 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [req-d4df9bc1-5355-4984-95aa-43303a9466f4 req-ac93f023-ba39-4024-a5b5-0bfe54c6255d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039046 Apr 13 16:25:14 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 119/358] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:25:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:25:16 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [req-d1fa7daf-2c83-45f8-9440-514f240110bf req-83817299-33c7-4e43-a6a1-4e32e658d062 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "235f827c-7116-48e9-84c5-0c9761c18e1e", "name": "network-vif-plugged", "status": "completed", "tag": "b72a6c8b-7244-41c2-a4f7-6da43b4944b8"}]} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:25:16 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_cell0:SELECT=2 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:25:16 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_cell0:SELECT=6 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:25:16 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-d1fa7daf-2c83-45f8-9440-514f240110bf req-83817299-33c7-4e43-a6a1-4e32e658d062 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:25:16 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-d1fa7daf-2c83-45f8-9440-514f240110bf req-83817299-33c7-4e43-a6a1-4e32e658d062 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:25:16 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-d1fa7daf-2c83-45f8-9440-514f240110bf req-83817299-33c7-4e43-a6a1-4e32e658d062 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:25:16 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-d1fa7daf-2c83-45f8-9440-514f240110bf req-83817299-33c7-4e43-a6a1-4e32e658d062 service nova] Creating event network-vif-plugged:b72a6c8b-7244-41c2-a4f7-6da43b4944b8 for instance 235f827c-7116-48e9-84c5-0c9761c18e1e on user Apr 13 16:25:16 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [req-d1fa7daf-2c83-45f8-9440-514f240110bf req-83817299-33c7-4e43-a6a1-4e32e658d062 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043759 Apr 13 16:25:16 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 120/359] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:25:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:25:16 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-1ec2b6d2-7bad-470f-8220-9d2ed18b1679 req-a9b84f87-4e4f-4a71-b7a2-f2d132398039 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ea4ab6a-6501-4a2f-a8f7-04090024747d", "name": "network-vif-plugged", "status": "completed", "tag": "8a5c66fa-4693-4162-b5a8-2c80b33cf979"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:25:16 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_cell0:SELECT=2 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:25:16 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-1ec2b6d2-7bad-470f-8220-9d2ed18b1679 req-a9b84f87-4e4f-4a71-b7a2-f2d132398039 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:25:16 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-1ec2b6d2-7bad-470f-8220-9d2ed18b1679 req-a9b84f87-4e4f-4a71-b7a2-f2d132398039 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:25:16 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-1ec2b6d2-7bad-470f-8220-9d2ed18b1679 req-a9b84f87-4e4f-4a71-b7a2-f2d132398039 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:25:16 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-1ec2b6d2-7bad-470f-8220-9d2ed18b1679 req-a9b84f87-4e4f-4a71-b7a2-f2d132398039 service nova] Creating event network-vif-plugged:8a5c66fa-4693-4162-b5a8-2c80b33cf979 for instance 5ea4ab6a-6501-4a2f-a8f7-04090024747d on user Apr 13 16:25:16 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [req-1ec2b6d2-7bad-470f-8220-9d2ed18b1679 req-a9b84f87-4e4f-4a71-b7a2-f2d132398039 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041997 Apr 13 16:25:16 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 121/360] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:25:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:25:18 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-bf47f78b-0883-42e0-a228-1f8d150d18c4 req-7ddb176b-c4a2-42b2-800c-c76756a7d487 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "235f827c-7116-48e9-84c5-0c9761c18e1e", "name": "network-vif-plugged", "status": "completed", "tag": "b72a6c8b-7244-41c2-a4f7-6da43b4944b8"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:25:18 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_api:SELECT=20,nova_api:DELETE=1 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:25:18 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-bf47f78b-0883-42e0-a228-1f8d150d18c4 req-7ddb176b-c4a2-42b2-800c-c76756a7d487 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:25:18 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-bf47f78b-0883-42e0-a228-1f8d150d18c4 req-7ddb176b-c4a2-42b2-800c-c76756a7d487 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:25:18 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-bf47f78b-0883-42e0-a228-1f8d150d18c4 req-7ddb176b-c4a2-42b2-800c-c76756a7d487 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:25:18 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-bf47f78b-0883-42e0-a228-1f8d150d18c4 req-7ddb176b-c4a2-42b2-800c-c76756a7d487 service nova] Creating event network-vif-plugged:b72a6c8b-7244-41c2-a4f7-6da43b4944b8 for instance 235f827c-7116-48e9-84c5-0c9761c18e1e on user Apr 13 16:25:18 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [req-bf47f78b-0883-42e0-a228-1f8d150d18c4 req-7ddb176b-c4a2-42b2-800c-c76756a7d487 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049886 Apr 13 16:25:18 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 120/361] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:25:18 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:25:20 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-becb7a59-9b09-4ba6-b7f8-c164468f847d tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:25:20 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-becb7a59-9b09-4ba6-b7f8-c164468f847d tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:25:20 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:25:20 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-becb7a59-9b09-4ba6-b7f8-c164468f847d tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:25:20 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-becb7a59-9b09-4ba6-b7f8-c164468f847d tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:25:20 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-becb7a59-9b09-4ba6-b7f8-c164468f847d tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:25:20 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-becb7a59-9b09-4ba6-b7f8-c164468f847d tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:25:20 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-becb7a59-9b09-4ba6-b7f8-c164468f847d tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:25:20 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-becb7a59-9b09-4ba6-b7f8-c164468f847d tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:25:20 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_cell1:SELECT=29 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:25:20 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-becb7a59-9b09-4ba6-b7f8-c164468f847d tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=62055) unshelve /opt/stack/nova/nova/compute/api.py:4596}} Apr 13 16:25:21 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-becb7a59-9b09-4ba6-b7f8-c164468f847d tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] 10.0.0.210 "POST /compute/v2.1/servers/bf350da4-9cc2-4900-adf0-506e44984b42/action" status: 202 len: 0 microversion: 2.1 time: 0.260012 Apr 13 16:25:21 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 121/362] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 16:25:20 2023] POST /compute/v2.1/servers/bf350da4-9cc2-4900-adf0-506e44984b42/action => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 16:25:21 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-e6c46f9f-e7a2-4efa-a97e-8fa5c5abd9af tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:25:21 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-e6c46f9f-e7a2-4efa-a97e-8fa5c5abd9af tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:25:21 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-e6c46f9f-e7a2-4efa-a97e-8fa5c5abd9af tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:25:21 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-e6c46f9f-e7a2-4efa-a97e-8fa5c5abd9af tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:25:21 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-e6c46f9f-e7a2-4efa-a97e-8fa5c5abd9af tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:25:21 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-e6c46f9f-e7a2-4efa-a97e-8fa5c5abd9af tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:25:21 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-e6c46f9f-e7a2-4efa-a97e-8fa5c5abd9af tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:25:21 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-e6c46f9f-e7a2-4efa-a97e-8fa5c5abd9af tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:25:21 user devstack@n-api.service[62054]: DEBUG nova.policy [None req-e6c46f9f-e7a2-4efa-a97e-8fa5c5abd9af tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6a4bf1a7794af2958c3d53ea1e19c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed94fa5d89c2486b8e2951e608e6630f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62054) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:25:21 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-e6c46f9f-e7a2-4efa-a97e-8fa5c5abd9af tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bf350da4-9cc2-4900-adf0-506e44984b42" status: 200 len: 1505 microversion: 2.1 time: 0.213447 Apr 13 16:25:21 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 122/363] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:25:21 2023] GET /compute/v2.1/servers/bf350da4-9cc2-4900-adf0-506e44984b42 => generated 1505 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:25:27 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-e1cbfc09-d925-49dc-9090-2829b47d6ebf tempest-VolumesAdminNegativeTest-371232260 tempest-VolumesAdminNegativeTest-371232260-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "c6cc7218-85b8-48de-affd-6ce79c7ba237"}} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:25:27 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-e1cbfc09-d925-49dc-9090-2829b47d6ebf tempest-VolumesAdminNegativeTest-371232260 tempest-VolumesAdminNegativeTest-371232260-project-admin] [instance: 94a2b8c9-388d-454c-88a1-54d7a8506511] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:25:27 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-e1cbfc09-d925-49dc-9090-2829b47d6ebf tempest-VolumesAdminNegativeTest-371232260 tempest-VolumesAdminNegativeTest-371232260-project-admin] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:25:27 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-e1cbfc09-d925-49dc-9090-2829b47d6ebf tempest-VolumesAdminNegativeTest-371232260 tempest-VolumesAdminNegativeTest-371232260-project-admin] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:25:27 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-e1cbfc09-d925-49dc-9090-2829b47d6ebf tempest-VolumesAdminNegativeTest-371232260 tempest-VolumesAdminNegativeTest-371232260-project-admin] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:25:27 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-e1cbfc09-d925-49dc-9090-2829b47d6ebf tempest-VolumesAdminNegativeTest-371232260 tempest-VolumesAdminNegativeTest-371232260-project-admin] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:25:27 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-e1cbfc09-d925-49dc-9090-2829b47d6ebf tempest-VolumesAdminNegativeTest-371232260 tempest-VolumesAdminNegativeTest-371232260-project-admin] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:25:27 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-e1cbfc09-d925-49dc-9090-2829b47d6ebf tempest-VolumesAdminNegativeTest-371232260 tempest-VolumesAdminNegativeTest-371232260-project-admin] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:25:27 user devstack@n-api.service[62053]: INFO nova.api.openstack.wsgi [None req-e1cbfc09-d925-49dc-9090-2829b47d6ebf tempest-VolumesAdminNegativeTest-371232260 tempest-VolumesAdminNegativeTest-371232260-project-admin] HTTP exception thrown: Volume f7942cff-3774-420e-a95a-78e3173216c9 could not be found. Apr 13 16:25:27 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-e1cbfc09-d925-49dc-9090-2829b47d6ebf tempest-VolumesAdminNegativeTest-371232260 tempest-VolumesAdminNegativeTest-371232260-project-admin] Request method failure captured: Apr 13 16:25:27 user devstack@n-api.service[62053]: request: PUT /compute/v2.1/servers/94a2b8c9-388d-454c-88a1-54d7a8506511/os-volume_attachments/f7942cff-3774-420e-a95a-78e3173216c9 HTTP/1.1 Apr 13 16:25:27 user devstack@n-api.service[62053]: Accept: application/json Apr 13 16:25:27 user devstack@n-api.service[62053]: Accept-Encoding: identity Apr 13 16:25:27 user devstack@n-api.service[62053]: Connection: close Apr 13 16:25:27 user devstack@n-api.service[62053]: Content-Length: 74 Apr 13 16:25:27 user devstack@n-api.service[62053]: Content-Type: application/json Apr 13 16:25:27 user devstack@n-api.service[62053]: Host: 10.0.0.210 Apr 13 16:25:27 user devstack@n-api.service[62053]: Openstack-System-Scope: None Apr 13 16:25:27 user devstack@n-api.service[62053]: User-Agent: python-urllib3/1.26.15 Apr 13 16:25:27 user devstack@n-api.service[62053]: X-Auth-Token: gAAAAABkOCvN8XrrYeVNU4ED1X-t-jRAFqQBhFFAI5XIb5hgR6whGTaf9dXEXMb0safy0YIAgLp5F7vhlhjhCfeffrb_NEoZmX6ouxJWvHgtbLRTqv4l2G5THpx9eKqEKF8BgYk3InJmXf90oikRawJKklVVVbHp6w19eR1OOzW59x5k-5MYp6M Apr 13 16:25:27 user devstack@n-api.service[62053]: X-Domain-Id: None Apr 13 16:25:27 user devstack@n-api.service[62053]: X-Domain-Name: None Apr 13 16:25:27 user devstack@n-api.service[62053]: X-Identity-Status: Confirmed Apr 13 16:25:27 user devstack@n-api.service[62053]: X-Is-Admin-Project: True Apr 13 16:25:27 user devstack@n-api.service[62053]: X-Project-Domain-Id: default Apr 13 16:25:27 user devstack@n-api.service[62053]: X-Project-Domain-Name: Default Apr 13 16:25:27 user devstack@n-api.service[62053]: X-Project-Id: 21b4556b2ac64f729fca060c702570d4 Apr 13 16:25:27 user devstack@n-api.service[62053]: X-Project-Name: tempest-VolumesAdminNegativeTest-371232260 Apr 13 16:25:27 user devstack@n-api.service[62053]: X-Role: reader,member,admin Apr 13 16:25:27 user devstack@n-api.service[62053]: X-Roles: reader,member,admin Apr 13 16:25:27 user devstack@n-api.service[62053]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/21b4556b2ac64f729fca060c702570d4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/21b4556b2ac64f729fca060c702570d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/21b4556b2ac64f729fca060c702570d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 13 16:25:27 user devstack@n-api.service[62053]: X-Tenant: tempest-VolumesAdminNegativeTest-371232260 Apr 13 16:25:27 user devstack@n-api.service[62053]: X-Tenant-Id: 21b4556b2ac64f729fca060c702570d4 Apr 13 16:25:27 user devstack@n-api.service[62053]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-371232260 Apr 13 16:25:27 user devstack@n-api.service[62053]: X-User: tempest-VolumesAdminNegativeTest-371232260-project-admin Apr 13 16:25:27 user devstack@n-api.service[62053]: X-User-Domain-Id: default Apr 13 16:25:27 user devstack@n-api.service[62053]: X-User-Domain-Name: Default Apr 13 16:25:27 user devstack@n-api.service[62053]: X-User-Domain-Name: Default Apr 13 16:25:27 user devstack@n-api.service[62053]: X-User-Id: c3ca68fdc9844678a5307317df63c6cc Apr 13 16:25:27 user devstack@n-api.service[62053]: X-User-Name: tempest-VolumesAdminNegativeTest-371232260-project-admin Apr 13 16:25:27 user devstack@n-api.service[62053]: Apr 13 16:25:27 user devstack@n-api.service[62053]: {"volumeAttachment": {"volumeId": "c6cc7218-85b8-48de-affd-6ce79c7ba237"}} Apr 13 16:25:27 user devstack@n-api.service[62053]: method: > Apr 13 16:25:27 user devstack@n-api.service[62053]: exception: Volume f7942cff-3774-420e-a95a-78e3173216c9 could not be found. Apr 13 16:25:27 user devstack@n-api.service[62053]: action_args: {'server_id': '94a2b8c9-388d-454c-88a1-54d7a8506511', 'id': 'f7942cff-3774-420e-a95a-78e3173216c9', 'body': {'volumeAttachment': {'volumeId': 'c6cc7218-85b8-48de-affd-6ce79c7ba237'}}} Apr 13 16:25:27 user devstack@n-api.service[62053]: {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 16:25:27 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:25:27 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 13 16:25:27 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 13 16:25:27 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 13 16:25:27 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 13 16:25:27 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 13 16:25:27 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 13 16:25:27 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 13 16:25:27 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 13 16:25:27 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 13 16:25:27 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 13 16:25:27 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 16:25:27 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 16:25:27 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 16:25:27 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 16:25:27 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f7942cff-3774-420e-a95a-78e3173216c9 could not be found. (HTTP 404) (Request-ID: req-d37f81b8-c078-482c-97b0-7feedd8b24ae) Apr 13 16:25:27 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:25:27 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:25:27 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:25:27 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:25:27 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Apr 13 16:25:27 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Apr 13 16:25:27 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 13 16:25:27 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 13 16:25:27 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 13 16:25:27 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 13 16:25:27 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 13 16:25:27 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 13 16:25:27 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 13 16:25:27 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 13 16:25:27 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 13 16:25:27 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 13 16:25:27 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 13 16:25:27 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 13 16:25:27 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 13 16:25:27 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 13 16:25:27 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 13 16:25:27 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 13 16:25:27 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 16:25:27 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 16:25:27 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 16:25:27 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 16:25:27 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f7942cff-3774-420e-a95a-78e3173216c9 could not be found. Apr 13 16:25:27 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:25:27 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:25:27 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:25:27 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:25:27 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 16:25:27 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 16:25:27 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 16:25:27 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 16:25:27 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 16:25:27 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 16:25:27 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 13 16:25:27 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 16:25:27 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 13 16:25:27 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 16:25:27 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Apr 13 16:25:27 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Apr 13 16:25:27 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Apr 13 16:25:27 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 16:25:27 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f7942cff-3774-420e-a95a-78e3173216c9 could not be found. Apr 13 16:25:27 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:25:27 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:25:27 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:25:27 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:25:27 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 16:25:27 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 16:25:27 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 16:25:27 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 16:25:27 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f7942cff-3774-420e-a95a-78e3173216c9 could not be found. Apr 13 16:25:27 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:25:27 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-e1cbfc09-d925-49dc-9090-2829b47d6ebf tempest-VolumesAdminNegativeTest-371232260 tempest-VolumesAdminNegativeTest-371232260-project-admin] Returning 404 to user: Volume f7942cff-3774-420e-a95a-78e3173216c9 could not be found. {{(pid=62053) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 16:25:27 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-e1cbfc09-d925-49dc-9090-2829b47d6ebf tempest-VolumesAdminNegativeTest-371232260 tempest-VolumesAdminNegativeTest-371232260-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/94a2b8c9-388d-454c-88a1-54d7a8506511/os-volume_attachments/f7942cff-3774-420e-a95a-78e3173216c9" status: 404 len: 109 microversion: 2.1 time: 0.121405 Apr 13 16:25:27 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 121/364] 10.0.0.210 () {64 vars in 1510 bytes} [Thu Apr 13 16:25:27 2023] PUT /compute/v2.1/servers/94a2b8c9-388d-454c-88a1-54d7a8506511/os-volume_attachments/f7942cff-3774-420e-a95a-78e3173216c9 => generated 109 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 16:25:29 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [req-bd6cd2cc-9255-4260-8275-a9069efabccd req-c937a042-0e05-4d1b-baeb-d68e0db713e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf350da4-9cc2-4900-adf0-506e44984b42", "tag": "1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8"}]} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:25:29 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-bd6cd2cc-9255-4260-8275-a9069efabccd req-c937a042-0e05-4d1b-baeb-d68e0db713e2 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:25:29 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-bd6cd2cc-9255-4260-8275-a9069efabccd req-c937a042-0e05-4d1b-baeb-d68e0db713e2 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:25:29 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-bd6cd2cc-9255-4260-8275-a9069efabccd req-c937a042-0e05-4d1b-baeb-d68e0db713e2 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:25:29 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-bd6cd2cc-9255-4260-8275-a9069efabccd req-c937a042-0e05-4d1b-baeb-d68e0db713e2 service nova] Creating event network-changed:1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8 for instance bf350da4-9cc2-4900-adf0-506e44984b42 on user Apr 13 16:25:29 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [req-bd6cd2cc-9255-4260-8275-a9069efabccd req-c937a042-0e05-4d1b-baeb-d68e0db713e2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.196684 Apr 13 16:25:29 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 122/365] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:25:29 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:25:30 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-3346e234-3b5b-45f4-b20c-a7ad822e67db tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:25:30 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-3346e234-3b5b-45f4-b20c-a7ad822e67db tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] [instance: 94a2b8c9-388d-454c-88a1-54d7a8506511] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:25:31 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_api:SELECT=18 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:25:31 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-3346e234-3b5b-45f4-b20c-a7ad822e67db tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:25:31 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-3346e234-3b5b-45f4-b20c-a7ad822e67db tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:25:31 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-3346e234-3b5b-45f4-b20c-a7ad822e67db tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:25:31 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-3346e234-3b5b-45f4-b20c-a7ad822e67db tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:25:31 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-3346e234-3b5b-45f4-b20c-a7ad822e67db tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:25:31 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-3346e234-3b5b-45f4-b20c-a7ad822e67db tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:25:31 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_cell1:SELECT=22 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:25:31 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-3346e234-3b5b-45f4-b20c-a7ad822e67db tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] [instance: 94a2b8c9-388d-454c-88a1-54d7a8506511] Going to try to terminate instance {{(pid=62054) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 16:25:31 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-3346e234-3b5b-45f4-b20c-a7ad822e67db tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/94a2b8c9-388d-454c-88a1-54d7a8506511" status: 204 len: 0 microversion: 2.1 time: 0.204096 Apr 13 16:25:31 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 123/366] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 16:25:30 2023] DELETE /compute/v2.1/servers/94a2b8c9-388d-454c-88a1-54d7a8506511 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 16:25:31 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-53ed04cf-8888-46d8-a33c-0c1034c3b762 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:25:31 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-53ed04cf-8888-46d8-a33c-0c1034c3b762 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] [instance: 94a2b8c9-388d-454c-88a1-54d7a8506511] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:25:31 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-53ed04cf-8888-46d8-a33c-0c1034c3b762 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:25:31 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-53ed04cf-8888-46d8-a33c-0c1034c3b762 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:25:31 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-53ed04cf-8888-46d8-a33c-0c1034c3b762 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:25:31 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-53ed04cf-8888-46d8-a33c-0c1034c3b762 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:25:31 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-53ed04cf-8888-46d8-a33c-0c1034c3b762 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:25:31 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-53ed04cf-8888-46d8-a33c-0c1034c3b762 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:25:31 user devstack@n-api.service[62053]: DEBUG nova.policy [None req-53ed04cf-8888-46d8-a33c-0c1034c3b762 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cf399757f544649fed18ee5a31d50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ded8a69b7e941f9bcdc502cfeed79db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62053) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:25:31 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-53ed04cf-8888-46d8-a33c-0c1034c3b762 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] 10.0.0.210 "GET /compute/v2.1/servers/94a2b8c9-388d-454c-88a1-54d7a8506511" status: 200 len: 1503 microversion: 2.1 time: 0.414832 Apr 13 16:25:31 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 122/367] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:25:31 2023] GET /compute/v2.1/servers/94a2b8c9-388d-454c-88a1-54d7a8506511 => generated 1503 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:25:31 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-8b732700-16fb-4865-8986-801b7985404b tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:25:31 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-8b732700-16fb-4865-8986-801b7985404b tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:25:32 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-8b732700-16fb-4865-8986-801b7985404b tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:25:32 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-8b732700-16fb-4865-8986-801b7985404b tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:25:32 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-8b732700-16fb-4865-8986-801b7985404b tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:25:32 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-8b732700-16fb-4865-8986-801b7985404b tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:25:32 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-8b732700-16fb-4865-8986-801b7985404b tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:25:32 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-8b732700-16fb-4865-8986-801b7985404b tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:25:32 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-8b732700-16fb-4865-8986-801b7985404b tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] 10.0.0.210 "GET /compute/v2.1/servers/acbcaee0-a47b-4fee-8765-9b1c9597d515/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.212354 Apr 13 16:25:32 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 124/368] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 13 16:25:31 2023] GET /compute/v2.1/servers/acbcaee0-a47b-4fee-8765-9b1c9597d515/os-interface => generated 282 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:25:32 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [req-a838f36a-27f3-427a-80c1-aaa56f7ca5c8 req-a958c7f2-875f-46c3-a988-c9e4822c7d4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94a2b8c9-388d-454c-88a1-54d7a8506511", "name": "network-vif-unplugged", "status": "completed", "tag": "8731e8dd-3e93-4fa1-b8e6-f1d2d10271f7"}]} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:25:32 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-a838f36a-27f3-427a-80c1-aaa56f7ca5c8 req-a958c7f2-875f-46c3-a988-c9e4822c7d4f service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:25:32 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-a838f36a-27f3-427a-80c1-aaa56f7ca5c8 req-a958c7f2-875f-46c3-a988-c9e4822c7d4f service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:25:32 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-a838f36a-27f3-427a-80c1-aaa56f7ca5c8 req-a958c7f2-875f-46c3-a988-c9e4822c7d4f service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:25:32 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-a838f36a-27f3-427a-80c1-aaa56f7ca5c8 req-a958c7f2-875f-46c3-a988-c9e4822c7d4f service nova] Creating event network-vif-unplugged:8731e8dd-3e93-4fa1-b8e6-f1d2d10271f7 for instance 94a2b8c9-388d-454c-88a1-54d7a8506511 on user Apr 13 16:25:32 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [req-a838f36a-27f3-427a-80c1-aaa56f7ca5c8 req-a958c7f2-875f-46c3-a988-c9e4822c7d4f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.397787 Apr 13 16:25:32 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 123/369] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:25:31 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 16:25:33 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-19226414-a360-45e3-a572-d2ac7f700bd5 req-2f1d6db0-ebfc-40c9-94ad-22acb327cf77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94a2b8c9-388d-454c-88a1-54d7a8506511", "name": "network-vif-deleted", "tag": "8731e8dd-3e93-4fa1-b8e6-f1d2d10271f7"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:25:33 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-19226414-a360-45e3-a572-d2ac7f700bd5 req-2f1d6db0-ebfc-40c9-94ad-22acb327cf77 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:25:33 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-19226414-a360-45e3-a572-d2ac7f700bd5 req-2f1d6db0-ebfc-40c9-94ad-22acb327cf77 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:25:33 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-19226414-a360-45e3-a572-d2ac7f700bd5 req-2f1d6db0-ebfc-40c9-94ad-22acb327cf77 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:25:33 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-19226414-a360-45e3-a572-d2ac7f700bd5 req-2f1d6db0-ebfc-40c9-94ad-22acb327cf77 service nova] Creating event network-vif-deleted:8731e8dd-3e93-4fa1-b8e6-f1d2d10271f7 for instance 94a2b8c9-388d-454c-88a1-54d7a8506511 on user Apr 13 16:25:33 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [req-19226414-a360-45e3-a572-d2ac7f700bd5 req-2f1d6db0-ebfc-40c9-94ad-22acb327cf77 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050882 Apr 13 16:25:33 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 123/370] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:25:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:25:33 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-93becf93-3374-4a51-8052-637ebdc2f5e1 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:25:33 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-93becf93-3374-4a51-8052-637ebdc2f5e1 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:25:33 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-93becf93-3374-4a51-8052-637ebdc2f5e1 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:25:33 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-93becf93-3374-4a51-8052-637ebdc2f5e1 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:25:33 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-93becf93-3374-4a51-8052-637ebdc2f5e1 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:25:33 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-93becf93-3374-4a51-8052-637ebdc2f5e1 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:25:33 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-93becf93-3374-4a51-8052-637ebdc2f5e1 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:25:33 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-93becf93-3374-4a51-8052-637ebdc2f5e1 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:25:33 user devstack@n-api.service[62054]: DEBUG nova.policy [None req-93becf93-3374-4a51-8052-637ebdc2f5e1 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b3df1c5c5d441819bcef89ed6966815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980559734a504574a83224deb7423c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62054) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:25:33 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-93becf93-3374-4a51-8052-637ebdc2f5e1 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] 10.0.0.210 "GET /compute/v2.1/servers/acbcaee0-a47b-4fee-8765-9b1c9597d515" status: 200 len: 1540 microversion: 2.1 time: 0.291255 Apr 13 16:25:33 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 125/371] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:25:33 2023] GET /compute/v2.1/servers/acbcaee0-a47b-4fee-8765-9b1c9597d515 => generated 1540 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:25:33 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-78c3f7e1-02b3-412e-b31a-4ede5876fe99 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:25:33 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-78c3f7e1-02b3-412e-b31a-4ede5876fe99 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:25:33 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-78c3f7e1-02b3-412e-b31a-4ede5876fe99 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:25:33 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-78c3f7e1-02b3-412e-b31a-4ede5876fe99 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:25:33 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-78c3f7e1-02b3-412e-b31a-4ede5876fe99 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:25:33 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-78c3f7e1-02b3-412e-b31a-4ede5876fe99 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:25:33 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-78c3f7e1-02b3-412e-b31a-4ede5876fe99 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:25:33 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-78c3f7e1-02b3-412e-b31a-4ede5876fe99 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:25:34 user devstack@n-api.service[62055]: DEBUG nova.policy [None req-78c3f7e1-02b3-412e-b31a-4ede5876fe99 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b3df1c5c5d441819bcef89ed6966815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980559734a504574a83224deb7423c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62055) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:25:34 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-78c3f7e1-02b3-412e-b31a-4ede5876fe99 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] 10.0.0.210 "GET /compute/v2.1/servers/acbcaee0-a47b-4fee-8765-9b1c9597d515" status: 200 len: 1540 microversion: 2.1 time: 0.354054 Apr 13 16:25:34 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 124/372] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:25:33 2023] GET /compute/v2.1/servers/acbcaee0-a47b-4fee-8765-9b1c9597d515 => generated 1540 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:25:34 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-07003adf-15a6-4473-a526-629b1f221613 req-59cd048b-06ba-459d-9425-0e1d161e8e60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94a2b8c9-388d-454c-88a1-54d7a8506511", "name": "network-vif-plugged", "status": "completed", "tag": "8731e8dd-3e93-4fa1-b8e6-f1d2d10271f7"}, {"server_uuid": "bf350da4-9cc2-4900-adf0-506e44984b42", "name": "network-vif-plugged", "status": "completed", "tag": "1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:25:34 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-07003adf-15a6-4473-a526-629b1f221613 req-59cd048b-06ba-459d-9425-0e1d161e8e60 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:25:34 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-07003adf-15a6-4473-a526-629b1f221613 req-59cd048b-06ba-459d-9425-0e1d161e8e60 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:25:34 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-07003adf-15a6-4473-a526-629b1f221613 req-59cd048b-06ba-459d-9425-0e1d161e8e60 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:25:34 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-07003adf-15a6-4473-a526-629b1f221613 req-59cd048b-06ba-459d-9425-0e1d161e8e60 service nova] Creating event network-vif-plugged:8731e8dd-3e93-4fa1-b8e6-f1d2d10271f7 for instance 94a2b8c9-388d-454c-88a1-54d7a8506511 on user Apr 13 16:25:34 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-07003adf-15a6-4473-a526-629b1f221613 req-59cd048b-06ba-459d-9425-0e1d161e8e60 service nova] Creating event network-vif-plugged:1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8 for instance bf350da4-9cc2-4900-adf0-506e44984b42 on user Apr 13 16:25:34 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [req-07003adf-15a6-4473-a526-629b1f221613 req-59cd048b-06ba-459d-9425-0e1d161e8e60 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.047843 Apr 13 16:25:34 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 124/373] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:25:34 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:25:35 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-785df8d1-5c03-46c5-8268-6d4667025ba5 req-8613a40d-165c-4c93-a734-a9fb2bf0561b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "acbcaee0-a47b-4fee-8765-9b1c9597d515", "tag": "13471516-9514-4b85-938f-69657c2990e5"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:25:35 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-785df8d1-5c03-46c5-8268-6d4667025ba5 req-8613a40d-165c-4c93-a734-a9fb2bf0561b service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:25:35 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-785df8d1-5c03-46c5-8268-6d4667025ba5 req-8613a40d-165c-4c93-a734-a9fb2bf0561b service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:25:35 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-785df8d1-5c03-46c5-8268-6d4667025ba5 req-8613a40d-165c-4c93-a734-a9fb2bf0561b service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:25:35 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-785df8d1-5c03-46c5-8268-6d4667025ba5 req-8613a40d-165c-4c93-a734-a9fb2bf0561b service nova] Creating event network-changed:13471516-9514-4b85-938f-69657c2990e5 for instance acbcaee0-a47b-4fee-8765-9b1c9597d515 on user Apr 13 16:25:35 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [req-785df8d1-5c03-46c5-8268-6d4667025ba5 req-8613a40d-165c-4c93-a734-a9fb2bf0561b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035898 Apr 13 16:25:35 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 126/374] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:25:35 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:25:36 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [req-d931615d-3eb0-4475-aa5b-870137410cdb req-1674aca4-09b6-415f-8022-92d830bfefca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf350da4-9cc2-4900-adf0-506e44984b42", "name": "network-vif-plugged", "status": "completed", "tag": "1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8"}]} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:25:36 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-d931615d-3eb0-4475-aa5b-870137410cdb req-1674aca4-09b6-415f-8022-92d830bfefca service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:25:36 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-d931615d-3eb0-4475-aa5b-870137410cdb req-1674aca4-09b6-415f-8022-92d830bfefca service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:25:36 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-d931615d-3eb0-4475-aa5b-870137410cdb req-1674aca4-09b6-415f-8022-92d830bfefca service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:25:36 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-d931615d-3eb0-4475-aa5b-870137410cdb req-1674aca4-09b6-415f-8022-92d830bfefca service nova] Creating event network-vif-plugged:1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8 for instance bf350da4-9cc2-4900-adf0-506e44984b42 on user Apr 13 16:25:36 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [req-d931615d-3eb0-4475-aa5b-870137410cdb req-1674aca4-09b6-415f-8022-92d830bfefca service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076014 Apr 13 16:25:36 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 125/375] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:25:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:25:38 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-d9711312-1f7b-4594-a431-b047f979fa5c tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:25:38 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-d9711312-1f7b-4594-a431-b047f979fa5c tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] [instance: 902e4077-e0d6-4b61-a861-883be253f1e0] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:25:38 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-d9711312-1f7b-4594-a431-b047f979fa5c tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:25:38 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-d9711312-1f7b-4594-a431-b047f979fa5c tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:25:38 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-d9711312-1f7b-4594-a431-b047f979fa5c tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:25:38 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-d9711312-1f7b-4594-a431-b047f979fa5c tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:25:38 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-d9711312-1f7b-4594-a431-b047f979fa5c tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:25:38 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-d9711312-1f7b-4594-a431-b047f979fa5c tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:25:38 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:25:38 user devstack@n-api.service[62053]: DEBUG nova.policy [None req-d9711312-1f7b-4594-a431-b047f979fa5c tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9223a3efe4bc4e37946c8ed718100de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7395d2408a44cc88cf88eb49d5f8503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62053) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:25:38 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-d9711312-1f7b-4594-a431-b047f979fa5c tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] 10.0.0.210 "GET /compute/v2.1/servers/902e4077-e0d6-4b61-a861-883be253f1e0" status: 200 len: 1496 microversion: 2.1 time: 0.219911 Apr 13 16:25:38 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 125/376] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:25:38 2023] GET /compute/v2.1/servers/902e4077-e0d6-4b61-a861-883be253f1e0 => generated 1496 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:25:49 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_api:SELECT=12,nova_api:UPDATE=1 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:25:49 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:25:49 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-ba449d3e-e84e-415a-bfe4-56648086b568 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1364271295", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "747cc697-b49e-4de8-bce5-4419496f0e5e", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "ae7f770e-a460-4297-91b5-ed0b908a895a"}]}} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:25:49 user devstack@n-api.service[62054]: INFO nova.api.openstack.wsgi [None req-ba449d3e-e84e-415a-bfe4-56648086b568 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] HTTP exception thrown: Block Device 747cc697-b49e-4de8-bce5-4419496f0e5e is not bootable. Apr 13 16:25:49 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-ba449d3e-e84e-415a-bfe4-56648086b568 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Request method failure captured: Apr 13 16:25:49 user devstack@n-api.service[62054]: request: POST /compute/v2.1/servers HTTP/1.1 Apr 13 16:25:49 user devstack@n-api.service[62054]: Accept: application/json Apr 13 16:25:49 user devstack@n-api.service[62054]: Accept-Encoding: identity Apr 13 16:25:49 user devstack@n-api.service[62054]: Connection: close Apr 13 16:25:49 user devstack@n-api.service[62054]: Content-Length: 357 Apr 13 16:25:49 user devstack@n-api.service[62054]: Content-Type: application/json Apr 13 16:25:49 user devstack@n-api.service[62054]: Host: 10.0.0.210 Apr 13 16:25:49 user devstack@n-api.service[62054]: Openstack-System-Scope: None Apr 13 16:25:49 user devstack@n-api.service[62054]: User-Agent: python-urllib3/1.26.15 Apr 13 16:25:49 user devstack@n-api.service[62054]: X-Auth-Token: gAAAAABkOCu7xvmudBrBXBLs2SCBDcK71oPknaVoa5c212HJ1YH5D1qqQ770FnyyQ769HR4gN3MWc8D4DgjQEtN69nkpO07yNpJgb9N95gGXJDJugJy1OfGoQrI6zjE_4e0z9MJFRRuCNbIXu0Si5G6jJIciNJHiNV9wx9koSjgJs77kT-szNSc Apr 13 16:25:49 user devstack@n-api.service[62054]: X-Domain-Id: None Apr 13 16:25:49 user devstack@n-api.service[62054]: X-Domain-Name: None Apr 13 16:25:49 user devstack@n-api.service[62054]: X-Identity-Status: Confirmed Apr 13 16:25:49 user devstack@n-api.service[62054]: X-Is-Admin-Project: True Apr 13 16:25:49 user devstack@n-api.service[62054]: X-Project-Domain-Id: default Apr 13 16:25:49 user devstack@n-api.service[62054]: X-Project-Domain-Name: Default Apr 13 16:25:49 user devstack@n-api.service[62054]: X-Project-Id: 5554aa7f1b4d471b8807a845ab1ea33f Apr 13 16:25:49 user devstack@n-api.service[62054]: X-Project-Name: tempest-ServersNegativeTestJSON-1820659348 Apr 13 16:25:49 user devstack@n-api.service[62054]: X-Role: reader,member Apr 13 16:25:49 user devstack@n-api.service[62054]: X-Roles: reader,member Apr 13 16:25:49 user devstack@n-api.service[62054]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5554aa7f1b4d471b8807a845ab1ea33f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5554aa7f1b4d471b8807a845ab1ea33f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5554aa7f1b4d471b8807a845ab1ea33f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 13 16:25:49 user devstack@n-api.service[62054]: X-Tenant: tempest-ServersNegativeTestJSON-1820659348 Apr 13 16:25:49 user devstack@n-api.service[62054]: X-Tenant-Id: 5554aa7f1b4d471b8807a845ab1ea33f Apr 13 16:25:49 user devstack@n-api.service[62054]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1820659348 Apr 13 16:25:49 user devstack@n-api.service[62054]: X-User: tempest-ServersNegativeTestJSON-1820659348-project-member Apr 13 16:25:49 user devstack@n-api.service[62054]: X-User-Domain-Id: default Apr 13 16:25:49 user devstack@n-api.service[62054]: X-User-Domain-Name: Default Apr 13 16:25:49 user devstack@n-api.service[62054]: X-User-Id: 4ddd547d240b43ccb213e9d459082309 Apr 13 16:25:49 user devstack@n-api.service[62054]: X-User-Name: tempest-ServersNegativeTestJSON-1820659348-project-member Apr 13 16:25:49 user devstack@n-api.service[62054]: Apr 13 16:25:49 user devstack@n-api.service[62054]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1364271295", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "747cc697-b49e-4de8-bce5-4419496f0e5e", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "ae7f770e-a460-4297-91b5-ed0b908a895a"}]}} Apr 13 16:25:49 user devstack@n-api.service[62054]: method: > Apr 13 16:25:49 user devstack@n-api.service[62054]: exception: Block Device 747cc697-b49e-4de8-bce5-4419496f0e5e is not bootable. Apr 13 16:25:49 user devstack@n-api.service[62054]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1364271295', 'imageRef': '', 'flavorRef': '42', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': '747cc697-b49e-4de8-bce5-4419496f0e5e'}], 'networks': [{'uuid': 'ae7f770e-a460-4297-91b5-ed0b908a895a'}]}}} Apr 13 16:25:49 user devstack@n-api.service[62054]: {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 16:25:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:25:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 785, in create Apr 13 16:25:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Apr 13 16:25:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Apr 13 16:25:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi return self._create_instance( Apr 13 16:25:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Apr 13 16:25:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Apr 13 16:25:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Apr 13 16:25:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Apr 13 16:25:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device 747cc697-b49e-4de8-bce5-4419496f0e5e is not bootable. Apr 13 16:25:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:25:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:25:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:25:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:25:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 16:25:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 16:25:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 16:25:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 16:25:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 16:25:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 16:25:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 13 16:25:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 16:25:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 13 16:25:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 16:25:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 13 16:25:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 16:25:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi [Previous line repeated 11 more times] Apr 13 16:25:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 867, in create Apr 13 16:25:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Apr 13 16:25:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device 747cc697-b49e-4de8-bce5-4419496f0e5e is not bootable. Apr 13 16:25:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:25:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:25:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:25:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:25:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 16:25:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 16:25:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 16:25:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 16:25:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device 747cc697-b49e-4de8-bce5-4419496f0e5e is not bootable. Apr 13 16:25:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:25:49 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-ba449d3e-e84e-415a-bfe4-56648086b568 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Returning 400 to user: Block Device 747cc697-b49e-4de8-bce5-4419496f0e5e is not bootable. {{(pid=62054) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 16:25:49 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-ba449d3e-e84e-415a-bfe4-56648086b568 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.083488 Apr 13 16:25:49 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 127/377] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 16:25:49 2023] POST /compute/v2.1/servers => generated 110 bytes in 85 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Apr 13 16:25:49 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:25:49 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:25:49 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-b6aa1270-a0fa-4cfe-ab59-d4c227a93692 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:25:49 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-b6aa1270-a0fa-4cfe-ab59-d4c227a93692 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] [instance: 7973e93b-6311-44ed-91ff-e861c32d0277] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:25:49 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-b6aa1270-a0fa-4cfe-ab59-d4c227a93692 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:25:49 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-b6aa1270-a0fa-4cfe-ab59-d4c227a93692 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:25:49 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-b6aa1270-a0fa-4cfe-ab59-d4c227a93692 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:25:49 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-b6aa1270-a0fa-4cfe-ab59-d4c227a93692 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:25:49 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-b6aa1270-a0fa-4cfe-ab59-d4c227a93692 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:25:49 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-b6aa1270-a0fa-4cfe-ab59-d4c227a93692 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:25:49 user devstack@n-api.service[62055]: DEBUG nova.policy [None req-b6aa1270-a0fa-4cfe-ab59-d4c227a93692 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ddd547d240b43ccb213e9d459082309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5554aa7f1b4d471b8807a845ab1ea33f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62055) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:25:49 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-b6aa1270-a0fa-4cfe-ab59-d4c227a93692 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7973e93b-6311-44ed-91ff-e861c32d0277" status: 200 len: 1493 microversion: 2.1 time: 0.167021 Apr 13 16:25:49 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 126/378] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:25:49 2023] GET /compute/v2.1/servers/7973e93b-6311-44ed-91ff-e861c32d0277 => generated 1493 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:25:53 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-35d28bc4-0ebb-4062-99b3-197153dc9ddd tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:25:53 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-35d28bc4-0ebb-4062-99b3-197153dc9ddd tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 5ea4ab6a-6501-4a2f-a8f7-04090024747d] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:25:53 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_api:SELECT=11 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:25:53 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_cell1:SELECT=5 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:25:53 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-35d28bc4-0ebb-4062-99b3-197153dc9ddd tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:25:53 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-35d28bc4-0ebb-4062-99b3-197153dc9ddd tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:25:53 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-35d28bc4-0ebb-4062-99b3-197153dc9ddd tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:25:53 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-35d28bc4-0ebb-4062-99b3-197153dc9ddd tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:25:53 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-35d28bc4-0ebb-4062-99b3-197153dc9ddd tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:25:53 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-35d28bc4-0ebb-4062-99b3-197153dc9ddd tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:25:54 user devstack@n-api.service[62053]: DEBUG nova.policy [None req-35d28bc4-0ebb-4062-99b3-197153dc9ddd tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e10f63cdd49a9a1ebe1fe4c9de0a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d451e0e239f486aa2b3abe9e273eab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62053) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:25:54 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-35d28bc4-0ebb-4062-99b3-197153dc9ddd tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5ea4ab6a-6501-4a2f-a8f7-04090024747d" status: 200 len: 1393 microversion: 2.1 time: 0.172058 Apr 13 16:25:54 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 126/379] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:25:53 2023] GET /compute/v2.1/servers/5ea4ab6a-6501-4a2f-a8f7-04090024747d => generated 1393 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:25:56 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-0228ec0a-42b8-4565-a611-0e8dc35eee66 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:25:56 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-0228ec0a-42b8-4565-a611-0e8dc35eee66 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:25:56 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-0228ec0a-42b8-4565-a611-0e8dc35eee66 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:25:56 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-0228ec0a-42b8-4565-a611-0e8dc35eee66 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:25:56 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-0228ec0a-42b8-4565-a611-0e8dc35eee66 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:25:56 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-0228ec0a-42b8-4565-a611-0e8dc35eee66 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:25:56 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-0228ec0a-42b8-4565-a611-0e8dc35eee66 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:25:56 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-0228ec0a-42b8-4565-a611-0e8dc35eee66 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:25:57 user devstack@n-api.service[62054]: DEBUG nova.policy [None req-0228ec0a-42b8-4565-a611-0e8dc35eee66 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45a882dbafb4ea4976e4f45289eb2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d09a74bf684a9fb1dd1e95d6c23f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62054) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:25:57 user devstack@n-api.service[62054]: DEBUG nova.policy [None req-0228ec0a-42b8-4565-a611-0e8dc35eee66 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e45a882dbafb4ea4976e4f45289eb2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d09a74bf684a9fb1dd1e95d6c23f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62054) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:25:57 user devstack@n-api.service[62054]: DEBUG nova.policy [None req-0228ec0a-42b8-4565-a611-0e8dc35eee66 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e45a882dbafb4ea4976e4f45289eb2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d09a74bf684a9fb1dd1e95d6c23f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62054) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:25:57 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-0228ec0a-42b8-4565-a611-0e8dc35eee66 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] 10.0.0.210 "GET /compute/v2.1/servers/235f827c-7116-48e9-84c5-0c9761c18e1e" status: 200 len: 1755 microversion: 2.87 time: 0.480417 Apr 13 16:25:57 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 128/380] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 16:25:56 2023] GET /compute/v2.1/servers/235f827c-7116-48e9-84c5-0c9761c18e1e => generated 1755 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 16:26:00 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-ad9a958f-b5c2-409f-bce7-e1f9e3cf3c20 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:26:00 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-ad9a958f-b5c2-409f-bce7-e1f9e3cf3c20 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:26:00 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_api:SELECT=2 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:26:00 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_cell1:SELECT=6 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:26:00 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-ad9a958f-b5c2-409f-bce7-e1f9e3cf3c20 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:26:00 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-ad9a958f-b5c2-409f-bce7-e1f9e3cf3c20 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:26:00 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-ad9a958f-b5c2-409f-bce7-e1f9e3cf3c20 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:26:00 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-ad9a958f-b5c2-409f-bce7-e1f9e3cf3c20 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:26:00 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-ad9a958f-b5c2-409f-bce7-e1f9e3cf3c20 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:26:00 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-ad9a958f-b5c2-409f-bce7-e1f9e3cf3c20 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:26:00 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-ad9a958f-b5c2-409f-bce7-e1f9e3cf3c20 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eaae47b9-a059-49f6-9ae6-d7147003e2f2/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.098556 Apr 13 16:26:00 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 127/381] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 13 16:26:00 2023] GET /compute/v2.1/servers/eaae47b9-a059-49f6-9ae6-d7147003e2f2/os-interface => generated 282 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:26:01 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-4a8ce099-874e-4f1d-94a8-8609f30a720c req-9284b0c0-d67b-4c8d-9ecc-e5d620e8a387 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eaae47b9-a059-49f6-9ae6-d7147003e2f2", "tag": "e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:26:01 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-4a8ce099-874e-4f1d-94a8-8609f30a720c req-9284b0c0-d67b-4c8d-9ecc-e5d620e8a387 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:26:01 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-4a8ce099-874e-4f1d-94a8-8609f30a720c req-9284b0c0-d67b-4c8d-9ecc-e5d620e8a387 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:26:01 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-4a8ce099-874e-4f1d-94a8-8609f30a720c req-9284b0c0-d67b-4c8d-9ecc-e5d620e8a387 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:26:01 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-4a8ce099-874e-4f1d-94a8-8609f30a720c req-9284b0c0-d67b-4c8d-9ecc-e5d620e8a387 service nova] Creating event network-changed:e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae for instance eaae47b9-a059-49f6-9ae6-d7147003e2f2 on user Apr 13 16:26:01 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [req-4a8ce099-874e-4f1d-94a8-8609f30a720c req-9284b0c0-d67b-4c8d-9ecc-e5d620e8a387 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030307 Apr 13 16:26:01 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 127/382] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:26:01 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:26:01 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-2cea2fa4-b357-41bc-82f5-10093f9f8e9f tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:26:01 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-2cea2fa4-b357-41bc-82f5-10093f9f8e9f tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:26:01 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-2cea2fa4-b357-41bc-82f5-10093f9f8e9f tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:26:01 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-2cea2fa4-b357-41bc-82f5-10093f9f8e9f tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:26:01 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-2cea2fa4-b357-41bc-82f5-10093f9f8e9f tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:26:01 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-2cea2fa4-b357-41bc-82f5-10093f9f8e9f tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:26:01 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-2cea2fa4-b357-41bc-82f5-10093f9f8e9f tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:26:01 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-2cea2fa4-b357-41bc-82f5-10093f9f8e9f tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:26:01 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-2cea2fa4-b357-41bc-82f5-10093f9f8e9f tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eaae47b9-a059-49f6-9ae6-d7147003e2f2/ips" status: 200 len: 104 microversion: 2.1 time: 0.036483 Apr 13 16:26:01 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 129/383] 10.0.0.210 () {62 vars in 1325 bytes} [Thu Apr 13 16:26:01 2023] GET /compute/v2.1/servers/eaae47b9-a059-49f6-9ae6-d7147003e2f2/ips => generated 104 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:26:04 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-97043357-b1f7-43b4-9364-c4cc8a068800 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6"}} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:26:04 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-97043357-b1f7-43b4-9364-c4cc8a068800 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:26:04 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-97043357-b1f7-43b4-9364-c4cc8a068800 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:26:04 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-97043357-b1f7-43b4-9364-c4cc8a068800 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:26:04 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-97043357-b1f7-43b4-9364-c4cc8a068800 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:26:04 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-97043357-b1f7-43b4-9364-c4cc8a068800 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:26:04 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-97043357-b1f7-43b4-9364-c4cc8a068800 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:26:04 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-97043357-b1f7-43b4-9364-c4cc8a068800 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:26:04 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-97043357-b1f7-43b4-9364-c4cc8a068800 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] 10.0.0.210 "POST /compute/v2.1/servers/eaae47b9-a059-49f6-9ae6-d7147003e2f2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.286008 Apr 13 16:26:04 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 128/384] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 16:26:04 2023] POST /compute/v2.1/servers/eaae47b9-a059-49f6-9ae6-d7147003e2f2/os-volume_attachments => generated 194 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:26:11 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-3185cd49-b98f-431e-9bb1-e7b7575cd616 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:26:11 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-3185cd49-b98f-431e-9bb1-e7b7575cd616 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:26:11 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-3185cd49-b98f-431e-9bb1-e7b7575cd616 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:26:11 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-3185cd49-b98f-431e-9bb1-e7b7575cd616 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:26:11 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-3185cd49-b98f-431e-9bb1-e7b7575cd616 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:26:11 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-3185cd49-b98f-431e-9bb1-e7b7575cd616 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:26:11 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-3185cd49-b98f-431e-9bb1-e7b7575cd616 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:26:11 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-3185cd49-b98f-431e-9bb1-e7b7575cd616 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:26:11 user devstack@n-api.service[62053]: DEBUG nova.policy [None req-3185cd49-b98f-431e-9bb1-e7b7575cd616 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6a4bf1a7794af2958c3d53ea1e19c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed94fa5d89c2486b8e2951e608e6630f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62053) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:26:11 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-3185cd49-b98f-431e-9bb1-e7b7575cd616 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bf350da4-9cc2-4900-adf0-506e44984b42" status: 200 len: 1550 microversion: 2.1 time: 0.163156 Apr 13 16:26:11 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 128/385] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:26:11 2023] GET /compute/v2.1/servers/bf350da4-9cc2-4900-adf0-506e44984b42 => generated 1550 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:26:12 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_api:SELECT=8 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:26:12 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_cell1:SELECT=10 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:26:12 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-e83afce1-3de8-4fe3-8a8f-7caf8fcca63a tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:26:12 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-e83afce1-3de8-4fe3-8a8f-7caf8fcca63a tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:26:12 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-e83afce1-3de8-4fe3-8a8f-7caf8fcca63a tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:26:12 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-e83afce1-3de8-4fe3-8a8f-7caf8fcca63a tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:26:12 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-e83afce1-3de8-4fe3-8a8f-7caf8fcca63a tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:26:12 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-e83afce1-3de8-4fe3-8a8f-7caf8fcca63a tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:26:12 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-e83afce1-3de8-4fe3-8a8f-7caf8fcca63a tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:26:12 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-e83afce1-3de8-4fe3-8a8f-7caf8fcca63a tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:26:12 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-e83afce1-3de8-4fe3-8a8f-7caf8fcca63a tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] 10.0.0.210 "POST /compute/v2.1/servers/bbcccf4b-e861-4254-9be3-a491776214e9/action" status: 202 len: 0 microversion: 2.1 time: 0.327842 Apr 13 16:26:12 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 130/386] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 16:26:12 2023] POST /compute/v2.1/servers/bbcccf4b-e861-4254-9be3-a491776214e9/action => generated 0 bytes in 329 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 16:26:12 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-79656025-0084-4f3b-9322-f027a211ca43 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:26:12 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-79656025-0084-4f3b-9322-f027a211ca43 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:26:12 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-79656025-0084-4f3b-9322-f027a211ca43 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:26:12 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-79656025-0084-4f3b-9322-f027a211ca43 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:26:12 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-79656025-0084-4f3b-9322-f027a211ca43 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:26:12 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-79656025-0084-4f3b-9322-f027a211ca43 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:26:12 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-79656025-0084-4f3b-9322-f027a211ca43 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:26:12 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-79656025-0084-4f3b-9322-f027a211ca43 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:26:12 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-79656025-0084-4f3b-9322-f027a211ca43 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bbcccf4b-e861-4254-9be3-a491776214e9/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.105881 Apr 13 16:26:12 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 129/387] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 13 16:26:12 2023] GET /compute/v2.1/servers/bbcccf4b-e861-4254-9be3-a491776214e9/os-interface => generated 282 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:26:13 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-0b82c558-eb2f-48eb-a53e-8c3dc2924275 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:26:13 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-0b82c558-eb2f-48eb-a53e-8c3dc2924275 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:26:13 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-0b82c558-eb2f-48eb-a53e-8c3dc2924275 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:26:13 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-0b82c558-eb2f-48eb-a53e-8c3dc2924275 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:26:13 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-0b82c558-eb2f-48eb-a53e-8c3dc2924275 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Going to try to stop instance {{(pid=62053) force_stop /opt/stack/nova/nova/compute/api.py:2764}} Apr 13 16:26:13 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-0b82c558-eb2f-48eb-a53e-8c3dc2924275 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] 10.0.0.210 "POST /compute/v2.1/servers/eaae47b9-a059-49f6-9ae6-d7147003e2f2/action" status: 202 len: 0 microversion: 2.1 time: 0.149309 Apr 13 16:26:13 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 129/388] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 16:26:13 2023] POST /compute/v2.1/servers/eaae47b9-a059-49f6-9ae6-d7147003e2f2/action => generated 0 bytes in 151 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 16:26:13 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-c7bd551b-78d6-4411-8fa1-b1ec64663325 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:26:13 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-c7bd551b-78d6-4411-8fa1-b1ec64663325 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:26:13 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-c7bd551b-78d6-4411-8fa1-b1ec64663325 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:26:13 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-c7bd551b-78d6-4411-8fa1-b1ec64663325 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:26:13 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-c7bd551b-78d6-4411-8fa1-b1ec64663325 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:26:13 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-c7bd551b-78d6-4411-8fa1-b1ec64663325 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:26:13 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-c7bd551b-78d6-4411-8fa1-b1ec64663325 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:26:13 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-c7bd551b-78d6-4411-8fa1-b1ec64663325 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:26:13 user devstack@n-api.service[62054]: DEBUG nova.policy [None req-c7bd551b-78d6-4411-8fa1-b1ec64663325 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fab402fb794a5a9281cfb7fe188813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24904988cf334657b084fd726c7ecf8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62054) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:26:13 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-c7bd551b-78d6-4411-8fa1-b1ec64663325 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eaae47b9-a059-49f6-9ae6-d7147003e2f2" status: 200 len: 1712 microversion: 2.1 time: 0.222579 Apr 13 16:26:13 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 131/389] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:26:13 2023] GET /compute/v2.1/servers/eaae47b9-a059-49f6-9ae6-d7147003e2f2 => generated 1712 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:26:14 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [req-278d08ad-8196-4cc1-a061-af62e30485e7 req-7a37c9b5-77ff-4d8e-8f4d-9a2d654e5dbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbcccf4b-e861-4254-9be3-a491776214e9", "name": "network-vif-unplugged", "status": "completed", "tag": "dbb2bf27-5de3-499c-ba4d-87867912a143"}]} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:26:14 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-278d08ad-8196-4cc1-a061-af62e30485e7 req-7a37c9b5-77ff-4d8e-8f4d-9a2d654e5dbd service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:26:14 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-278d08ad-8196-4cc1-a061-af62e30485e7 req-7a37c9b5-77ff-4d8e-8f4d-9a2d654e5dbd service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:26:14 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-278d08ad-8196-4cc1-a061-af62e30485e7 req-7a37c9b5-77ff-4d8e-8f4d-9a2d654e5dbd service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:26:14 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-278d08ad-8196-4cc1-a061-af62e30485e7 req-7a37c9b5-77ff-4d8e-8f4d-9a2d654e5dbd service nova] Creating event network-vif-unplugged:dbb2bf27-5de3-499c-ba4d-87867912a143 for instance bbcccf4b-e861-4254-9be3-a491776214e9 on user Apr 13 16:26:14 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [req-278d08ad-8196-4cc1-a061-af62e30485e7 req-7a37c9b5-77ff-4d8e-8f4d-9a2d654e5dbd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.200941 Apr 13 16:26:14 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 130/390] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:26:14 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:26:16 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-1c5a23d8-b721-46d6-9214-f0013c0ec9e2 req-251c27a3-11e4-4870-80fd-c0645c1238da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbcccf4b-e861-4254-9be3-a491776214e9", "tag": "dbb2bf27-5de3-499c-ba4d-87867912a143"}, {"server_uuid": "bbcccf4b-e861-4254-9be3-a491776214e9", "name": "network-vif-plugged", "status": "completed", "tag": "dbb2bf27-5de3-499c-ba4d-87867912a143"}, {"name": "network-changed", "server_uuid": "bbcccf4b-e861-4254-9be3-a491776214e9", "tag": "dbb2bf27-5de3-499c-ba4d-87867912a143"}, {"server_uuid": "eaae47b9-a059-49f6-9ae6-d7147003e2f2", "name": "network-vif-unplugged", "status": "completed", "tag": "e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae"}, {"server_uuid": "eaae47b9-a059-49f6-9ae6-d7147003e2f2", "name": "network-vif-plugged", "status": "completed", "tag": "e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae"}, {"server_uuid": "bbcccf4b-e861-4254-9be3-a491776214e9", "name": "network-vif-plugged", "status": "completed", "tag": "dbb2bf27-5de3-499c-ba4d-87867912a143"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:26:16 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-1c5a23d8-b721-46d6-9214-f0013c0ec9e2 req-251c27a3-11e4-4870-80fd-c0645c1238da service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:26:16 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-1c5a23d8-b721-46d6-9214-f0013c0ec9e2 req-251c27a3-11e4-4870-80fd-c0645c1238da service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:26:16 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-1c5a23d8-b721-46d6-9214-f0013c0ec9e2 req-251c27a3-11e4-4870-80fd-c0645c1238da service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:26:16 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-1c5a23d8-b721-46d6-9214-f0013c0ec9e2 req-251c27a3-11e4-4870-80fd-c0645c1238da service nova] Creating event network-changed:dbb2bf27-5de3-499c-ba4d-87867912a143 for instance bbcccf4b-e861-4254-9be3-a491776214e9 on user Apr 13 16:26:16 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-1c5a23d8-b721-46d6-9214-f0013c0ec9e2 req-251c27a3-11e4-4870-80fd-c0645c1238da service nova] Creating event network-vif-plugged:dbb2bf27-5de3-499c-ba4d-87867912a143 for instance bbcccf4b-e861-4254-9be3-a491776214e9 on user Apr 13 16:26:16 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-1c5a23d8-b721-46d6-9214-f0013c0ec9e2 req-251c27a3-11e4-4870-80fd-c0645c1238da service nova] Creating event network-changed:dbb2bf27-5de3-499c-ba4d-87867912a143 for instance bbcccf4b-e861-4254-9be3-a491776214e9 on user Apr 13 16:26:16 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-1c5a23d8-b721-46d6-9214-f0013c0ec9e2 req-251c27a3-11e4-4870-80fd-c0645c1238da service nova] Creating event network-vif-unplugged:e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae for instance eaae47b9-a059-49f6-9ae6-d7147003e2f2 on user Apr 13 16:26:16 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-1c5a23d8-b721-46d6-9214-f0013c0ec9e2 req-251c27a3-11e4-4870-80fd-c0645c1238da service nova] Creating event network-vif-plugged:e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae for instance eaae47b9-a059-49f6-9ae6-d7147003e2f2 on user Apr 13 16:26:16 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-1c5a23d8-b721-46d6-9214-f0013c0ec9e2 req-251c27a3-11e4-4870-80fd-c0645c1238da service nova] Creating event network-vif-plugged:dbb2bf27-5de3-499c-ba4d-87867912a143 for instance bbcccf4b-e861-4254-9be3-a491776214e9 on user Apr 13 16:26:16 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [req-1c5a23d8-b721-46d6-9214-f0013c0ec9e2 req-251c27a3-11e4-4870-80fd-c0645c1238da service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1032 microversion: 2.1 time: 0.044701 Apr 13 16:26:16 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 130/391] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:26:16 2023] POST /compute/v2.1/os-server-external-events => generated 1032 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:26:18 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-d9503520-f61f-4c78-8b44-752fac669b2d req-c62d80f2-3141-4bbd-8d12-8229f2e5263f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbcccf4b-e861-4254-9be3-a491776214e9", "name": "network-vif-plugged", "status": "completed", "tag": "dbb2bf27-5de3-499c-ba4d-87867912a143"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:26:18 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-d9503520-f61f-4c78-8b44-752fac669b2d req-c62d80f2-3141-4bbd-8d12-8229f2e5263f service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:26:18 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-d9503520-f61f-4c78-8b44-752fac669b2d req-c62d80f2-3141-4bbd-8d12-8229f2e5263f service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:26:18 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-d9503520-f61f-4c78-8b44-752fac669b2d req-c62d80f2-3141-4bbd-8d12-8229f2e5263f service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:26:18 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-d9503520-f61f-4c78-8b44-752fac669b2d req-c62d80f2-3141-4bbd-8d12-8229f2e5263f service nova] Creating event network-vif-plugged:dbb2bf27-5de3-499c-ba4d-87867912a143 for instance bbcccf4b-e861-4254-9be3-a491776214e9 on user Apr 13 16:26:18 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [req-d9503520-f61f-4c78-8b44-752fac669b2d req-c62d80f2-3141-4bbd-8d12-8229f2e5263f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046069 Apr 13 16:26:18 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 132/392] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:26:18 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:26:21 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-166938a0-6a29-444c-a8a6-0837ef45ab2d tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:26:21 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-166938a0-6a29-444c-a8a6-0837ef45ab2d tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] [instance: 94a2b8c9-388d-454c-88a1-54d7a8506511] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:26:21 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-166938a0-6a29-444c-a8a6-0837ef45ab2d tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:26:21 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-166938a0-6a29-444c-a8a6-0837ef45ab2d tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:26:21 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-166938a0-6a29-444c-a8a6-0837ef45ab2d tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:26:21 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-166938a0-6a29-444c-a8a6-0837ef45ab2d tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:26:21 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-166938a0-6a29-444c-a8a6-0837ef45ab2d tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:26:21 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-166938a0-6a29-444c-a8a6-0837ef45ab2d tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:26:21 user devstack@n-api.service[62055]: INFO nova.api.openstack.wsgi [None req-166938a0-6a29-444c-a8a6-0837ef45ab2d tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] HTTP exception thrown: Instance 94a2b8c9-388d-454c-88a1-54d7a8506511 could not be found. Apr 13 16:26:21 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-166938a0-6a29-444c-a8a6-0837ef45ab2d tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Request method failure captured: Apr 13 16:26:21 user devstack@n-api.service[62055]: request: GET /compute/v2.1/servers/94a2b8c9-388d-454c-88a1-54d7a8506511 HTTP/1.1 Apr 13 16:26:21 user devstack@n-api.service[62055]: Accept: application/json Apr 13 16:26:21 user devstack@n-api.service[62055]: Accept-Encoding: identity Apr 13 16:26:21 user devstack@n-api.service[62055]: Connection: close Apr 13 16:26:21 user devstack@n-api.service[62055]: Content-Length: 0 Apr 13 16:26:21 user devstack@n-api.service[62055]: Content-Type: application/json Apr 13 16:26:21 user devstack@n-api.service[62055]: Host: 10.0.0.210 Apr 13 16:26:21 user devstack@n-api.service[62055]: Openstack-System-Scope: None Apr 13 16:26:21 user devstack@n-api.service[62055]: User-Agent: python-urllib3/1.26.15 Apr 13 16:26:21 user devstack@n-api.service[62055]: X-Auth-Token: gAAAAABkOCu67MgYnaiCt_3pkwW01IxEApxUUSNfs-qZrcQGeNBxBdaovS3Zw2mZNOx19ZOfPVglweLJOFzB1waE8IwDdFGeXXxXgqyPninUYKcOsXCzYWWVxtIP08uDV0EIq5Sd3quQx_Sxity2lmsc5pGbkYsRg_3ZX3PkCDqqSquRdAlSZoE Apr 13 16:26:21 user devstack@n-api.service[62055]: X-Domain-Id: None Apr 13 16:26:21 user devstack@n-api.service[62055]: X-Domain-Name: None Apr 13 16:26:21 user devstack@n-api.service[62055]: X-Identity-Status: Confirmed Apr 13 16:26:21 user devstack@n-api.service[62055]: X-Is-Admin-Project: True Apr 13 16:26:21 user devstack@n-api.service[62055]: X-Project-Domain-Id: default Apr 13 16:26:21 user devstack@n-api.service[62055]: X-Project-Domain-Name: Default Apr 13 16:26:21 user devstack@n-api.service[62055]: X-Project-Id: 5ded8a69b7e941f9bcdc502cfeed79db Apr 13 16:26:21 user devstack@n-api.service[62055]: X-Project-Name: tempest-VolumesAdminNegativeTest-694044578 Apr 13 16:26:21 user devstack@n-api.service[62055]: X-Role: reader,member Apr 13 16:26:21 user devstack@n-api.service[62055]: X-Roles: reader,member Apr 13 16:26:21 user devstack@n-api.service[62055]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5ded8a69b7e941f9bcdc502cfeed79db"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5ded8a69b7e941f9bcdc502cfeed79db"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5ded8a69b7e941f9bcdc502cfeed79db"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 13 16:26:21 user devstack@n-api.service[62055]: X-Tenant: tempest-VolumesAdminNegativeTest-694044578 Apr 13 16:26:21 user devstack@n-api.service[62055]: X-Tenant-Id: 5ded8a69b7e941f9bcdc502cfeed79db Apr 13 16:26:21 user devstack@n-api.service[62055]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-694044578 Apr 13 16:26:21 user devstack@n-api.service[62055]: X-User: tempest-VolumesAdminNegativeTest-694044578-project-member Apr 13 16:26:21 user devstack@n-api.service[62055]: X-User-Domain-Id: default Apr 13 16:26:21 user devstack@n-api.service[62055]: X-User-Domain-Name: Default Apr 13 16:26:21 user devstack@n-api.service[62055]: X-User-Id: 62cf399757f544649fed18ee5a31d50c Apr 13 16:26:21 user devstack@n-api.service[62055]: X-User-Name: tempest-VolumesAdminNegativeTest-694044578-project-member Apr 13 16:26:21 user devstack@n-api.service[62055]: method: > Apr 13 16:26:21 user devstack@n-api.service[62055]: exception: Instance 94a2b8c9-388d-454c-88a1-54d7a8506511 could not be found. Apr 13 16:26:21 user devstack@n-api.service[62055]: action_args: {'id': '94a2b8c9-388d-454c-88a1-54d7a8506511'} Apr 13 16:26:21 user devstack@n-api.service[62055]: {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 16:26:21 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:26:21 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 16:26:21 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 16:26:21 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 16:26:21 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 16:26:21 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 16:26:21 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 16:26:21 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 16:26:21 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 16:26:21 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94a2b8c9-388d-454c-88a1-54d7a8506511 could not be found. Apr 13 16:26:21 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:26:21 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:26:21 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:26:21 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:26:21 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 16:26:21 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 16:26:21 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 16:26:21 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 16:26:21 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 16:26:21 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 16:26:21 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 16:26:21 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 16:26:21 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 16:26:21 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 16:26:21 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 16:26:21 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 16:26:21 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94a2b8c9-388d-454c-88a1-54d7a8506511 could not be found. Apr 13 16:26:21 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:26:21 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:26:21 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:26:21 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:26:21 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 16:26:21 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 16:26:21 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 16:26:21 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 16:26:21 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94a2b8c9-388d-454c-88a1-54d7a8506511 could not be found. Apr 13 16:26:21 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:26:21 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-166938a0-6a29-444c-a8a6-0837ef45ab2d tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Returning 404 to user: Instance 94a2b8c9-388d-454c-88a1-54d7a8506511 could not be found. {{(pid=62055) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 16:26:21 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-166938a0-6a29-444c-a8a6-0837ef45ab2d tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] 10.0.0.210 "GET /compute/v2.1/servers/94a2b8c9-388d-454c-88a1-54d7a8506511" status: 404 len: 111 microversion: 2.1 time: 0.042939 Apr 13 16:26:21 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 131/393] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:26:21 2023] GET /compute/v2.1/servers/94a2b8c9-388d-454c-88a1-54d7a8506511 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 16:26:23 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-f332ec71-46c6-43db-b9da-d15aeb8e5dd9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:26:23 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-f332ec71-46c6-43db-b9da-d15aeb8e5dd9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] [instance: 5db1cb51-2e5a-46c9-8914-cba759a96a65] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:26:23 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_api:SELECT=11 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:26:23 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-f332ec71-46c6-43db-b9da-d15aeb8e5dd9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:26:23 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-f332ec71-46c6-43db-b9da-d15aeb8e5dd9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:26:23 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-f332ec71-46c6-43db-b9da-d15aeb8e5dd9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:26:23 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-f332ec71-46c6-43db-b9da-d15aeb8e5dd9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:26:23 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-f332ec71-46c6-43db-b9da-d15aeb8e5dd9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:26:23 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-f332ec71-46c6-43db-b9da-d15aeb8e5dd9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:26:23 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:26:23 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-f332ec71-46c6-43db-b9da-d15aeb8e5dd9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] [instance: 5db1cb51-2e5a-46c9-8914-cba759a96a65] Going to try to terminate instance {{(pid=62053) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 16:26:24 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-f332ec71-46c6-43db-b9da-d15aeb8e5dd9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5db1cb51-2e5a-46c9-8914-cba759a96a65" status: 204 len: 0 microversion: 2.1 time: 0.140837 Apr 13 16:26:24 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 131/394] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 16:26:23 2023] DELETE /compute/v2.1/servers/5db1cb51-2e5a-46c9-8914-cba759a96a65 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 16:26:24 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-d71528f3-3ae4-4cd1-a9e2-887f305b591e tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:26:24 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-d71528f3-3ae4-4cd1-a9e2-887f305b591e tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] [instance: 5db1cb51-2e5a-46c9-8914-cba759a96a65] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:26:24 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-d71528f3-3ae4-4cd1-a9e2-887f305b591e tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:26:24 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-d71528f3-3ae4-4cd1-a9e2-887f305b591e tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:26:24 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-d71528f3-3ae4-4cd1-a9e2-887f305b591e tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:26:24 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-d71528f3-3ae4-4cd1-a9e2-887f305b591e tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:26:24 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-d71528f3-3ae4-4cd1-a9e2-887f305b591e tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:26:24 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-d71528f3-3ae4-4cd1-a9e2-887f305b591e tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:26:24 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-79f82ead-49f1-4868-a889-f09f6ff1d779 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:26:24 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-79f82ead-49f1-4868-a889-f09f6ff1d779 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:26:24 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-79f82ead-49f1-4868-a889-f09f6ff1d779 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:26:24 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-79f82ead-49f1-4868-a889-f09f6ff1d779 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:26:24 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-79f82ead-49f1-4868-a889-f09f6ff1d779 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:26:24 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-79f82ead-49f1-4868-a889-f09f6ff1d779 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:26:24 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-79f82ead-49f1-4868-a889-f09f6ff1d779 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:26:24 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-79f82ead-49f1-4868-a889-f09f6ff1d779 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:26:24 user devstack@n-api.service[62054]: DEBUG nova.policy [None req-d71528f3-3ae4-4cd1-a9e2-887f305b591e tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cf399757f544649fed18ee5a31d50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ded8a69b7e941f9bcdc502cfeed79db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62054) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:26:24 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-d71528f3-3ae4-4cd1-a9e2-887f305b591e tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5db1cb51-2e5a-46c9-8914-cba759a96a65" status: 200 len: 1669 microversion: 2.1 time: 0.347500 Apr 13 16:26:24 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 133/395] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:26:24 2023] GET /compute/v2.1/servers/5db1cb51-2e5a-46c9-8914-cba759a96a65 => generated 1669 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:26:24 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-f01ff4e2-daca-4ccf-9ef3-6fed951f0663 req-87111191-dfc9-4aad-815f-8db5b30a9394 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5db1cb51-2e5a-46c9-8914-cba759a96a65", "name": "network-vif-unplugged", "status": "completed", "tag": "628a1eb7-e3f1-4158-9f9e-1ae752c91c0b"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:26:24 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-f01ff4e2-daca-4ccf-9ef3-6fed951f0663 req-87111191-dfc9-4aad-815f-8db5b30a9394 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:26:24 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-f01ff4e2-daca-4ccf-9ef3-6fed951f0663 req-87111191-dfc9-4aad-815f-8db5b30a9394 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:26:24 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-f01ff4e2-daca-4ccf-9ef3-6fed951f0663 req-87111191-dfc9-4aad-815f-8db5b30a9394 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:26:24 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-f01ff4e2-daca-4ccf-9ef3-6fed951f0663 req-87111191-dfc9-4aad-815f-8db5b30a9394 service nova] Creating event network-vif-unplugged:628a1eb7-e3f1-4158-9f9e-1ae752c91c0b for instance 5db1cb51-2e5a-46c9-8914-cba759a96a65 on user Apr 13 16:26:24 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [req-f01ff4e2-daca-4ccf-9ef3-6fed951f0663 req-87111191-dfc9-4aad-815f-8db5b30a9394 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034914 Apr 13 16:26:24 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 132/396] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:26:24 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:26:24 user devstack@n-api.service[62055]: DEBUG nova.policy [None req-79f82ead-49f1-4868-a889-f09f6ff1d779 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b3df1c5c5d441819bcef89ed6966815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980559734a504574a83224deb7423c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62055) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:26:24 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-79f82ead-49f1-4868-a889-f09f6ff1d779 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] 10.0.0.210 "GET /compute/v2.1/servers/acbcaee0-a47b-4fee-8765-9b1c9597d515" status: 200 len: 1659 microversion: 2.1 time: 0.203447 Apr 13 16:26:24 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 132/397] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:26:24 2023] GET /compute/v2.1/servers/acbcaee0-a47b-4fee-8765-9b1c9597d515 => generated 1659 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:26:24 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-909044e6-eb16-4f9d-80b0-bf1daa49186f tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:26:24 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-909044e6-eb16-4f9d-80b0-bf1daa49186f tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:26:24 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-909044e6-eb16-4f9d-80b0-bf1daa49186f tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:26:24 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-909044e6-eb16-4f9d-80b0-bf1daa49186f tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:26:24 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-909044e6-eb16-4f9d-80b0-bf1daa49186f tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:26:24 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-909044e6-eb16-4f9d-80b0-bf1daa49186f tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:26:24 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-909044e6-eb16-4f9d-80b0-bf1daa49186f tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:26:24 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-909044e6-eb16-4f9d-80b0-bf1daa49186f tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:26:24 user devstack@n-api.service[62054]: DEBUG nova.policy [None req-909044e6-eb16-4f9d-80b0-bf1daa49186f tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b3df1c5c5d441819bcef89ed6966815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980559734a504574a83224deb7423c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62054) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:26:24 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-909044e6-eb16-4f9d-80b0-bf1daa49186f tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] 10.0.0.210 "GET /compute/v2.1/servers/acbcaee0-a47b-4fee-8765-9b1c9597d515" status: 200 len: 1659 microversion: 2.1 time: 0.216163 Apr 13 16:26:24 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 134/398] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:26:24 2023] GET /compute/v2.1/servers/acbcaee0-a47b-4fee-8765-9b1c9597d515 => generated 1659 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:26:25 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-1b692761-54ba-44e1-9e2c-18312dad749f req-1b1489ed-f110-4906-9ad6-752125cfe3ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5db1cb51-2e5a-46c9-8914-cba759a96a65", "name": "network-vif-deleted", "tag": "628a1eb7-e3f1-4158-9f9e-1ae752c91c0b"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:26:25 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-1b692761-54ba-44e1-9e2c-18312dad749f req-1b1489ed-f110-4906-9ad6-752125cfe3ea service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:26:25 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-1b692761-54ba-44e1-9e2c-18312dad749f req-1b1489ed-f110-4906-9ad6-752125cfe3ea service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:26:25 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-1b692761-54ba-44e1-9e2c-18312dad749f req-1b1489ed-f110-4906-9ad6-752125cfe3ea service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:26:25 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-1b692761-54ba-44e1-9e2c-18312dad749f req-1b1489ed-f110-4906-9ad6-752125cfe3ea service nova] Creating event network-vif-deleted:628a1eb7-e3f1-4158-9f9e-1ae752c91c0b for instance 5db1cb51-2e5a-46c9-8914-cba759a96a65 on user Apr 13 16:26:25 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [req-1b692761-54ba-44e1-9e2c-18312dad749f req-1b1489ed-f110-4906-9ad6-752125cfe3ea service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036159 Apr 13 16:26:25 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 133/399] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:26:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:26:26 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [req-c567d334-5254-4f72-86b6-cf7f5642a631 req-cf0349a5-82c3-4b0f-a309-111b94b65371 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5db1cb51-2e5a-46c9-8914-cba759a96a65", "name": "network-vif-plugged", "status": "completed", "tag": "628a1eb7-e3f1-4158-9f9e-1ae752c91c0b"}]} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:26:26 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-c567d334-5254-4f72-86b6-cf7f5642a631 req-cf0349a5-82c3-4b0f-a309-111b94b65371 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:26:26 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-c567d334-5254-4f72-86b6-cf7f5642a631 req-cf0349a5-82c3-4b0f-a309-111b94b65371 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:26:26 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-c567d334-5254-4f72-86b6-cf7f5642a631 req-cf0349a5-82c3-4b0f-a309-111b94b65371 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:26:26 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-c567d334-5254-4f72-86b6-cf7f5642a631 req-cf0349a5-82c3-4b0f-a309-111b94b65371 service nova] Creating event network-vif-plugged:628a1eb7-e3f1-4158-9f9e-1ae752c91c0b for instance 5db1cb51-2e5a-46c9-8914-cba759a96a65 on user Apr 13 16:26:26 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [req-c567d334-5254-4f72-86b6-cf7f5642a631 req-cf0349a5-82c3-4b0f-a309-111b94b65371 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048027 Apr 13 16:26:26 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 133/400] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:26:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:26:38 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_api:SELECT=10 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:26:38 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:26:38 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-057b9909-be17-4316-bb87-fe0f40a3042d tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6c64d091-303e-4a8b-bc23-ec85ca668f40", "device": "/dev/vdb"}} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:26:38 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-057b9909-be17-4316-bb87-fe0f40a3042d tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] [instance: 902e4077-e0d6-4b61-a861-883be253f1e0] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:26:38 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-057b9909-be17-4316-bb87-fe0f40a3042d tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:26:38 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-057b9909-be17-4316-bb87-fe0f40a3042d tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:26:38 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-057b9909-be17-4316-bb87-fe0f40a3042d tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:26:38 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-057b9909-be17-4316-bb87-fe0f40a3042d tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:26:38 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-057b9909-be17-4316-bb87-fe0f40a3042d tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:26:38 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-057b9909-be17-4316-bb87-fe0f40a3042d tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:26:38 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-057b9909-be17-4316-bb87-fe0f40a3042d tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] 10.0.0.210 "POST /compute/v2.1/servers/902e4077-e0d6-4b61-a861-883be253f1e0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.480889 Apr 13 16:26:38 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 135/401] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 16:26:38 2023] POST /compute/v2.1/servers/902e4077-e0d6-4b61-a861-883be253f1e0/os-volume_attachments => generated 194 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:26:46 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-01cde371-b17c-40e7-b1fa-f59638ae537b tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:26:46 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-01cde371-b17c-40e7-b1fa-f59638ae537b tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:26:46 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_api:SELECT=10,nova_api:UPDATE=1 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:26:46 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_cell1:SELECT=18,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:26:46 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-01cde371-b17c-40e7-b1fa-f59638ae537b tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:26:46 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-01cde371-b17c-40e7-b1fa-f59638ae537b tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:26:46 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-01cde371-b17c-40e7-b1fa-f59638ae537b tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:26:46 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-01cde371-b17c-40e7-b1fa-f59638ae537b tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:26:46 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-01cde371-b17c-40e7-b1fa-f59638ae537b tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:26:46 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-01cde371-b17c-40e7-b1fa-f59638ae537b tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:26:46 user devstack@n-api.service[62053]: DEBUG nova.objects.instance [None req-01cde371-b17c-40e7-b1fa-f59638ae537b tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Lazy-loading 'services' on Instance uuid bbcccf4b-e861-4254-9be3-a491776214e9 {{(pid=62053) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 16:26:46 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-01cde371-b17c-40e7-b1fa-f59638ae537b tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/bbcccf4b-e861-4254-9be3-a491776214e9/os-volume_attachments/dc7649d3-fc59-438d-b230-72c4ce61e722" status: 202 len: 0 microversion: 2.1 time: 0.226846 Apr 13 16:26:46 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 134/402] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 16:26:46 2023] DELETE /compute/v2.1/servers/bbcccf4b-e861-4254-9be3-a491776214e9/os-volume_attachments/dc7649d3-fc59-438d-b230-72c4ce61e722 => generated 0 bytes in 230 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 16:26:46 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_api:SELECT=14 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:26:46 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:26:46 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-fa24bf1d-e3b7-4d58-9906-7790796df412 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:26:46 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-fa24bf1d-e3b7-4d58-9906-7790796df412 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:26:46 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-fa24bf1d-e3b7-4d58-9906-7790796df412 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:26:46 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-fa24bf1d-e3b7-4d58-9906-7790796df412 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:26:46 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-fa24bf1d-e3b7-4d58-9906-7790796df412 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:26:46 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-fa24bf1d-e3b7-4d58-9906-7790796df412 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:26:46 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-fa24bf1d-e3b7-4d58-9906-7790796df412 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:26:46 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-fa24bf1d-e3b7-4d58-9906-7790796df412 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:26:46 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-fa24bf1d-e3b7-4d58-9906-7790796df412 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bbcccf4b-e861-4254-9be3-a491776214e9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069605 Apr 13 16:26:46 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 134/403] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 16:26:46 2023] GET /compute/v2.1/servers/bbcccf4b-e861-4254-9be3-a491776214e9/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:26:50 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_api:SELECT=2 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:26:50 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:26:50 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-85795d8a-ac6d-4289-84eb-3a14d6089020 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:26:50 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-85795d8a-ac6d-4289-84eb-3a14d6089020 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] [instance: 7973e93b-6311-44ed-91ff-e861c32d0277] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:26:50 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-85795d8a-ac6d-4289-84eb-3a14d6089020 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:26:50 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-85795d8a-ac6d-4289-84eb-3a14d6089020 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:26:50 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-85795d8a-ac6d-4289-84eb-3a14d6089020 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:26:50 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-85795d8a-ac6d-4289-84eb-3a14d6089020 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:26:50 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-85795d8a-ac6d-4289-84eb-3a14d6089020 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:26:50 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-85795d8a-ac6d-4289-84eb-3a14d6089020 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:26:50 user devstack@n-api.service[62054]: DEBUG nova.policy [None req-85795d8a-ac6d-4289-84eb-3a14d6089020 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ddd547d240b43ccb213e9d459082309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5554aa7f1b4d471b8807a845ab1ea33f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62054) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:26:50 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-85795d8a-ac6d-4289-84eb-3a14d6089020 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7973e93b-6311-44ed-91ff-e861c32d0277" status: 200 len: 1493 microversion: 2.1 time: 0.156192 Apr 13 16:26:50 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 136/404] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:26:50 2023] GET /compute/v2.1/servers/7973e93b-6311-44ed-91ff-e861c32d0277 => generated 1493 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:26:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-2931b7ea-f039-4f48-bb86-aaac3fe7361c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:26:54 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-2931b7ea-f039-4f48-bb86-aaac3fe7361c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 5ea4ab6a-6501-4a2f-a8f7-04090024747d] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:26:54 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-2931b7ea-f039-4f48-bb86-aaac3fe7361c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:26:54 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-2931b7ea-f039-4f48-bb86-aaac3fe7361c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:26:54 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-2931b7ea-f039-4f48-bb86-aaac3fe7361c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:26:54 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-2931b7ea-f039-4f48-bb86-aaac3fe7361c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:26:54 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-2931b7ea-f039-4f48-bb86-aaac3fe7361c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:26:54 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-2931b7ea-f039-4f48-bb86-aaac3fe7361c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:26:54 user devstack@n-api.service[62053]: DEBUG nova.policy [None req-2931b7ea-f039-4f48-bb86-aaac3fe7361c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e10f63cdd49a9a1ebe1fe4c9de0a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d451e0e239f486aa2b3abe9e273eab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62053) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:26:54 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-2931b7ea-f039-4f48-bb86-aaac3fe7361c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5ea4ab6a-6501-4a2f-a8f7-04090024747d" status: 200 len: 1393 microversion: 2.1 time: 0.159029 Apr 13 16:26:54 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 135/405] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:26:54 2023] GET /compute/v2.1/servers/5ea4ab6a-6501-4a2f-a8f7-04090024747d => generated 1393 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:26:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-e4122f09-d78c-4ecc-b89e-815bc6d0270e tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-417163356"}} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:26:54 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-e4122f09-d78c-4ecc-b89e-815bc6d0270e tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 5ea4ab6a-6501-4a2f-a8f7-04090024747d] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:26:54 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-e4122f09-d78c-4ecc-b89e-815bc6d0270e tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:26:54 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-e4122f09-d78c-4ecc-b89e-815bc6d0270e tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:26:54 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-e4122f09-d78c-4ecc-b89e-815bc6d0270e tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:26:54 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-e4122f09-d78c-4ecc-b89e-815bc6d0270e tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:26:54 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-e4122f09-d78c-4ecc-b89e-815bc6d0270e tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:26:54 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-e4122f09-d78c-4ecc-b89e-815bc6d0270e tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:26:54 user devstack@n-api.service[62055]: INFO nova.compute.api [None req-e4122f09-d78c-4ecc-b89e-815bc6d0270e tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 5ea4ab6a-6501-4a2f-a8f7-04090024747d] Attempting to quiesce instance before volume snapshot. Apr 13 16:26:54 user devstack@n-api.service[62055]: INFO nova.compute.api [None req-e4122f09-d78c-4ecc-b89e-815bc6d0270e tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 5ea4ab6a-6501-4a2f-a8f7-04090024747d] Skipping quiescing instance: QEMU guest agent is not enabled. Apr 13 16:26:54 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-e4122f09-d78c-4ecc-b89e-815bc6d0270e tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 5ea4ab6a-6501-4a2f-a8f7-04090024747d] Creating snapshot from volume e4317bfd-71c2-4c48-a0f0-e3c795f262a8. {{(pid=62055) snapshot_instance /opt/stack/nova/nova/compute/api.py:3511}} Apr 13 16:26:56 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-f6948a5f-d016-468a-a94d-752f539b3ca4 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:26:56 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-f6948a5f-d016-468a-a94d-752f539b3ca4 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] [instance: 902e4077-e0d6-4b61-a861-883be253f1e0] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:26:56 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-f6948a5f-d016-468a-a94d-752f539b3ca4 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:26:56 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-f6948a5f-d016-468a-a94d-752f539b3ca4 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:26:56 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-f6948a5f-d016-468a-a94d-752f539b3ca4 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:26:56 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-f6948a5f-d016-468a-a94d-752f539b3ca4 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:26:56 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-f6948a5f-d016-468a-a94d-752f539b3ca4 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:26:56 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-f6948a5f-d016-468a-a94d-752f539b3ca4 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:26:56 user devstack@n-api.service[62054]: DEBUG nova.objects.instance [None req-f6948a5f-d016-468a-a94d-752f539b3ca4 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Lazy-loading 'services' on Instance uuid 902e4077-e0d6-4b61-a861-883be253f1e0 {{(pid=62054) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 16:26:56 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-f6948a5f-d016-468a-a94d-752f539b3ca4 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/902e4077-e0d6-4b61-a861-883be253f1e0/os-volume_attachments/6c64d091-303e-4a8b-bc23-ec85ca668f40" status: 202 len: 0 microversion: 2.1 time: 0.163846 Apr 13 16:26:56 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 137/406] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 16:26:56 2023] DELETE /compute/v2.1/servers/902e4077-e0d6-4b61-a861-883be253f1e0/os-volume_attachments/6c64d091-303e-4a8b-bc23-ec85ca668f40 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 16:26:56 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-fadc2ade-5256-4641-ac83-c5c7d7c64dd3 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:26:56 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-fadc2ade-5256-4641-ac83-c5c7d7c64dd3 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] [instance: 902e4077-e0d6-4b61-a861-883be253f1e0] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:26:56 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-fadc2ade-5256-4641-ac83-c5c7d7c64dd3 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:26:56 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-fadc2ade-5256-4641-ac83-c5c7d7c64dd3 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:26:56 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-fadc2ade-5256-4641-ac83-c5c7d7c64dd3 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:26:56 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-fadc2ade-5256-4641-ac83-c5c7d7c64dd3 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:26:56 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-fadc2ade-5256-4641-ac83-c5c7d7c64dd3 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:26:56 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-fadc2ade-5256-4641-ac83-c5c7d7c64dd3 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:26:56 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-fadc2ade-5256-4641-ac83-c5c7d7c64dd3 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] [instance: 902e4077-e0d6-4b61-a861-883be253f1e0] Going to try to terminate instance {{(pid=62053) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 16:26:56 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-fadc2ade-5256-4641-ac83-c5c7d7c64dd3 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/902e4077-e0d6-4b61-a861-883be253f1e0" status: 204 len: 0 microversion: 2.1 time: 0.139110 Apr 13 16:26:56 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 136/407] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 16:26:56 2023] DELETE /compute/v2.1/servers/902e4077-e0d6-4b61-a861-883be253f1e0 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 16:26:56 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-2684de4f-44fb-493d-9148-a257dedbcea8 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:26:56 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-2684de4f-44fb-493d-9148-a257dedbcea8 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] [instance: 902e4077-e0d6-4b61-a861-883be253f1e0] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:26:56 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-2684de4f-44fb-493d-9148-a257dedbcea8 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:26:56 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-2684de4f-44fb-493d-9148-a257dedbcea8 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:26:56 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-2684de4f-44fb-493d-9148-a257dedbcea8 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:26:56 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-2684de4f-44fb-493d-9148-a257dedbcea8 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:26:56 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-2684de4f-44fb-493d-9148-a257dedbcea8 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:26:56 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-2684de4f-44fb-493d-9148-a257dedbcea8 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:26:57 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-e4122f09-d78c-4ecc-b89e-815bc6d0270e tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] 10.0.0.210 "POST /compute/v2.1/servers/5ea4ab6a-6501-4a2f-a8f7-04090024747d/action" status: 202 len: 0 microversion: 2.1 time: 2.703276 Apr 13 16:26:57 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 135/408] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 16:26:54 2023] POST /compute/v2.1/servers/5ea4ab6a-6501-4a2f-a8f7-04090024747d/action => generated 0 bytes in 2705 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Apr 13 16:26:57 user devstack@n-api.service[62054]: DEBUG nova.policy [None req-2684de4f-44fb-493d-9148-a257dedbcea8 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9223a3efe4bc4e37946c8ed718100de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7395d2408a44cc88cf88eb49d5f8503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62054) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:26:57 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-2684de4f-44fb-493d-9148-a257dedbcea8 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] 10.0.0.210 "GET /compute/v2.1/servers/902e4077-e0d6-4b61-a861-883be253f1e0" status: 200 len: 1548 microversion: 2.1 time: 0.169012 Apr 13 16:26:57 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 138/409] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:26:56 2023] GET /compute/v2.1/servers/902e4077-e0d6-4b61-a861-883be253f1e0 => generated 1548 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:26:57 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-0e88a05e-c4ef-4adc-8c74-1e9f3b628392 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:26:57 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-0e88a05e-c4ef-4adc-8c74-1e9f3b628392 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:26:57 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-0e88a05e-c4ef-4adc-8c74-1e9f3b628392 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:26:57 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-0e88a05e-c4ef-4adc-8c74-1e9f3b628392 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:26:57 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-0e88a05e-c4ef-4adc-8c74-1e9f3b628392 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:26:57 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-0e88a05e-c4ef-4adc-8c74-1e9f3b628392 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:26:57 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-0e88a05e-c4ef-4adc-8c74-1e9f3b628392 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:26:57 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-0e88a05e-c4ef-4adc-8c74-1e9f3b628392 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:26:57 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-be1f0e44-4d7f-4429-a718-bf4c73c90fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-1605197208", "imageRef": "02551df5-2d31-40a8-8d99-40af9cae089b", "flavorRef": "42", "networks": [{"uuid": "d36bc206-f629-4d6e-8a3f-458061d7b525"}]}} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:26:57 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-0e88a05e-c4ef-4adc-8c74-1e9f3b628392 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] 10.0.0.210 "POST /compute/v2.1/servers/235f827c-7116-48e9-84c5-0c9761c18e1e/action" status: 202 len: 0 microversion: 2.87 time: 0.081966 Apr 13 16:26:57 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 137/410] 10.0.0.210 () {66 vars in 1396 bytes} [Thu Apr 13 16:26:57 2023] POST /compute/v2.1/servers/235f827c-7116-48e9-84c5-0c9761c18e1e/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 13 16:26:57 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-37064f38-7ad4-43ef-9643-2634812744d4 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:26:57 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-37064f38-7ad4-43ef-9643-2634812744d4 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:26:57 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-37064f38-7ad4-43ef-9643-2634812744d4 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:26:57 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-37064f38-7ad4-43ef-9643-2634812744d4 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:26:57 user devstack@n-api.service[62055]: DEBUG nova.network.neutron [None req-be1f0e44-4d7f-4429-a718-bf4c73c90fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] validate_networks() for [('d36bc206-f629-4d6e-8a3f-458061d7b525', None, None, None, None, None)] {{(pid=62055) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 16:26:57 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-37064f38-7ad4-43ef-9643-2634812744d4 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:26:57 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-37064f38-7ad4-43ef-9643-2634812744d4 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:26:57 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-37064f38-7ad4-43ef-9643-2634812744d4 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:26:57 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-37064f38-7ad4-43ef-9643-2634812744d4 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:26:57 user devstack@n-api.service[62054]: DEBUG nova.policy [None req-37064f38-7ad4-43ef-9643-2634812744d4 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45a882dbafb4ea4976e4f45289eb2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d09a74bf684a9fb1dd1e95d6c23f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62054) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:26:57 user devstack@n-api.service[62054]: DEBUG nova.policy [None req-37064f38-7ad4-43ef-9643-2634812744d4 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e45a882dbafb4ea4976e4f45289eb2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d09a74bf684a9fb1dd1e95d6c23f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62054) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:26:57 user devstack@n-api.service[62054]: DEBUG nova.policy [None req-37064f38-7ad4-43ef-9643-2634812744d4 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e45a882dbafb4ea4976e4f45289eb2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d09a74bf684a9fb1dd1e95d6c23f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62054) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:26:57 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-37064f38-7ad4-43ef-9643-2634812744d4 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] 10.0.0.210 "GET /compute/v2.1/servers/235f827c-7116-48e9-84c5-0c9761c18e1e" status: 200 len: 1763 microversion: 2.87 time: 0.207129 Apr 13 16:26:57 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 139/411] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 16:26:57 2023] GET /compute/v2.1/servers/235f827c-7116-48e9-84c5-0c9761c18e1e => generated 1763 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 16:26:57 user devstack@n-api.service[62055]: DEBUG nova.virt.hardware [None req-be1f0e44-4d7f-4429-a718-bf4c73c90fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Flavor limits 0:0:0 {{(pid=62055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 16:26:57 user devstack@n-api.service[62055]: DEBUG nova.virt.hardware [None req-be1f0e44-4d7f-4429-a718-bf4c73c90fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Image limits 0:0:0 {{(pid=62055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 16:26:57 user devstack@n-api.service[62055]: DEBUG nova.virt.hardware [None req-be1f0e44-4d7f-4429-a718-bf4c73c90fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Flavor pref 0:0:0 {{(pid=62055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 16:26:57 user devstack@n-api.service[62055]: DEBUG nova.virt.hardware [None req-be1f0e44-4d7f-4429-a718-bf4c73c90fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Image pref 0:0:0 {{(pid=62055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 16:26:57 user devstack@n-api.service[62055]: DEBUG nova.virt.hardware [None req-be1f0e44-4d7f-4429-a718-bf4c73c90fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 16:26:57 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-be1f0e44-4d7f-4429-a718-bf4c73c90fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:26:57 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-be1f0e44-4d7f-4429-a718-bf4c73c90fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:26:57 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-be1f0e44-4d7f-4429-a718-bf4c73c90fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:26:57 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-be1f0e44-4d7f-4429-a718-bf4c73c90fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:26:57 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-be1f0e44-4d7f-4429-a718-bf4c73c90fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:26:57 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-be1f0e44-4d7f-4429-a718-bf4c73c90fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:26:57 user devstack@n-api.service[62055]: DEBUG nova.quota [None req-be1f0e44-4d7f-4429-a718-bf4c73c90fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Getting quotas for project 8d451e0e239f486aa2b3abe9e273eab3. Resources: {'instances', 'cores', 'ram'} {{(pid=62055) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 16:26:57 user devstack@n-api.service[62055]: DEBUG nova.quota [None req-be1f0e44-4d7f-4429-a718-bf4c73c90fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Getting quotas for user d70e10f63cdd49a9a1ebe1fe4c9de0a2 and project 8d451e0e239f486aa2b3abe9e273eab3. Resources: {'instances', 'cores', 'ram'} {{(pid=62055) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 16:26:57 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-be1f0e44-4d7f-4429-a718-bf4c73c90fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Going to run 1 instances... {{(pid=62055) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 16:26:57 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-be1f0e44-4d7f-4429-a718-bf4c73c90fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 0f52d9e3-921c-4f79-9cdb-7d73500c8c35] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/vda',device_type='disk',disk_bus='virtio',encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='4e1ba122-cfbe-44c9-a5b3-770ea148cbb8',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=62055) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 16:26:57 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-be1f0e44-4d7f-4429-a718-bf4c73c90fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.644978 Apr 13 16:26:57 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 136/412] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 16:26:57 2023] POST /compute/v2.1/servers => generated 378 bytes in 647 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 16:26:57 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-c83e9068-6b9e-42f4-931c-05bcf6e2764f tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:26:57 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-c83e9068-6b9e-42f4-931c-05bcf6e2764f tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 0f52d9e3-921c-4f79-9cdb-7d73500c8c35] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:26:58 user devstack@n-api.service[62053]: DEBUG nova.policy [None req-c83e9068-6b9e-42f4-931c-05bcf6e2764f tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e10f63cdd49a9a1ebe1fe4c9de0a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d451e0e239f486aa2b3abe9e273eab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62053) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:26:58 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-c83e9068-6b9e-42f4-931c-05bcf6e2764f tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0f52d9e3-921c-4f79-9cdb-7d73500c8c35" status: 200 len: 1224 microversion: 2.1 time: 0.116955 Apr 13 16:26:58 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 138/413] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:26:57 2023] GET /compute/v2.1/servers/0f52d9e3-921c-4f79-9cdb-7d73500c8c35 => generated 1224 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:26:58 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-5c02551e-e775-48e1-a1b5-3d23be849132 req-61c22c69-ca97-4450-8e59-03bbedec1367 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "235f827c-7116-48e9-84c5-0c9761c18e1e", "name": "network-vif-unplugged", "status": "completed", "tag": "b72a6c8b-7244-41c2-a4f7-6da43b4944b8"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:26:58 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-5c02551e-e775-48e1-a1b5-3d23be849132 req-61c22c69-ca97-4450-8e59-03bbedec1367 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:26:58 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-5c02551e-e775-48e1-a1b5-3d23be849132 req-61c22c69-ca97-4450-8e59-03bbedec1367 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:26:58 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-5c02551e-e775-48e1-a1b5-3d23be849132 req-61c22c69-ca97-4450-8e59-03bbedec1367 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:26:58 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-5c02551e-e775-48e1-a1b5-3d23be849132 req-61c22c69-ca97-4450-8e59-03bbedec1367 service nova] Creating event network-vif-unplugged:b72a6c8b-7244-41c2-a4f7-6da43b4944b8 for instance 235f827c-7116-48e9-84c5-0c9761c18e1e on user Apr 13 16:26:58 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [req-5c02551e-e775-48e1-a1b5-3d23be849132 req-61c22c69-ca97-4450-8e59-03bbedec1367 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.056746 Apr 13 16:26:58 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 140/414] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:26:58 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:26:59 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [req-9b91a7e7-42cd-43aa-a138-eff9e7da7046 req-29d3e9e0-1fb8-4e1e-80c7-acd7db95f139 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "902e4077-e0d6-4b61-a861-883be253f1e0", "name": "network-vif-unplugged", "status": "completed", "tag": "58b69a6e-8c04-42e5-931a-0947d9c0f78d"}]} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:26:59 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-9b91a7e7-42cd-43aa-a138-eff9e7da7046 req-29d3e9e0-1fb8-4e1e-80c7-acd7db95f139 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:26:59 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-9b91a7e7-42cd-43aa-a138-eff9e7da7046 req-29d3e9e0-1fb8-4e1e-80c7-acd7db95f139 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:26:59 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-9b91a7e7-42cd-43aa-a138-eff9e7da7046 req-29d3e9e0-1fb8-4e1e-80c7-acd7db95f139 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:26:59 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-9b91a7e7-42cd-43aa-a138-eff9e7da7046 req-29d3e9e0-1fb8-4e1e-80c7-acd7db95f139 service nova] Creating event network-vif-unplugged:58b69a6e-8c04-42e5-931a-0947d9c0f78d for instance 902e4077-e0d6-4b61-a861-883be253f1e0 on user Apr 13 16:26:59 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [req-9b91a7e7-42cd-43aa-a138-eff9e7da7046 req-29d3e9e0-1fb8-4e1e-80c7-acd7db95f139 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043008 Apr 13 16:26:59 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 137/415] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:26:59 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:27:00 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-f2a2353e-2261-44a2-be1b-982085958fa6 req-0913720f-d400-4f6e-a390-655a1a7fcf54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "235f827c-7116-48e9-84c5-0c9761c18e1e", "name": "network-vif-plugged", "status": "completed", "tag": "b72a6c8b-7244-41c2-a4f7-6da43b4944b8"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:27:00 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-f2a2353e-2261-44a2-be1b-982085958fa6 req-0913720f-d400-4f6e-a390-655a1a7fcf54 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:27:00 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-f2a2353e-2261-44a2-be1b-982085958fa6 req-0913720f-d400-4f6e-a390-655a1a7fcf54 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:27:00 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-f2a2353e-2261-44a2-be1b-982085958fa6 req-0913720f-d400-4f6e-a390-655a1a7fcf54 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:27:00 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-f2a2353e-2261-44a2-be1b-982085958fa6 req-0913720f-d400-4f6e-a390-655a1a7fcf54 service nova] Creating event network-vif-plugged:b72a6c8b-7244-41c2-a4f7-6da43b4944b8 for instance 235f827c-7116-48e9-84c5-0c9761c18e1e on user Apr 13 16:27:00 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [req-f2a2353e-2261-44a2-be1b-982085958fa6 req-0913720f-d400-4f6e-a390-655a1a7fcf54 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028195 Apr 13 16:27:00 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 139/416] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:27:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:27:01 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-97e5f2ad-e377-4378-b794-7a3e49fbb72a req-3b07f85e-15c0-444b-a677-8511d2fbfdfd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "902e4077-e0d6-4b61-a861-883be253f1e0", "name": "network-vif-plugged", "status": "completed", "tag": "58b69a6e-8c04-42e5-931a-0947d9c0f78d"}, {"server_uuid": "902e4077-e0d6-4b61-a861-883be253f1e0", "name": "network-vif-deleted", "tag": "58b69a6e-8c04-42e5-931a-0947d9c0f78d"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:27:01 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-97e5f2ad-e377-4378-b794-7a3e49fbb72a req-3b07f85e-15c0-444b-a677-8511d2fbfdfd service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:27:01 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-97e5f2ad-e377-4378-b794-7a3e49fbb72a req-3b07f85e-15c0-444b-a677-8511d2fbfdfd service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:27:01 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-97e5f2ad-e377-4378-b794-7a3e49fbb72a req-3b07f85e-15c0-444b-a677-8511d2fbfdfd service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:27:01 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-97e5f2ad-e377-4378-b794-7a3e49fbb72a req-3b07f85e-15c0-444b-a677-8511d2fbfdfd service nova] Creating event network-vif-plugged:58b69a6e-8c04-42e5-931a-0947d9c0f78d for instance 902e4077-e0d6-4b61-a861-883be253f1e0 on user Apr 13 16:27:01 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-97e5f2ad-e377-4378-b794-7a3e49fbb72a req-3b07f85e-15c0-444b-a677-8511d2fbfdfd service nova] Creating event network-vif-deleted:58b69a6e-8c04-42e5-931a-0947d9c0f78d for instance 902e4077-e0d6-4b61-a861-883be253f1e0 on user Apr 13 16:27:01 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [req-97e5f2ad-e377-4378-b794-7a3e49fbb72a req-3b07f85e-15c0-444b-a677-8511d2fbfdfd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.035368 Apr 13 16:27:01 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 141/417] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:27:01 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:27:02 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [req-a6ae7682-5970-4e12-9e32-d498bce97ae0 req-84e0b9c0-a13a-45cd-b69b-b9fc28478843 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "235f827c-7116-48e9-84c5-0c9761c18e1e", "name": "network-vif-plugged", "status": "completed", "tag": "b72a6c8b-7244-41c2-a4f7-6da43b4944b8"}, {"server_uuid": "235f827c-7116-48e9-84c5-0c9761c18e1e", "name": "network-vif-plugged", "status": "completed", "tag": "b72a6c8b-7244-41c2-a4f7-6da43b4944b8"}]} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:27:02 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-a6ae7682-5970-4e12-9e32-d498bce97ae0 req-84e0b9c0-a13a-45cd-b69b-b9fc28478843 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:27:02 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-a6ae7682-5970-4e12-9e32-d498bce97ae0 req-84e0b9c0-a13a-45cd-b69b-b9fc28478843 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:27:02 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-a6ae7682-5970-4e12-9e32-d498bce97ae0 req-84e0b9c0-a13a-45cd-b69b-b9fc28478843 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:27:02 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-a6ae7682-5970-4e12-9e32-d498bce97ae0 req-84e0b9c0-a13a-45cd-b69b-b9fc28478843 service nova] Creating event network-vif-plugged:b72a6c8b-7244-41c2-a4f7-6da43b4944b8 for instance 235f827c-7116-48e9-84c5-0c9761c18e1e on user Apr 13 16:27:02 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-a6ae7682-5970-4e12-9e32-d498bce97ae0 req-84e0b9c0-a13a-45cd-b69b-b9fc28478843 service nova] Creating event network-vif-plugged:b72a6c8b-7244-41c2-a4f7-6da43b4944b8 for instance 235f827c-7116-48e9-84c5-0c9761c18e1e on user Apr 13 16:27:02 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [req-a6ae7682-5970-4e12-9e32-d498bce97ae0 req-84e0b9c0-a13a-45cd-b69b-b9fc28478843 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.037226 Apr 13 16:27:02 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 138/418] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:27:02 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:27:03 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-8fdee42c-fc23-42b2-8683-e8ae5e901b3b req-84d6669d-90d3-4a50-b4e1-d2fa9a11e426 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f52d9e3-921c-4f79-9cdb-7d73500c8c35", "tag": "d68dc4c7-5e6e-4d7f-8143-62eeb1816486"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:27:03 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-8fdee42c-fc23-42b2-8683-e8ae5e901b3b req-84d6669d-90d3-4a50-b4e1-d2fa9a11e426 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:27:03 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-8fdee42c-fc23-42b2-8683-e8ae5e901b3b req-84d6669d-90d3-4a50-b4e1-d2fa9a11e426 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:27:03 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-8fdee42c-fc23-42b2-8683-e8ae5e901b3b req-84d6669d-90d3-4a50-b4e1-d2fa9a11e426 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:27:03 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-8fdee42c-fc23-42b2-8683-e8ae5e901b3b req-84d6669d-90d3-4a50-b4e1-d2fa9a11e426 service nova] Creating event network-changed:d68dc4c7-5e6e-4d7f-8143-62eeb1816486 for instance 0f52d9e3-921c-4f79-9cdb-7d73500c8c35 on user Apr 13 16:27:03 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [req-8fdee42c-fc23-42b2-8683-e8ae5e901b3b req-84d6669d-90d3-4a50-b4e1-d2fa9a11e426 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028714 Apr 13 16:27:03 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 140/419] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:27:03 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:27:03 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-817e13dd-da6d-41bc-b5f7-e224a18eb70d tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:27:03 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-817e13dd-da6d-41bc-b5f7-e224a18eb70d tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:27:03 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-817e13dd-da6d-41bc-b5f7-e224a18eb70d tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:27:03 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-817e13dd-da6d-41bc-b5f7-e224a18eb70d tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:27:03 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-817e13dd-da6d-41bc-b5f7-e224a18eb70d tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:27:03 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-817e13dd-da6d-41bc-b5f7-e224a18eb70d tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:27:03 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-817e13dd-da6d-41bc-b5f7-e224a18eb70d tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:27:03 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-817e13dd-da6d-41bc-b5f7-e224a18eb70d tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:27:03 user devstack@n-api.service[62054]: DEBUG nova.policy [None req-817e13dd-da6d-41bc-b5f7-e224a18eb70d tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fab402fb794a5a9281cfb7fe188813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24904988cf334657b084fd726c7ecf8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62054) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:27:03 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-817e13dd-da6d-41bc-b5f7-e224a18eb70d tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eaae47b9-a059-49f6-9ae6-d7147003e2f2" status: 200 len: 1689 microversion: 2.1 time: 0.144254 Apr 13 16:27:03 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 142/420] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:27:03 2023] GET /compute/v2.1/servers/eaae47b9-a059-49f6-9ae6-d7147003e2f2 => generated 1689 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:27:12 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_cell0:SELECT=2 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:27:12 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_cell0:SELECT=6 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:27:12 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=3 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:27:12 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-09a265a8-335e-4637-8084-afa225f4f65a req-c13d3cf1-cded-45ce-8ee8-d90907b7f2de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf350da4-9cc2-4900-adf0-506e44984b42", "tag": "1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:27:12 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_cell1:SELECT=26,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:27:12 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_cell0:SELECT=2 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:27:12 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-5f3566b0-cecc-492c-89bd-07e42b3d3b37 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:27:12 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-5f3566b0-cecc-492c-89bd-07e42b3d3b37 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:27:12 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-09a265a8-335e-4637-8084-afa225f4f65a req-c13d3cf1-cded-45ce-8ee8-d90907b7f2de service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:27:12 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-09a265a8-335e-4637-8084-afa225f4f65a req-c13d3cf1-cded-45ce-8ee8-d90907b7f2de service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:27:12 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-09a265a8-335e-4637-8084-afa225f4f65a req-c13d3cf1-cded-45ce-8ee8-d90907b7f2de service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:27:12 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-5f3566b0-cecc-492c-89bd-07e42b3d3b37 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:27:12 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-5f3566b0-cecc-492c-89bd-07e42b3d3b37 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:27:12 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-5f3566b0-cecc-492c-89bd-07e42b3d3b37 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:27:12 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-5f3566b0-cecc-492c-89bd-07e42b3d3b37 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:27:12 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-5f3566b0-cecc-492c-89bd-07e42b3d3b37 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:27:12 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-5f3566b0-cecc-492c-89bd-07e42b3d3b37 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:27:12 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-09a265a8-335e-4637-8084-afa225f4f65a req-c13d3cf1-cded-45ce-8ee8-d90907b7f2de service nova] Creating event network-changed:1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8 for instance bf350da4-9cc2-4900-adf0-506e44984b42 on user Apr 13 16:27:12 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [req-09a265a8-335e-4637-8084-afa225f4f65a req-c13d3cf1-cded-45ce-8ee8-d90907b7f2de service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033494 Apr 13 16:27:12 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 141/421] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:27:12 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:27:12 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-5f3566b0-cecc-492c-89bd-07e42b3d3b37 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Going to try to terminate instance {{(pid=62055) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 16:27:12 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-5f3566b0-cecc-492c-89bd-07e42b3d3b37 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/bf350da4-9cc2-4900-adf0-506e44984b42" status: 204 len: 0 microversion: 2.1 time: 0.137238 Apr 13 16:27:12 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 139/422] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 16:27:12 2023] DELETE /compute/v2.1/servers/bf350da4-9cc2-4900-adf0-506e44984b42 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 16:27:12 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-d7cd19c9-6fff-4e05-bd45-aa3ee4e812cd tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:27:12 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-d7cd19c9-6fff-4e05-bd45-aa3ee4e812cd tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:27:12 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-d7cd19c9-6fff-4e05-bd45-aa3ee4e812cd tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:27:12 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-d7cd19c9-6fff-4e05-bd45-aa3ee4e812cd tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:27:12 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-d7cd19c9-6fff-4e05-bd45-aa3ee4e812cd tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:27:12 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-d7cd19c9-6fff-4e05-bd45-aa3ee4e812cd tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:27:12 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-d7cd19c9-6fff-4e05-bd45-aa3ee4e812cd tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:27:12 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-d7cd19c9-6fff-4e05-bd45-aa3ee4e812cd tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:27:12 user devstack@n-api.service[62054]: DEBUG nova.policy [None req-d7cd19c9-6fff-4e05-bd45-aa3ee4e812cd tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6a4bf1a7794af2958c3d53ea1e19c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed94fa5d89c2486b8e2951e608e6630f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62054) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:27:12 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-d7cd19c9-6fff-4e05-bd45-aa3ee4e812cd tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bf350da4-9cc2-4900-adf0-506e44984b42" status: 200 len: 1556 microversion: 2.1 time: 0.258548 Apr 13 16:27:12 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 143/423] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:27:12 2023] GET /compute/v2.1/servers/bf350da4-9cc2-4900-adf0-506e44984b42 => generated 1556 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:27:12 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-2a8a5cdd-2fba-449f-aaae-2be4500fc6f7 req-9332f2fd-f7c1-4982-a1a1-806b2adb5206 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf350da4-9cc2-4900-adf0-506e44984b42", "name": "network-vif-unplugged", "status": "completed", "tag": "1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:27:12 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-2a8a5cdd-2fba-449f-aaae-2be4500fc6f7 req-9332f2fd-f7c1-4982-a1a1-806b2adb5206 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:27:12 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-2a8a5cdd-2fba-449f-aaae-2be4500fc6f7 req-9332f2fd-f7c1-4982-a1a1-806b2adb5206 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:27:12 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-2a8a5cdd-2fba-449f-aaae-2be4500fc6f7 req-9332f2fd-f7c1-4982-a1a1-806b2adb5206 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:27:12 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-2a8a5cdd-2fba-449f-aaae-2be4500fc6f7 req-9332f2fd-f7c1-4982-a1a1-806b2adb5206 service nova] Creating event network-vif-unplugged:1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8 for instance bf350da4-9cc2-4900-adf0-506e44984b42 on user Apr 13 16:27:12 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [req-2a8a5cdd-2fba-449f-aaae-2be4500fc6f7 req-9332f2fd-f7c1-4982-a1a1-806b2adb5206 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045887 Apr 13 16:27:12 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 142/424] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:27:12 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:27:14 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [req-eba62087-4a10-490d-a29f-faf10d3a0459 req-c71e52f4-dc95-4b7c-b341-db461cf52dbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf350da4-9cc2-4900-adf0-506e44984b42", "name": "network-vif-deleted", "tag": "1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8"}]} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:27:14 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-eba62087-4a10-490d-a29f-faf10d3a0459 req-c71e52f4-dc95-4b7c-b341-db461cf52dbf service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:27:14 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-eba62087-4a10-490d-a29f-faf10d3a0459 req-c71e52f4-dc95-4b7c-b341-db461cf52dbf service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:27:14 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-eba62087-4a10-490d-a29f-faf10d3a0459 req-c71e52f4-dc95-4b7c-b341-db461cf52dbf service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:27:14 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-eba62087-4a10-490d-a29f-faf10d3a0459 req-c71e52f4-dc95-4b7c-b341-db461cf52dbf service nova] Creating event network-vif-deleted:1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8 for instance bf350da4-9cc2-4900-adf0-506e44984b42 on user Apr 13 16:27:14 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [req-eba62087-4a10-490d-a29f-faf10d3a0459 req-c71e52f4-dc95-4b7c-b341-db461cf52dbf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034779 Apr 13 16:27:14 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 140/425] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:27:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:27:14 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-8ec6875c-673a-490a-b514-2aa3084b87ca req-8ce214ce-b3d3-4638-924b-a797bf996636 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f52d9e3-921c-4f79-9cdb-7d73500c8c35", "name": "network-vif-plugged", "status": "completed", "tag": "d68dc4c7-5e6e-4d7f-8143-62eeb1816486"}, {"server_uuid": "0f52d9e3-921c-4f79-9cdb-7d73500c8c35", "name": "network-vif-plugged", "status": "completed", "tag": "d68dc4c7-5e6e-4d7f-8143-62eeb1816486"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:27:14 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-8ec6875c-673a-490a-b514-2aa3084b87ca req-8ce214ce-b3d3-4638-924b-a797bf996636 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:27:14 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-8ec6875c-673a-490a-b514-2aa3084b87ca req-8ce214ce-b3d3-4638-924b-a797bf996636 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:27:14 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-8ec6875c-673a-490a-b514-2aa3084b87ca req-8ce214ce-b3d3-4638-924b-a797bf996636 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:27:14 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-0de74c0a-b0fb-4042-ae30-7e2585f0166a tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:27:14 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-0de74c0a-b0fb-4042-ae30-7e2585f0166a tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] [instance: 5db1cb51-2e5a-46c9-8914-cba759a96a65] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:27:14 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-0de74c0a-b0fb-4042-ae30-7e2585f0166a tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:27:14 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-0de74c0a-b0fb-4042-ae30-7e2585f0166a tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:27:14 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-0de74c0a-b0fb-4042-ae30-7e2585f0166a tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:27:14 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-0de74c0a-b0fb-4042-ae30-7e2585f0166a tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:27:14 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-0de74c0a-b0fb-4042-ae30-7e2585f0166a tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:27:14 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-0de74c0a-b0fb-4042-ae30-7e2585f0166a tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:27:14 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-8ec6875c-673a-490a-b514-2aa3084b87ca req-8ce214ce-b3d3-4638-924b-a797bf996636 service nova] Creating event network-vif-plugged:d68dc4c7-5e6e-4d7f-8143-62eeb1816486 for instance 0f52d9e3-921c-4f79-9cdb-7d73500c8c35 on user Apr 13 16:27:14 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-8ec6875c-673a-490a-b514-2aa3084b87ca req-8ce214ce-b3d3-4638-924b-a797bf996636 service nova] Creating event network-vif-plugged:d68dc4c7-5e6e-4d7f-8143-62eeb1816486 for instance 0f52d9e3-921c-4f79-9cdb-7d73500c8c35 on user Apr 13 16:27:14 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [req-8ec6875c-673a-490a-b514-2aa3084b87ca req-8ce214ce-b3d3-4638-924b-a797bf996636 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.030807 Apr 13 16:27:14 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 144/426] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:27:14 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:27:14 user devstack@n-api.service[62053]: INFO nova.api.openstack.wsgi [None req-0de74c0a-b0fb-4042-ae30-7e2585f0166a tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] HTTP exception thrown: Instance 5db1cb51-2e5a-46c9-8914-cba759a96a65 could not be found. Apr 13 16:27:14 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-0de74c0a-b0fb-4042-ae30-7e2585f0166a tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Request method failure captured: Apr 13 16:27:14 user devstack@n-api.service[62053]: request: GET /compute/v2.1/servers/5db1cb51-2e5a-46c9-8914-cba759a96a65 HTTP/1.1 Apr 13 16:27:14 user devstack@n-api.service[62053]: Accept: application/json Apr 13 16:27:14 user devstack@n-api.service[62053]: Accept-Encoding: identity Apr 13 16:27:14 user devstack@n-api.service[62053]: Connection: close Apr 13 16:27:14 user devstack@n-api.service[62053]: Content-Length: 0 Apr 13 16:27:14 user devstack@n-api.service[62053]: Content-Type: application/json Apr 13 16:27:14 user devstack@n-api.service[62053]: Host: 10.0.0.210 Apr 13 16:27:14 user devstack@n-api.service[62053]: Openstack-System-Scope: None Apr 13 16:27:14 user devstack@n-api.service[62053]: User-Agent: python-urllib3/1.26.15 Apr 13 16:27:14 user devstack@n-api.service[62053]: X-Auth-Token: gAAAAABkOCu67MgYnaiCt_3pkwW01IxEApxUUSNfs-qZrcQGeNBxBdaovS3Zw2mZNOx19ZOfPVglweLJOFzB1waE8IwDdFGeXXxXgqyPninUYKcOsXCzYWWVxtIP08uDV0EIq5Sd3quQx_Sxity2lmsc5pGbkYsRg_3ZX3PkCDqqSquRdAlSZoE Apr 13 16:27:14 user devstack@n-api.service[62053]: X-Domain-Id: None Apr 13 16:27:14 user devstack@n-api.service[62053]: X-Domain-Name: None Apr 13 16:27:14 user devstack@n-api.service[62053]: X-Identity-Status: Confirmed Apr 13 16:27:14 user devstack@n-api.service[62053]: X-Is-Admin-Project: True Apr 13 16:27:14 user devstack@n-api.service[62053]: X-Project-Domain-Id: default Apr 13 16:27:14 user devstack@n-api.service[62053]: X-Project-Domain-Name: Default Apr 13 16:27:14 user devstack@n-api.service[62053]: X-Project-Id: 5ded8a69b7e941f9bcdc502cfeed79db Apr 13 16:27:14 user devstack@n-api.service[62053]: X-Project-Name: tempest-VolumesAdminNegativeTest-694044578 Apr 13 16:27:14 user devstack@n-api.service[62053]: X-Role: reader,member Apr 13 16:27:14 user devstack@n-api.service[62053]: X-Roles: reader,member Apr 13 16:27:14 user devstack@n-api.service[62053]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5ded8a69b7e941f9bcdc502cfeed79db"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5ded8a69b7e941f9bcdc502cfeed79db"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5ded8a69b7e941f9bcdc502cfeed79db"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 13 16:27:14 user devstack@n-api.service[62053]: X-Tenant: tempest-VolumesAdminNegativeTest-694044578 Apr 13 16:27:14 user devstack@n-api.service[62053]: X-Tenant-Id: 5ded8a69b7e941f9bcdc502cfeed79db Apr 13 16:27:14 user devstack@n-api.service[62053]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-694044578 Apr 13 16:27:14 user devstack@n-api.service[62053]: X-User: tempest-VolumesAdminNegativeTest-694044578-project-member Apr 13 16:27:14 user devstack@n-api.service[62053]: X-User-Domain-Id: default Apr 13 16:27:14 user devstack@n-api.service[62053]: X-User-Domain-Name: Default Apr 13 16:27:14 user devstack@n-api.service[62053]: X-User-Id: 62cf399757f544649fed18ee5a31d50c Apr 13 16:27:14 user devstack@n-api.service[62053]: X-User-Name: tempest-VolumesAdminNegativeTest-694044578-project-member Apr 13 16:27:14 user devstack@n-api.service[62053]: method: > Apr 13 16:27:14 user devstack@n-api.service[62053]: exception: Instance 5db1cb51-2e5a-46c9-8914-cba759a96a65 could not be found. Apr 13 16:27:14 user devstack@n-api.service[62053]: action_args: {'id': '5db1cb51-2e5a-46c9-8914-cba759a96a65'} Apr 13 16:27:14 user devstack@n-api.service[62053]: {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 16:27:14 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:27:14 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 16:27:14 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 16:27:14 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 16:27:14 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 16:27:14 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 16:27:14 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 16:27:14 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 16:27:14 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 16:27:14 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5db1cb51-2e5a-46c9-8914-cba759a96a65 could not be found. Apr 13 16:27:14 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:27:14 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:27:14 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:27:14 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:27:14 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 16:27:14 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 16:27:14 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 16:27:14 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 16:27:14 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 16:27:14 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 16:27:14 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 16:27:14 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 16:27:14 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 16:27:14 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 16:27:14 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 16:27:14 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 16:27:14 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5db1cb51-2e5a-46c9-8914-cba759a96a65 could not be found. Apr 13 16:27:14 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:27:14 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:27:14 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:27:14 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:27:14 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 16:27:14 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 16:27:14 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 16:27:14 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 16:27:14 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5db1cb51-2e5a-46c9-8914-cba759a96a65 could not be found. Apr 13 16:27:14 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:27:14 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-0de74c0a-b0fb-4042-ae30-7e2585f0166a tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Returning 404 to user: Instance 5db1cb51-2e5a-46c9-8914-cba759a96a65 could not be found. {{(pid=62053) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 16:27:14 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-0de74c0a-b0fb-4042-ae30-7e2585f0166a tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5db1cb51-2e5a-46c9-8914-cba759a96a65" status: 404 len: 111 microversion: 2.1 time: 0.037440 Apr 13 16:27:14 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 143/427] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:27:14 2023] GET /compute/v2.1/servers/5db1cb51-2e5a-46c9-8914-cba759a96a65 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 16:27:14 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-86026095-89b2-4842-8198-2547c1f37fe8 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Calling method '.version_select at 0x7f96e4b09360>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:27:14 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-86026095-89b2-4842-8198-2547c1f37fe8 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-16668737" status: 202 len: 0 microversion: 2.1 time: 0.039732 Apr 13 16:27:14 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 141/428] 10.0.0.210 () {62 vars in 1292 bytes} [Thu Apr 13 16:27:14 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-16668737 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 16:27:15 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-f84df35e-a415-4a9e-b470-c42cb68fe0cb req-ea63b2d2-b103-4656-bf2f-f642b0eb7db8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf350da4-9cc2-4900-adf0-506e44984b42", "name": "network-vif-plugged", "status": "completed", "tag": "1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:27:15 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-f84df35e-a415-4a9e-b470-c42cb68fe0cb req-ea63b2d2-b103-4656-bf2f-f642b0eb7db8 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:27:15 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-f84df35e-a415-4a9e-b470-c42cb68fe0cb req-ea63b2d2-b103-4656-bf2f-f642b0eb7db8 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:27:15 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-f84df35e-a415-4a9e-b470-c42cb68fe0cb req-ea63b2d2-b103-4656-bf2f-f642b0eb7db8 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:27:15 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-f84df35e-a415-4a9e-b470-c42cb68fe0cb req-ea63b2d2-b103-4656-bf2f-f642b0eb7db8 service nova] Creating event network-vif-plugged:1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8 for instance bf350da4-9cc2-4900-adf0-506e44984b42 on user Apr 13 16:27:15 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [req-f84df35e-a415-4a9e-b470-c42cb68fe0cb req-ea63b2d2-b103-4656-bf2f-f642b0eb7db8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029936 Apr 13 16:27:15 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 145/429] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:27:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:27:26 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-6075abaf-caf8-4bff-b2d5-9bb4fa2cc1f4 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:27:26 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-6075abaf-caf8-4bff-b2d5-9bb4fa2cc1f4 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:27:26 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:27:26 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_cell1:SELECT=50,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:27:26 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-6075abaf-caf8-4bff-b2d5-9bb4fa2cc1f4 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:27:26 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-6075abaf-caf8-4bff-b2d5-9bb4fa2cc1f4 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:27:26 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-6075abaf-caf8-4bff-b2d5-9bb4fa2cc1f4 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:27:26 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-6075abaf-caf8-4bff-b2d5-9bb4fa2cc1f4 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:27:26 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-6075abaf-caf8-4bff-b2d5-9bb4fa2cc1f4 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:27:26 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-6075abaf-caf8-4bff-b2d5-9bb4fa2cc1f4 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:27:26 user devstack@n-api.service[62053]: DEBUG nova.policy [None req-6075abaf-caf8-4bff-b2d5-9bb4fa2cc1f4 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b3df1c5c5d441819bcef89ed6966815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980559734a504574a83224deb7423c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62053) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:27:26 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-6075abaf-caf8-4bff-b2d5-9bb4fa2cc1f4 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] 10.0.0.210 "GET /compute/v2.1/servers/acbcaee0-a47b-4fee-8765-9b1c9597d515" status: 200 len: 1659 microversion: 2.1 time: 0.265813 Apr 13 16:27:26 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 144/430] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:27:26 2023] GET /compute/v2.1/servers/acbcaee0-a47b-4fee-8765-9b1c9597d515 => generated 1659 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:27:26 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:27:26 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_api:SELECT=12,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:27:26 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-8badd565-8407-452f-817c-467e3fd3e81a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d53e720e-a9ca-499b-aacd-aad1a169a874"}} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:27:26 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-8badd565-8407-452f-817c-467e3fd3e81a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:27:26 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-8badd565-8407-452f-817c-467e3fd3e81a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:27:26 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-8badd565-8407-452f-817c-467e3fd3e81a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:27:26 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-8badd565-8407-452f-817c-467e3fd3e81a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:27:26 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-8badd565-8407-452f-817c-467e3fd3e81a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:27:26 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-8badd565-8407-452f-817c-467e3fd3e81a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:27:26 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-8badd565-8407-452f-817c-467e3fd3e81a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:27:26 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-8badd565-8407-452f-817c-467e3fd3e81a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] 10.0.0.210 "POST /compute/v2.1/servers/acbcaee0-a47b-4fee-8765-9b1c9597d515/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.311692 Apr 13 16:27:26 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 142/431] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 16:27:26 2023] POST /compute/v2.1/servers/acbcaee0-a47b-4fee-8765-9b1c9597d515/os-volume_attachments => generated 194 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:27:34 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_api:SELECT=22 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:27:34 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_cell1:SELECT=47,nova_cell1:INSERT=1 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:27:34 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-c6d688cf-e10a-419e-972d-bc4f4f9d7522 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:27:34 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-c6d688cf-e10a-419e-972d-bc4f4f9d7522 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:27:34 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-c6d688cf-e10a-419e-972d-bc4f4f9d7522 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:27:34 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-c6d688cf-e10a-419e-972d-bc4f4f9d7522 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:27:34 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-c6d688cf-e10a-419e-972d-bc4f4f9d7522 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:27:34 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-c6d688cf-e10a-419e-972d-bc4f4f9d7522 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:27:34 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-c6d688cf-e10a-419e-972d-bc4f4f9d7522 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:27:34 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-c6d688cf-e10a-419e-972d-bc4f4f9d7522 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:27:34 user devstack@n-api.service[62054]: DEBUG nova.policy [None req-c6d688cf-e10a-419e-972d-bc4f4f9d7522 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b3df1c5c5d441819bcef89ed6966815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980559734a504574a83224deb7423c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62054) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:27:34 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-c6d688cf-e10a-419e-972d-bc4f4f9d7522 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] 10.0.0.210 "GET /compute/v2.1/servers/acbcaee0-a47b-4fee-8765-9b1c9597d515" status: 200 len: 1705 microversion: 2.1 time: 0.297380 Apr 13 16:27:34 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 146/432] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:27:34 2023] GET /compute/v2.1/servers/acbcaee0-a47b-4fee-8765-9b1c9597d515 => generated 1705 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:27:34 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Action: 'action', calling method: >, body: {"rebuild": {"name": "tempest-ServerActionsTestJSON-server-376598631", "metadata": {"rebuild": "server"}, "adminPass": "***", "imageRef": "}} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:27:34 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:27:34 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:27:34 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:27:34 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:27:34 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:27:34 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:27:34 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:27:34 user devstack@n-api.service[62053]: DEBUG nova.quota [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Getting quotas for project 980559734a504574a83224deb7423c77. Resources: dict_keys(['metadata_items']) {{(pid=62053) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 16:27:34 user devstack@n-api.service[62053]: DEBUG nova.quota [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Getting quotas for user 1b3df1c5c5d441819bcef89ed6966815 and project 980559734a504574a83224deb7423c77. Resources: dict_keys(['metadata_items']) {{(pid=62053) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 16:27:34 user devstack@n-api.service[62053]: DEBUG nova.virt.hardware [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Flavor limits 0:0:0 {{(pid=62053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 16:27:34 user devstack@n-api.service[62053]: DEBUG nova.virt.hardware [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Image limits 0:0:0 {{(pid=62053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 16:27:34 user devstack@n-api.service[62053]: DEBUG nova.virt.hardware [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Flavor pref 0:0:0 {{(pid=62053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 16:27:34 user devstack@n-api.service[62053]: DEBUG nova.virt.hardware [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Image pref 0:0:0 {{(pid=62053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 16:27:34 user devstack@n-api.service[62053]: DEBUG nova.virt.hardware [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 16:27:35 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:27:35 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:27:35 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:27:35 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:27:35 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:27:35 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:27:35 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:27:35 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] 10.0.0.210 "POST /compute/v2.1/servers/acbcaee0-a47b-4fee-8765-9b1c9597d515/action" status: 202 len: 1159 microversion: 2.1 time: 0.365600 Apr 13 16:27:35 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 145/433] 10.0.0.210 () {64 vars in 1356 bytes} [Thu Apr 13 16:27:34 2023] POST /compute/v2.1/servers/acbcaee0-a47b-4fee-8765-9b1c9597d515/action => generated 1159 bytes in 367 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 13 16:27:35 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-661ec815-2bb6-4322-8542-0bfefef977db tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:27:35 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-661ec815-2bb6-4322-8542-0bfefef977db tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:27:35 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-661ec815-2bb6-4322-8542-0bfefef977db tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:27:35 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-661ec815-2bb6-4322-8542-0bfefef977db tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:27:35 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-661ec815-2bb6-4322-8542-0bfefef977db tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:27:35 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-661ec815-2bb6-4322-8542-0bfefef977db tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:27:35 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-661ec815-2bb6-4322-8542-0bfefef977db tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:27:35 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-661ec815-2bb6-4322-8542-0bfefef977db tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:27:35 user devstack@n-api.service[62055]: DEBUG nova.policy [None req-661ec815-2bb6-4322-8542-0bfefef977db tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b3df1c5c5d441819bcef89ed6966815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980559734a504574a83224deb7423c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62055) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:27:35 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-661ec815-2bb6-4322-8542-0bfefef977db tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] 10.0.0.210 "GET /compute/v2.1/servers/acbcaee0-a47b-4fee-8765-9b1c9597d515" status: 200 len: 1732 microversion: 2.1 time: 0.254546 Apr 13 16:27:35 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 143/434] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:27:35 2023] GET /compute/v2.1/servers/acbcaee0-a47b-4fee-8765-9b1c9597d515 => generated 1732 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:27:35 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-a84754a8-e677-4b43-8a8f-22920050986e req-2b679f21-a4ec-42f3-920b-4198ec94944d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acbcaee0-a47b-4fee-8765-9b1c9597d515", "name": "network-vif-unplugged", "status": "completed", "tag": "13471516-9514-4b85-938f-69657c2990e5"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:27:35 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-a84754a8-e677-4b43-8a8f-22920050986e req-2b679f21-a4ec-42f3-920b-4198ec94944d service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:27:35 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-a84754a8-e677-4b43-8a8f-22920050986e req-2b679f21-a4ec-42f3-920b-4198ec94944d service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:27:35 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-a84754a8-e677-4b43-8a8f-22920050986e req-2b679f21-a4ec-42f3-920b-4198ec94944d service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:27:35 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-a84754a8-e677-4b43-8a8f-22920050986e req-2b679f21-a4ec-42f3-920b-4198ec94944d service nova] Creating event network-vif-unplugged:13471516-9514-4b85-938f-69657c2990e5 for instance acbcaee0-a47b-4fee-8765-9b1c9597d515 on user Apr 13 16:27:35 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [req-a84754a8-e677-4b43-8a8f-22920050986e req-2b679f21-a4ec-42f3-920b-4198ec94944d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040742 Apr 13 16:27:35 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 147/435] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:27:35 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:27:36 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-ea05a23e-ccd7-4641-b40f-81be4c24ef83 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:27:36 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-ea05a23e-ccd7-4641-b40f-81be4c24ef83 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:27:36 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-ea05a23e-ccd7-4641-b40f-81be4c24ef83 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:27:36 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-ea05a23e-ccd7-4641-b40f-81be4c24ef83 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:27:36 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-ea05a23e-ccd7-4641-b40f-81be4c24ef83 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:27:36 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-ea05a23e-ccd7-4641-b40f-81be4c24ef83 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:27:36 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-ea05a23e-ccd7-4641-b40f-81be4c24ef83 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:27:36 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-ea05a23e-ccd7-4641-b40f-81be4c24ef83 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:27:36 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-ea05a23e-ccd7-4641-b40f-81be4c24ef83 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bbcccf4b-e861-4254-9be3-a491776214e9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044880 Apr 13 16:27:36 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 146/436] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 16:27:36 2023] GET /compute/v2.1/servers/bbcccf4b-e861-4254-9be3-a491776214e9/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 16:27:37 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [req-14111b02-068e-4353-9f11-f2d64383b954 req-70ece200-9a4f-433c-9e69-8e5a76e58b1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acbcaee0-a47b-4fee-8765-9b1c9597d515", "name": "network-vif-plugged", "status": "completed", "tag": "13471516-9514-4b85-938f-69657c2990e5"}]} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:27:37 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-14111b02-068e-4353-9f11-f2d64383b954 req-70ece200-9a4f-433c-9e69-8e5a76e58b1a service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:27:37 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-14111b02-068e-4353-9f11-f2d64383b954 req-70ece200-9a4f-433c-9e69-8e5a76e58b1a service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:27:37 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-14111b02-068e-4353-9f11-f2d64383b954 req-70ece200-9a4f-433c-9e69-8e5a76e58b1a service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:27:37 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-14111b02-068e-4353-9f11-f2d64383b954 req-70ece200-9a4f-433c-9e69-8e5a76e58b1a service nova] Creating event network-vif-plugged:13471516-9514-4b85-938f-69657c2990e5 for instance acbcaee0-a47b-4fee-8765-9b1c9597d515 on user Apr 13 16:27:37 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [req-14111b02-068e-4353-9f11-f2d64383b954 req-70ece200-9a4f-433c-9e69-8e5a76e58b1a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034522 Apr 13 16:27:37 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 144/437] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:27:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:27:38 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-7b4bc823-4141-4b87-8b81-d3bec5e3b090 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Calling method '.version_select at 0x7f96e4ad80d0>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:27:38 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-7b4bc823-4141-4b87-8b81-d3bec5e3b090 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] 10.0.0.210 "DELETE /compute/v2.1/images/fe56253b-3d7f-43e5-9008-6d9c17385e97" status: 204 len: 0 microversion: 2.1 time: 0.260451 Apr 13 16:27:38 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 148/438] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:27:38 2023] DELETE /compute/v2.1/images/fe56253b-3d7f-43e5-9008-6d9c17385e97 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 16:27:38 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-b45dc4f4-c905-4c9d-867c-6cd83c761081 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:27:38 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-b45dc4f4-c905-4c9d-867c-6cd83c761081 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:27:38 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-b45dc4f4-c905-4c9d-867c-6cd83c761081 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:27:38 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-b45dc4f4-c905-4c9d-867c-6cd83c761081 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:27:38 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-b45dc4f4-c905-4c9d-867c-6cd83c761081 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:27:38 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-b45dc4f4-c905-4c9d-867c-6cd83c761081 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:27:38 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-b45dc4f4-c905-4c9d-867c-6cd83c761081 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:27:38 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-b45dc4f4-c905-4c9d-867c-6cd83c761081 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:27:39 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-b45dc4f4-c905-4c9d-867c-6cd83c761081 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Going to try to terminate instance {{(pid=62053) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 16:27:39 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-b45dc4f4-c905-4c9d-867c-6cd83c761081 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/bbcccf4b-e861-4254-9be3-a491776214e9" status: 204 len: 0 microversion: 2.1 time: 0.133011 Apr 13 16:27:39 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 147/439] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 16:27:38 2023] DELETE /compute/v2.1/servers/bbcccf4b-e861-4254-9be3-a491776214e9 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 16:27:39 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-8f5ca549-bd7c-4682-a43d-5b55cf08acd9 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:27:39 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-8f5ca549-bd7c-4682-a43d-5b55cf08acd9 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:27:39 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-8f5ca549-bd7c-4682-a43d-5b55cf08acd9 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:27:39 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-8f5ca549-bd7c-4682-a43d-5b55cf08acd9 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:27:39 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-8f5ca549-bd7c-4682-a43d-5b55cf08acd9 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:27:39 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-8f5ca549-bd7c-4682-a43d-5b55cf08acd9 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:27:39 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-8f5ca549-bd7c-4682-a43d-5b55cf08acd9 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:27:39 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-8f5ca549-bd7c-4682-a43d-5b55cf08acd9 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:27:39 user devstack@n-api.service[62055]: DEBUG nova.policy [None req-8f5ca549-bd7c-4682-a43d-5b55cf08acd9 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf19848229f45baad45c490cf539508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7061f2f041954ffe90b0c87b422890e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62055) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:27:39 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-8f5ca549-bd7c-4682-a43d-5b55cf08acd9 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bbcccf4b-e861-4254-9be3-a491776214e9" status: 200 len: 1676 microversion: 2.1 time: 0.240037 Apr 13 16:27:39 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 145/440] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:27:39 2023] GET /compute/v2.1/servers/bbcccf4b-e861-4254-9be3-a491776214e9 => generated 1676 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:27:39 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-9c1f2b7e-6110-4e91-96bd-f6432bb7e80e req-e6c7b681-833c-43c6-8542-0d925501fd50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbcccf4b-e861-4254-9be3-a491776214e9", "name": "network-vif-unplugged", "status": "completed", "tag": "dbb2bf27-5de3-499c-ba4d-87867912a143"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:27:39 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-9c1f2b7e-6110-4e91-96bd-f6432bb7e80e req-e6c7b681-833c-43c6-8542-0d925501fd50 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:27:39 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-9c1f2b7e-6110-4e91-96bd-f6432bb7e80e req-e6c7b681-833c-43c6-8542-0d925501fd50 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:27:39 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-9c1f2b7e-6110-4e91-96bd-f6432bb7e80e req-e6c7b681-833c-43c6-8542-0d925501fd50 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:27:39 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-9c1f2b7e-6110-4e91-96bd-f6432bb7e80e req-e6c7b681-833c-43c6-8542-0d925501fd50 service nova] Creating event network-vif-unplugged:dbb2bf27-5de3-499c-ba4d-87867912a143 for instance bbcccf4b-e861-4254-9be3-a491776214e9 on user Apr 13 16:27:39 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [req-9c1f2b7e-6110-4e91-96bd-f6432bb7e80e req-e6c7b681-833c-43c6-8542-0d925501fd50 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036088 Apr 13 16:27:39 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 149/441] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:27:39 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:27:40 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-2735f0d0-05e5-4ada-8f55-34a22bf57327 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Action: 'create', calling method: .version_select at 0x7f96e49d6d40>, body: {"keypair": {"name": "tempest-keypair-1469740557", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAENxxbnK5TO5rrhClGAK4OGBjRSl2WhguyF+uaJMZFTdQImhP15imwNCemvjwOF1cJdEvHpeqOmPATUZWcFezxU2vmY8dwhasInHSqB5TQd2r6SmgLKfFX1fag2EbRN/A=="}} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:27:40 user devstack@n-api.service[62053]: DEBUG nova.quota [None req-2735f0d0-05e5-4ada-8f55-34a22bf57327 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Getting quotas for project 3c33fd5889ce4d0b983f529767005267. Resources: {'key_pairs'} {{(pid=62053) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 16:27:40 user devstack@n-api.service[62053]: DEBUG nova.quota [None req-2735f0d0-05e5-4ada-8f55-34a22bf57327 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Getting quotas for user fa66202e2e5547d1b6e792557b335d0f and project 3c33fd5889ce4d0b983f529767005267. Resources: {'key_pairs'} {{(pid=62053) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 16:27:40 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-2735f0d0-05e5-4ada-8f55-34a22bf57327 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.49 time: 0.056509 Apr 13 16:27:40 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 148/442] 10.0.0.210 () {66 vars in 1277 bytes} [Thu Apr 13 16:27:40 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 58 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 13 16:27:40 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [req-5a55b725-7aea-41e0-8191-22f6eea30879 req-75c44ba9-ef52-4063-9ca4-fc0d21b3a903 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbcccf4b-e861-4254-9be3-a491776214e9", "name": "network-vif-deleted", "tag": "dbb2bf27-5de3-499c-ba4d-87867912a143"}]} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:27:40 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-5a55b725-7aea-41e0-8191-22f6eea30879 req-75c44ba9-ef52-4063-9ca4-fc0d21b3a903 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:27:40 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-5a55b725-7aea-41e0-8191-22f6eea30879 req-75c44ba9-ef52-4063-9ca4-fc0d21b3a903 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:27:40 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-5a55b725-7aea-41e0-8191-22f6eea30879 req-75c44ba9-ef52-4063-9ca4-fc0d21b3a903 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:27:41 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-5a55b725-7aea-41e0-8191-22f6eea30879 req-75c44ba9-ef52-4063-9ca4-fc0d21b3a903 service nova] Creating event network-vif-deleted:dbb2bf27-5de3-499c-ba4d-87867912a143 for instance bbcccf4b-e861-4254-9be3-a491776214e9 on user Apr 13 16:27:41 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [req-5a55b725-7aea-41e0-8191-22f6eea30879 req-75c44ba9-ef52-4063-9ca4-fc0d21b3a903 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062360 Apr 13 16:27:41 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 146/443] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:27:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:27:41 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-435abe30-c6e9-4252-9652-15181fddca9b req-ed3b687f-64a5-4290-bd62-a5ad6edc3567 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbcccf4b-e861-4254-9be3-a491776214e9", "name": "network-vif-plugged", "status": "completed", "tag": "dbb2bf27-5de3-499c-ba4d-87867912a143"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:27:41 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-435abe30-c6e9-4252-9652-15181fddca9b req-ed3b687f-64a5-4290-bd62-a5ad6edc3567 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:27:41 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-435abe30-c6e9-4252-9652-15181fddca9b req-ed3b687f-64a5-4290-bd62-a5ad6edc3567 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:27:41 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-435abe30-c6e9-4252-9652-15181fddca9b req-ed3b687f-64a5-4290-bd62-a5ad6edc3567 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:27:41 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-435abe30-c6e9-4252-9652-15181fddca9b req-ed3b687f-64a5-4290-bd62-a5ad6edc3567 service nova] Creating event network-vif-plugged:dbb2bf27-5de3-499c-ba4d-87867912a143 for instance bbcccf4b-e861-4254-9be3-a491776214e9 on user Apr 13 16:27:41 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [req-435abe30-c6e9-4252-9652-15181fddca9b req-ed3b687f-64a5-4290-bd62-a5ad6edc3567 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044558 Apr 13 16:27:41 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 150/444] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:27:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:27:42 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-33bedf23-5a3c-4c5a-99e0-72c1af3a225e tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-2052401344", "imageRef": "708622a9-7465-4492-ade8-b827198f7e30", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "c790aafd-fad0-4403-bfad-05bbf49d23b2"}], "security_groups": [{"name": "tempest-securitygroup--616840444"}], "key_name": "tempest-keypair-1469740557", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:27:42 user devstack@n-api.service[62053]: DEBUG nova.network.neutron [None req-33bedf23-5a3c-4c5a-99e0-72c1af3a225e tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] validate_networks() for [('c790aafd-fad0-4403-bfad-05bbf49d23b2', None, None, None, None, None)] {{(pid=62053) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 16:27:43 user devstack@n-api.service[62053]: DEBUG nova.virt.hardware [None req-33bedf23-5a3c-4c5a-99e0-72c1af3a225e tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Flavor limits 0:0:0 {{(pid=62053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 16:27:43 user devstack@n-api.service[62053]: DEBUG nova.virt.hardware [None req-33bedf23-5a3c-4c5a-99e0-72c1af3a225e tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Image limits 0:0:0 {{(pid=62053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 16:27:43 user devstack@n-api.service[62053]: DEBUG nova.virt.hardware [None req-33bedf23-5a3c-4c5a-99e0-72c1af3a225e tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Flavor pref 0:0:0 {{(pid=62053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 16:27:43 user devstack@n-api.service[62053]: DEBUG nova.virt.hardware [None req-33bedf23-5a3c-4c5a-99e0-72c1af3a225e tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Image pref 0:0:0 {{(pid=62053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 16:27:43 user devstack@n-api.service[62053]: DEBUG nova.virt.hardware [None req-33bedf23-5a3c-4c5a-99e0-72c1af3a225e tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 16:27:43 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-33bedf23-5a3c-4c5a-99e0-72c1af3a225e tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:27:43 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-33bedf23-5a3c-4c5a-99e0-72c1af3a225e tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:27:43 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-33bedf23-5a3c-4c5a-99e0-72c1af3a225e tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:27:43 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-33bedf23-5a3c-4c5a-99e0-72c1af3a225e tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:27:43 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-33bedf23-5a3c-4c5a-99e0-72c1af3a225e tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:27:43 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-33bedf23-5a3c-4c5a-99e0-72c1af3a225e tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:27:43 user devstack@n-api.service[62053]: DEBUG nova.quota [None req-33bedf23-5a3c-4c5a-99e0-72c1af3a225e tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Getting quotas for project 3c33fd5889ce4d0b983f529767005267. Resources: {'instances', 'cores', 'ram'} {{(pid=62053) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 16:27:43 user devstack@n-api.service[62053]: DEBUG nova.quota [None req-33bedf23-5a3c-4c5a-99e0-72c1af3a225e tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Getting quotas for user fa66202e2e5547d1b6e792557b335d0f and project 3c33fd5889ce4d0b983f529767005267. Resources: {'instances', 'cores', 'ram'} {{(pid=62053) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 16:27:43 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-33bedf23-5a3c-4c5a-99e0-72c1af3a225e tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Going to run 1 instances... {{(pid=62053) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 16:27:43 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-33bedf23-5a3c-4c5a-99e0-72c1af3a225e tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] [instance: 5d50f597-3a29-4335-8166-6ab8e8149376] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='708622a9-7465-4492-ade8-b827198f7e30',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=62053) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 16:27:43 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-33bedf23-5a3c-4c5a-99e0-72c1af3a225e tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.49 time: 0.922652 Apr 13 16:27:43 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 149/445] 10.0.0.210 () {66 vars in 1265 bytes} [Thu Apr 13 16:27:42 2023] POST /compute/v2.1/servers => generated 403 bytes in 924 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 13 16:27:43 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-57a6beb2-8009-4f05-8730-cbd7b30a8c06 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:27:43 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-57a6beb2-8009-4f05-8730-cbd7b30a8c06 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] [instance: 5d50f597-3a29-4335-8166-6ab8e8149376] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:27:43 user devstack@n-api.service[62055]: DEBUG nova.policy [None req-57a6beb2-8009-4f05-8730-cbd7b30a8c06 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa66202e2e5547d1b6e792557b335d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c33fd5889ce4d0b983f529767005267', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62055) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:27:43 user devstack@n-api.service[62055]: DEBUG nova.policy [None req-57a6beb2-8009-4f05-8730-cbd7b30a8c06 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa66202e2e5547d1b6e792557b335d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c33fd5889ce4d0b983f529767005267', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62055) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:27:43 user devstack@n-api.service[62055]: DEBUG nova.policy [None req-57a6beb2-8009-4f05-8730-cbd7b30a8c06 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa66202e2e5547d1b6e792557b335d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c33fd5889ce4d0b983f529767005267', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62055) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:27:43 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-57a6beb2-8009-4f05-8730-cbd7b30a8c06 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5d50f597-3a29-4335-8166-6ab8e8149376" status: 200 len: 1321 microversion: 2.49 time: 0.076677 Apr 13 16:27:43 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 147/446] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 16:27:43 2023] GET /compute/v2.1/servers/5d50f597-3a29-4335-8166-6ab8e8149376 => generated 1321 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 16:27:45 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-426a1811-7f22-4865-bde4-2f0a1cff207b req-1672b3e6-1b30-44e2-9683-e876827cf359 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d50f597-3a29-4335-8166-6ab8e8149376", "tag": "cde3b0f9-9ed1-4eba-8560-d5fa05166b2e"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:27:45 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-426a1811-7f22-4865-bde4-2f0a1cff207b req-1672b3e6-1b30-44e2-9683-e876827cf359 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:27:45 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-426a1811-7f22-4865-bde4-2f0a1cff207b req-1672b3e6-1b30-44e2-9683-e876827cf359 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:27:45 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-426a1811-7f22-4865-bde4-2f0a1cff207b req-1672b3e6-1b30-44e2-9683-e876827cf359 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:27:45 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-426a1811-7f22-4865-bde4-2f0a1cff207b req-1672b3e6-1b30-44e2-9683-e876827cf359 service nova] Creating event network-changed:cde3b0f9-9ed1-4eba-8560-d5fa05166b2e for instance 5d50f597-3a29-4335-8166-6ab8e8149376 on user Apr 13 16:27:45 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [req-426a1811-7f22-4865-bde4-2f0a1cff207b req-1672b3e6-1b30-44e2-9683-e876827cf359 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031017 Apr 13 16:27:45 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 151/447] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:27:45 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:27:46 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-e784c2ad-b07f-4a1a-8354-574d0917ac53 req-9693de78-b9e0-4fb7-af35-e51cc127311e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acbcaee0-a47b-4fee-8765-9b1c9597d515", "name": "network-vif-plugged", "status": "completed", "tag": "13471516-9514-4b85-938f-69657c2990e5"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:27:46 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-e784c2ad-b07f-4a1a-8354-574d0917ac53 req-9693de78-b9e0-4fb7-af35-e51cc127311e service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:27:46 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-e784c2ad-b07f-4a1a-8354-574d0917ac53 req-9693de78-b9e0-4fb7-af35-e51cc127311e service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:27:46 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-e784c2ad-b07f-4a1a-8354-574d0917ac53 req-9693de78-b9e0-4fb7-af35-e51cc127311e service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:27:46 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-e784c2ad-b07f-4a1a-8354-574d0917ac53 req-9693de78-b9e0-4fb7-af35-e51cc127311e service nova] Creating event network-vif-plugged:13471516-9514-4b85-938f-69657c2990e5 for instance acbcaee0-a47b-4fee-8765-9b1c9597d515 on user Apr 13 16:27:46 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [req-e784c2ad-b07f-4a1a-8354-574d0917ac53 req-9693de78-b9e0-4fb7-af35-e51cc127311e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040200 Apr 13 16:27:46 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 150/448] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:27:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:27:47 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-f4961bb0-28eb-43e4-b53e-8b0e9b676339 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:27:47 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-f4961bb0-28eb-43e4-b53e-8b0e9b676339 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] [instance: 902e4077-e0d6-4b61-a861-883be253f1e0] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:27:47 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-f4961bb0-28eb-43e4-b53e-8b0e9b676339 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:27:47 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-f4961bb0-28eb-43e4-b53e-8b0e9b676339 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:27:47 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-f4961bb0-28eb-43e4-b53e-8b0e9b676339 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:27:47 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-f4961bb0-28eb-43e4-b53e-8b0e9b676339 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:27:47 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-f4961bb0-28eb-43e4-b53e-8b0e9b676339 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:27:47 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-f4961bb0-28eb-43e4-b53e-8b0e9b676339 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:27:47 user devstack@n-api.service[62055]: INFO nova.api.openstack.wsgi [None req-f4961bb0-28eb-43e4-b53e-8b0e9b676339 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] HTTP exception thrown: Instance 902e4077-e0d6-4b61-a861-883be253f1e0 could not be found. Apr 13 16:27:47 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-f4961bb0-28eb-43e4-b53e-8b0e9b676339 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Request method failure captured: Apr 13 16:27:47 user devstack@n-api.service[62055]: request: GET /compute/v2.1/servers/902e4077-e0d6-4b61-a861-883be253f1e0 HTTP/1.1 Apr 13 16:27:47 user devstack@n-api.service[62055]: Accept: application/json Apr 13 16:27:47 user devstack@n-api.service[62055]: Accept-Encoding: identity Apr 13 16:27:47 user devstack@n-api.service[62055]: Connection: close Apr 13 16:27:47 user devstack@n-api.service[62055]: Content-Length: 0 Apr 13 16:27:47 user devstack@n-api.service[62055]: Content-Type: application/json Apr 13 16:27:47 user devstack@n-api.service[62055]: Host: 10.0.0.210 Apr 13 16:27:47 user devstack@n-api.service[62055]: Openstack-System-Scope: None Apr 13 16:27:47 user devstack@n-api.service[62055]: User-Agent: python-urllib3/1.26.15 Apr 13 16:27:47 user devstack@n-api.service[62055]: X-Auth-Token: gAAAAABkOCwICdOYUNMq2XTmp7fPKYYIL47DO4DENTPMQgSht1dTIG82lfhuFgnIu6iB7daPqHja3Py6WVNbrBjN3hDOqRAAzSqG19kmoaiRDqbakCSeoYbYikmNwRUJ98ykgNk0e17tG9DgLJTrzwzEBheVJvyMaVu4E8WtXpnuwa8gWkFLrhA Apr 13 16:27:47 user devstack@n-api.service[62055]: X-Domain-Id: None Apr 13 16:27:47 user devstack@n-api.service[62055]: X-Domain-Name: None Apr 13 16:27:47 user devstack@n-api.service[62055]: X-Identity-Status: Confirmed Apr 13 16:27:47 user devstack@n-api.service[62055]: X-Is-Admin-Project: True Apr 13 16:27:47 user devstack@n-api.service[62055]: X-Project-Domain-Id: default Apr 13 16:27:47 user devstack@n-api.service[62055]: X-Project-Domain-Name: Default Apr 13 16:27:47 user devstack@n-api.service[62055]: X-Project-Id: e7395d2408a44cc88cf88eb49d5f8503 Apr 13 16:27:47 user devstack@n-api.service[62055]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1985397600 Apr 13 16:27:47 user devstack@n-api.service[62055]: X-Role: reader,member Apr 13 16:27:47 user devstack@n-api.service[62055]: X-Roles: reader,member Apr 13 16:27:47 user devstack@n-api.service[62055]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e7395d2408a44cc88cf88eb49d5f8503"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e7395d2408a44cc88cf88eb49d5f8503"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e7395d2408a44cc88cf88eb49d5f8503"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 13 16:27:47 user devstack@n-api.service[62055]: X-Tenant: tempest-VolumesSnapshotTestJSON-1985397600 Apr 13 16:27:47 user devstack@n-api.service[62055]: X-Tenant-Id: e7395d2408a44cc88cf88eb49d5f8503 Apr 13 16:27:47 user devstack@n-api.service[62055]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1985397600 Apr 13 16:27:47 user devstack@n-api.service[62055]: X-User: tempest-VolumesSnapshotTestJSON-1985397600-project-member Apr 13 16:27:47 user devstack@n-api.service[62055]: X-User-Domain-Id: default Apr 13 16:27:47 user devstack@n-api.service[62055]: X-User-Domain-Name: Default Apr 13 16:27:47 user devstack@n-api.service[62055]: X-User-Id: 9223a3efe4bc4e37946c8ed718100de4 Apr 13 16:27:47 user devstack@n-api.service[62055]: X-User-Name: tempest-VolumesSnapshotTestJSON-1985397600-project-member Apr 13 16:27:47 user devstack@n-api.service[62055]: method: > Apr 13 16:27:47 user devstack@n-api.service[62055]: exception: Instance 902e4077-e0d6-4b61-a861-883be253f1e0 could not be found. Apr 13 16:27:47 user devstack@n-api.service[62055]: action_args: {'id': '902e4077-e0d6-4b61-a861-883be253f1e0'} Apr 13 16:27:47 user devstack@n-api.service[62055]: {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 16:27:47 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:27:47 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 16:27:47 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 16:27:47 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 16:27:47 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 16:27:47 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 16:27:47 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 16:27:47 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 16:27:47 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 16:27:47 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 902e4077-e0d6-4b61-a861-883be253f1e0 could not be found. Apr 13 16:27:47 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:27:47 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:27:47 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:27:47 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:27:47 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 16:27:47 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 16:27:47 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 16:27:47 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 16:27:47 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 16:27:47 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 16:27:47 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 16:27:47 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 16:27:47 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 16:27:47 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 16:27:47 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 16:27:47 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 16:27:47 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 902e4077-e0d6-4b61-a861-883be253f1e0 could not be found. Apr 13 16:27:47 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:27:47 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:27:47 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:27:47 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:27:47 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 16:27:47 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 16:27:47 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 16:27:47 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 16:27:47 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 902e4077-e0d6-4b61-a861-883be253f1e0 could not be found. Apr 13 16:27:47 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:27:47 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-f4961bb0-28eb-43e4-b53e-8b0e9b676339 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Returning 404 to user: Instance 902e4077-e0d6-4b61-a861-883be253f1e0 could not be found. {{(pid=62055) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 16:27:47 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-f4961bb0-28eb-43e4-b53e-8b0e9b676339 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] 10.0.0.210 "GET /compute/v2.1/servers/902e4077-e0d6-4b61-a861-883be253f1e0" status: 404 len: 111 microversion: 2.1 time: 0.031281 Apr 13 16:27:47 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 148/449] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:27:47 2023] GET /compute/v2.1/servers/902e4077-e0d6-4b61-a861-883be253f1e0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 16:27:47 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-5cfe01a5-2bc0-4522-a9f9-26a39d17b718 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:27:47 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-5cfe01a5-2bc0-4522-a9f9-26a39d17b718 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:27:47 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-5cfe01a5-2bc0-4522-a9f9-26a39d17b718 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:27:47 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-5cfe01a5-2bc0-4522-a9f9-26a39d17b718 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:27:47 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-5cfe01a5-2bc0-4522-a9f9-26a39d17b718 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:27:47 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-5cfe01a5-2bc0-4522-a9f9-26a39d17b718 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:27:47 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-5cfe01a5-2bc0-4522-a9f9-26a39d17b718 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:27:47 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-5cfe01a5-2bc0-4522-a9f9-26a39d17b718 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:27:47 user devstack@n-api.service[62054]: DEBUG nova.policy [None req-5cfe01a5-2bc0-4522-a9f9-26a39d17b718 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45a882dbafb4ea4976e4f45289eb2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d09a74bf684a9fb1dd1e95d6c23f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62054) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:27:47 user devstack@n-api.service[62054]: DEBUG nova.policy [None req-5cfe01a5-2bc0-4522-a9f9-26a39d17b718 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e45a882dbafb4ea4976e4f45289eb2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d09a74bf684a9fb1dd1e95d6c23f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62054) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:27:47 user devstack@n-api.service[62054]: DEBUG nova.policy [None req-5cfe01a5-2bc0-4522-a9f9-26a39d17b718 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e45a882dbafb4ea4976e4f45289eb2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d09a74bf684a9fb1dd1e95d6c23f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62054) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:27:47 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-5cfe01a5-2bc0-4522-a9f9-26a39d17b718 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] 10.0.0.210 "GET /compute/v2.1/servers/235f827c-7116-48e9-84c5-0c9761c18e1e" status: 200 len: 1769 microversion: 2.87 time: 0.198474 Apr 13 16:27:47 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 152/450] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 16:27:47 2023] GET /compute/v2.1/servers/235f827c-7116-48e9-84c5-0c9761c18e1e => generated 1769 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 16:27:48 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-7be02b1c-b0ab-42ff-b325-de137465a73c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:27:48 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-7be02b1c-b0ab-42ff-b325-de137465a73c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 0f52d9e3-921c-4f79-9cdb-7d73500c8c35] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:27:48 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-7be02b1c-b0ab-42ff-b325-de137465a73c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:27:48 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-7be02b1c-b0ab-42ff-b325-de137465a73c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:27:48 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-7be02b1c-b0ab-42ff-b325-de137465a73c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:27:48 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-7be02b1c-b0ab-42ff-b325-de137465a73c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:27:48 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-7be02b1c-b0ab-42ff-b325-de137465a73c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:27:48 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-7be02b1c-b0ab-42ff-b325-de137465a73c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:27:48 user devstack@n-api.service[62053]: DEBUG nova.policy [None req-7be02b1c-b0ab-42ff-b325-de137465a73c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e10f63cdd49a9a1ebe1fe4c9de0a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d451e0e239f486aa2b3abe9e273eab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62053) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:27:48 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-7be02b1c-b0ab-42ff-b325-de137465a73c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0f52d9e3-921c-4f79-9cdb-7d73500c8c35" status: 200 len: 1550 microversion: 2.1 time: 0.178186 Apr 13 16:27:48 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 151/451] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:27:48 2023] GET /compute/v2.1/servers/0f52d9e3-921c-4f79-9cdb-7d73500c8c35 => generated 1550 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:27:48 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [req-71f61b74-8b1d-4d6b-888f-a0b394c9bb62 req-96870251-80ac-46df-8b79-77686bad87a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acbcaee0-a47b-4fee-8765-9b1c9597d515", "name": "network-vif-plugged", "status": "completed", "tag": "13471516-9514-4b85-938f-69657c2990e5"}, {"server_uuid": "5d50f597-3a29-4335-8166-6ab8e8149376", "name": "network-vif-plugged", "status": "completed", "tag": "cde3b0f9-9ed1-4eba-8560-d5fa05166b2e"}, {"server_uuid": "5d50f597-3a29-4335-8166-6ab8e8149376", "name": "network-vif-plugged", "status": "completed", "tag": "cde3b0f9-9ed1-4eba-8560-d5fa05166b2e"}]} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:27:48 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-71f61b74-8b1d-4d6b-888f-a0b394c9bb62 req-96870251-80ac-46df-8b79-77686bad87a5 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:27:48 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-71f61b74-8b1d-4d6b-888f-a0b394c9bb62 req-96870251-80ac-46df-8b79-77686bad87a5 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:27:48 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-71f61b74-8b1d-4d6b-888f-a0b394c9bb62 req-96870251-80ac-46df-8b79-77686bad87a5 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:27:48 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-71f61b74-8b1d-4d6b-888f-a0b394c9bb62 req-96870251-80ac-46df-8b79-77686bad87a5 service nova] Creating event network-vif-plugged:13471516-9514-4b85-938f-69657c2990e5 for instance acbcaee0-a47b-4fee-8765-9b1c9597d515 on user Apr 13 16:27:48 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-71f61b74-8b1d-4d6b-888f-a0b394c9bb62 req-96870251-80ac-46df-8b79-77686bad87a5 service nova] Creating event network-vif-plugged:cde3b0f9-9ed1-4eba-8560-d5fa05166b2e for instance 5d50f597-3a29-4335-8166-6ab8e8149376 on user Apr 13 16:27:48 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-71f61b74-8b1d-4d6b-888f-a0b394c9bb62 req-96870251-80ac-46df-8b79-77686bad87a5 service nova] Creating event network-vif-plugged:cde3b0f9-9ed1-4eba-8560-d5fa05166b2e for instance 5d50f597-3a29-4335-8166-6ab8e8149376 on user Apr 13 16:27:48 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [req-71f61b74-8b1d-4d6b-888f-a0b394c9bb62 req-96870251-80ac-46df-8b79-77686bad87a5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.046209 Apr 13 16:27:48 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 149/452] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:27:48 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:27:52 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-29777d48-28c0-4935-8f7a-17a41db45c1f tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-507236045", "imageRef": "708622a9-7465-4492-ade8-b827198f7e30", "flavorRef": "42", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "708622a9-7465-4492-ade8-b827198f7e30", "destination_type": "local"}, {"source_type": "volume", "uuid": "376ba3fb-a85a-42bf-8e2d-d3afad2c3178", "destination_type": "invalid"}], "networks": [{"uuid": "ae7f770e-a460-4297-91b5-ed0b908a895a"}]}} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:27:52 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-29777d48-28c0-4935-8f7a-17a41db45c1f tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Request method failure captured: Apr 13 16:27:52 user devstack@n-api.service[62054]: request: POST /compute/v2.1/servers HTTP/1.1 Apr 13 16:27:52 user devstack@n-api.service[62054]: Accept: application/json Apr 13 16:27:52 user devstack@n-api.service[62054]: Accept-Encoding: identity Apr 13 16:27:52 user devstack@n-api.service[62054]: Connection: close Apr 13 16:27:52 user devstack@n-api.service[62054]: Content-Length: 493 Apr 13 16:27:52 user devstack@n-api.service[62054]: Content-Type: application/json Apr 13 16:27:52 user devstack@n-api.service[62054]: Host: 10.0.0.210 Apr 13 16:27:52 user devstack@n-api.service[62054]: Openstack-System-Scope: None Apr 13 16:27:52 user devstack@n-api.service[62054]: User-Agent: python-urllib3/1.26.15 Apr 13 16:27:52 user devstack@n-api.service[62054]: X-Auth-Token: gAAAAABkOCu7xvmudBrBXBLs2SCBDcK71oPknaVoa5c212HJ1YH5D1qqQ770FnyyQ769HR4gN3MWc8D4DgjQEtN69nkpO07yNpJgb9N95gGXJDJugJy1OfGoQrI6zjE_4e0z9MJFRRuCNbIXu0Si5G6jJIciNJHiNV9wx9koSjgJs77kT-szNSc Apr 13 16:27:52 user devstack@n-api.service[62054]: X-Domain-Id: None Apr 13 16:27:52 user devstack@n-api.service[62054]: X-Domain-Name: None Apr 13 16:27:52 user devstack@n-api.service[62054]: X-Identity-Status: Confirmed Apr 13 16:27:52 user devstack@n-api.service[62054]: X-Is-Admin-Project: True Apr 13 16:27:52 user devstack@n-api.service[62054]: X-Project-Domain-Id: default Apr 13 16:27:52 user devstack@n-api.service[62054]: X-Project-Domain-Name: Default Apr 13 16:27:52 user devstack@n-api.service[62054]: X-Project-Id: 5554aa7f1b4d471b8807a845ab1ea33f Apr 13 16:27:52 user devstack@n-api.service[62054]: X-Project-Name: tempest-ServersNegativeTestJSON-1820659348 Apr 13 16:27:52 user devstack@n-api.service[62054]: X-Role: reader,member Apr 13 16:27:52 user devstack@n-api.service[62054]: X-Roles: reader,member Apr 13 16:27:52 user devstack@n-api.service[62054]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5554aa7f1b4d471b8807a845ab1ea33f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5554aa7f1b4d471b8807a845ab1ea33f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5554aa7f1b4d471b8807a845ab1ea33f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 13 16:27:52 user devstack@n-api.service[62054]: X-Tenant: tempest-ServersNegativeTestJSON-1820659348 Apr 13 16:27:52 user devstack@n-api.service[62054]: X-Tenant-Id: 5554aa7f1b4d471b8807a845ab1ea33f Apr 13 16:27:52 user devstack@n-api.service[62054]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1820659348 Apr 13 16:27:52 user devstack@n-api.service[62054]: X-User: tempest-ServersNegativeTestJSON-1820659348-project-member Apr 13 16:27:52 user devstack@n-api.service[62054]: X-User-Domain-Id: default Apr 13 16:27:52 user devstack@n-api.service[62054]: X-User-Domain-Name: Default Apr 13 16:27:52 user devstack@n-api.service[62054]: X-User-Id: 4ddd547d240b43ccb213e9d459082309 Apr 13 16:27:52 user devstack@n-api.service[62054]: X-User-Name: tempest-ServersNegativeTestJSON-1820659348-project-member Apr 13 16:27:52 user devstack@n-api.service[62054]: Apr 13 16:27:52 user devstack@n-api.service[62054]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-507236045", "imageRef": "708622a9-7465-4492-ade8-b827198f7e30", "flavorRef": "42", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "708622a9-7465-4492-ade8-b827198f7e30", "destination_type": "local"}, {"source_type": "volume", "uuid": "376ba3fb-a85a-42bf-8e2d-d3afad2c3178", "destination_type": "invalid"}], "networks": [{"uuid": "ae7f770e-a460-4297-91b5-ed0b908a895a"}]}} Apr 13 16:27:52 user devstack@n-api.service[62054]: method: > Apr 13 16:27:52 user devstack@n-api.service[62054]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Apr 13 16:27:52 user devstack@n-api.service[62054]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-507236045', 'imageRef': '708622a9-7465-4492-ade8-b827198f7e30', 'flavorRef': '42', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': '708622a9-7465-4492-ade8-b827198f7e30', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': '376ba3fb-a85a-42bf-8e2d-d3afad2c3178', 'destination_type': 'invalid'}], 'networks': [{'uuid': 'ae7f770e-a460-4297-91b5-ed0b908a895a'}]}}} Apr 13 16:27:52 user devstack@n-api.service[62054]: {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 16:27:52 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:27:52 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 13 16:27:52 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 13 16:27:52 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 13 16:27:52 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi raise error Apr 13 16:27:52 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Apr 13 16:27:52 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:27:52 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Apr 13 16:27:52 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Apr 13 16:27:52 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:27:52 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Apr 13 16:27:52 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi 'invalid' Apr 13 16:27:52 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:27:52 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:27:52 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:27:52 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:27:52 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 16:27:52 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 16:27:52 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 16:27:52 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 16:27:52 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 16:27:52 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 16:27:52 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 13 16:27:52 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 16:27:52 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 13 16:27:52 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 13 16:27:52 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 13 16:27:52 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 13 16:27:52 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 13 16:27:52 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 13 16:27:52 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Apr 13 16:27:52 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:27:52 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:27:52 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:27:52 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:27:52 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 16:27:52 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 16:27:52 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 13 16:27:52 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 13 16:27:52 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Apr 13 16:27:52 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:27:52 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-29777d48-28c0-4935-8f7a-17a41db45c1f tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=62054) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 16:27:52 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-29777d48-28c0-4935-8f7a-17a41db45c1f tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.029572 Apr 13 16:27:52 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 153/453] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 16:27:52 2023] POST /compute/v2.1/servers => generated 155 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 13 16:27:52 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-def798ac-7192-40f6-a5eb-d7881a37ce0a tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:27:52 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-def798ac-7192-40f6-a5eb-d7881a37ce0a tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] [instance: 7973e93b-6311-44ed-91ff-e861c32d0277] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:27:52 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-def798ac-7192-40f6-a5eb-d7881a37ce0a tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:27:52 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-def798ac-7192-40f6-a5eb-d7881a37ce0a tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:27:52 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-def798ac-7192-40f6-a5eb-d7881a37ce0a tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:27:52 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-def798ac-7192-40f6-a5eb-d7881a37ce0a tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:27:52 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-def798ac-7192-40f6-a5eb-d7881a37ce0a tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:27:52 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-def798ac-7192-40f6-a5eb-d7881a37ce0a tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:27:52 user devstack@n-api.service[62053]: DEBUG nova.policy [None req-def798ac-7192-40f6-a5eb-d7881a37ce0a tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ddd547d240b43ccb213e9d459082309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5554aa7f1b4d471b8807a845ab1ea33f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62053) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:27:52 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-def798ac-7192-40f6-a5eb-d7881a37ce0a tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7973e93b-6311-44ed-91ff-e861c32d0277" status: 200 len: 1493 microversion: 2.1 time: 0.157957 Apr 13 16:27:52 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 152/454] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:27:52 2023] GET /compute/v2.1/servers/7973e93b-6311-44ed-91ff-e861c32d0277 => generated 1493 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:28:02 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_cell0:SELECT=2 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:28:02 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_api:SELECT=18 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:28:02 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:28:02 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-8a002c6b-8094-4c00-a7ae-cef92e2bed07 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:28:02 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-8a002c6b-8094-4c00-a7ae-cef92e2bed07 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:28:02 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-8a002c6b-8094-4c00-a7ae-cef92e2bed07 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:28:02 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-8a002c6b-8094-4c00-a7ae-cef92e2bed07 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:28:02 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-8a002c6b-8094-4c00-a7ae-cef92e2bed07 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:28:02 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-8a002c6b-8094-4c00-a7ae-cef92e2bed07 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:28:02 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-8a002c6b-8094-4c00-a7ae-cef92e2bed07 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:28:02 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-8a002c6b-8094-4c00-a7ae-cef92e2bed07 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:28:02 user devstack@n-api.service[62055]: INFO nova.api.openstack.wsgi [None req-8a002c6b-8094-4c00-a7ae-cef92e2bed07 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] HTTP exception thrown: Instance bf350da4-9cc2-4900-adf0-506e44984b42 could not be found. Apr 13 16:28:02 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-8a002c6b-8094-4c00-a7ae-cef92e2bed07 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Request method failure captured: Apr 13 16:28:02 user devstack@n-api.service[62055]: request: GET /compute/v2.1/servers/bf350da4-9cc2-4900-adf0-506e44984b42 HTTP/1.1 Apr 13 16:28:02 user devstack@n-api.service[62055]: Accept: application/json Apr 13 16:28:02 user devstack@n-api.service[62055]: Accept-Encoding: identity Apr 13 16:28:02 user devstack@n-api.service[62055]: Connection: close Apr 13 16:28:02 user devstack@n-api.service[62055]: Content-Length: 0 Apr 13 16:28:02 user devstack@n-api.service[62055]: Content-Type: application/json Apr 13 16:28:02 user devstack@n-api.service[62055]: Host: 10.0.0.210 Apr 13 16:28:02 user devstack@n-api.service[62055]: Openstack-System-Scope: None Apr 13 16:28:02 user devstack@n-api.service[62055]: User-Agent: python-urllib3/1.26.15 Apr 13 16:28:02 user devstack@n-api.service[62055]: X-Auth-Token: gAAAAABkOCwBiyMc_SKBoSGiZ6nv2YO-5nfH9rrtzFIbtHV5cDsDsi3zwwMjx2zDbxaIWs9QD5xBU-s_ujUz08KNS_xA-6v0qCjzlYPcqPnACF_JeOSJeFxkW77yVCUiVdp0HxH6ua50LdZXRaUmA2oCnJ34BTReInwuN4FyqpUNqn4CKvKp5y0 Apr 13 16:28:02 user devstack@n-api.service[62055]: X-Domain-Id: None Apr 13 16:28:02 user devstack@n-api.service[62055]: X-Domain-Name: None Apr 13 16:28:02 user devstack@n-api.service[62055]: X-Identity-Status: Confirmed Apr 13 16:28:02 user devstack@n-api.service[62055]: X-Is-Admin-Project: True Apr 13 16:28:02 user devstack@n-api.service[62055]: X-Project-Domain-Id: default Apr 13 16:28:02 user devstack@n-api.service[62055]: X-Project-Domain-Name: Default Apr 13 16:28:02 user devstack@n-api.service[62055]: X-Project-Id: ed94fa5d89c2486b8e2951e608e6630f Apr 13 16:28:02 user devstack@n-api.service[62055]: X-Project-Name: tempest-TestShelveInstance-1159741724 Apr 13 16:28:02 user devstack@n-api.service[62055]: X-Role: reader,member Apr 13 16:28:02 user devstack@n-api.service[62055]: X-Roles: reader,member Apr 13 16:28:02 user devstack@n-api.service[62055]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ed94fa5d89c2486b8e2951e608e6630f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ed94fa5d89c2486b8e2951e608e6630f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ed94fa5d89c2486b8e2951e608e6630f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 13 16:28:02 user devstack@n-api.service[62055]: X-Tenant: tempest-TestShelveInstance-1159741724 Apr 13 16:28:02 user devstack@n-api.service[62055]: X-Tenant-Id: ed94fa5d89c2486b8e2951e608e6630f Apr 13 16:28:02 user devstack@n-api.service[62055]: X-Tenant-Name: tempest-TestShelveInstance-1159741724 Apr 13 16:28:02 user devstack@n-api.service[62055]: X-User: tempest-TestShelveInstance-1159741724-project-member Apr 13 16:28:02 user devstack@n-api.service[62055]: X-User-Domain-Id: default Apr 13 16:28:02 user devstack@n-api.service[62055]: X-User-Domain-Name: Default Apr 13 16:28:02 user devstack@n-api.service[62055]: X-User-Id: fe6a4bf1a7794af2958c3d53ea1e19c6 Apr 13 16:28:02 user devstack@n-api.service[62055]: X-User-Name: tempest-TestShelveInstance-1159741724-project-member Apr 13 16:28:02 user devstack@n-api.service[62055]: method: > Apr 13 16:28:02 user devstack@n-api.service[62055]: exception: Instance bf350da4-9cc2-4900-adf0-506e44984b42 could not be found. Apr 13 16:28:02 user devstack@n-api.service[62055]: action_args: {'id': 'bf350da4-9cc2-4900-adf0-506e44984b42'} Apr 13 16:28:02 user devstack@n-api.service[62055]: {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 16:28:02 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:28:02 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 16:28:02 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 16:28:02 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 16:28:02 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 16:28:02 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 16:28:02 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 16:28:02 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 16:28:02 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 16:28:02 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf350da4-9cc2-4900-adf0-506e44984b42 could not be found. Apr 13 16:28:02 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:28:02 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:28:02 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:28:02 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:28:02 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 16:28:02 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 16:28:02 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 16:28:02 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 16:28:02 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 16:28:02 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 16:28:02 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 16:28:02 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 16:28:02 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 16:28:02 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 16:28:02 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 16:28:02 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 16:28:02 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf350da4-9cc2-4900-adf0-506e44984b42 could not be found. Apr 13 16:28:02 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:28:02 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:28:02 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:28:02 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:28:02 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 16:28:02 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 16:28:02 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 16:28:02 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 16:28:02 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf350da4-9cc2-4900-adf0-506e44984b42 could not be found. Apr 13 16:28:02 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:28:02 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-8a002c6b-8094-4c00-a7ae-cef92e2bed07 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Returning 404 to user: Instance bf350da4-9cc2-4900-adf0-506e44984b42 could not be found. {{(pid=62055) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 16:28:02 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-8a002c6b-8094-4c00-a7ae-cef92e2bed07 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bf350da4-9cc2-4900-adf0-506e44984b42" status: 404 len: 111 microversion: 2.1 time: 0.038663 Apr 13 16:28:02 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 150/455] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:28:02 2023] GET /compute/v2.1/servers/bf350da4-9cc2-4900-adf0-506e44984b42 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 16:28:03 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_cell1:SELECT=20 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:28:03 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_api:SELECT=14 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:28:03 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-79fb2cdc-59a2-4594-949f-7a75070112f3 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Calling method '.version_select at 0x7f96e4ab53f0>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:28:03 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-79fb2cdc-59a2-4594-949f-7a75070112f3 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2029240993" status: 202 len: 0 microversion: 2.1 time: 0.031729 Apr 13 16:28:03 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 154/456] 10.0.0.210 () {62 vars in 1331 bytes} [Thu Apr 13 16:28:03 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2029240993 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 16:28:03 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-5c366176-05bf-425c-9dc3-7ec1952fdbb0 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:28:03 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_cell0:SELECT=2 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:28:03 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_cell0:SELECT=10 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:28:04 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:28:04 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=6,nova_cell1:INSERT=3,nova_cell1:DELETE=1 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:28:04 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-5c366176-05bf-425c-9dc3-7ec1952fdbb0 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:28:04 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-5c366176-05bf-425c-9dc3-7ec1952fdbb0 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:28:04 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-5c366176-05bf-425c-9dc3-7ec1952fdbb0 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:28:04 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-5c366176-05bf-425c-9dc3-7ec1952fdbb0 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Going to try to start instance {{(pid=62053) start /opt/stack/nova/nova/compute/api.py:2787}} Apr 13 16:28:04 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-5c366176-05bf-425c-9dc3-7ec1952fdbb0 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] 10.0.0.210 "POST /compute/v2.1/servers/eaae47b9-a059-49f6-9ae6-d7147003e2f2/action" status: 202 len: 0 microversion: 2.1 time: 0.091099 Apr 13 16:28:04 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 153/457] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 16:28:03 2023] POST /compute/v2.1/servers/eaae47b9-a059-49f6-9ae6-d7147003e2f2/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 16:28:04 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-e08b76d2-a96e-4941-9de7-e592bef3b0d7 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:28:04 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-e08b76d2-a96e-4941-9de7-e592bef3b0d7 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:28:04 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-e08b76d2-a96e-4941-9de7-e592bef3b0d7 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:28:04 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-e08b76d2-a96e-4941-9de7-e592bef3b0d7 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:28:04 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-e08b76d2-a96e-4941-9de7-e592bef3b0d7 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:28:04 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-e08b76d2-a96e-4941-9de7-e592bef3b0d7 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:28:04 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-e08b76d2-a96e-4941-9de7-e592bef3b0d7 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:28:04 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-e08b76d2-a96e-4941-9de7-e592bef3b0d7 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:28:04 user devstack@n-api.service[62055]: DEBUG nova.policy [None req-e08b76d2-a96e-4941-9de7-e592bef3b0d7 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fab402fb794a5a9281cfb7fe188813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24904988cf334657b084fd726c7ecf8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62055) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:28:04 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-e08b76d2-a96e-4941-9de7-e592bef3b0d7 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eaae47b9-a059-49f6-9ae6-d7147003e2f2" status: 200 len: 1698 microversion: 2.1 time: 0.609312 Apr 13 16:28:04 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 151/458] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:28:04 2023] GET /compute/v2.1/servers/eaae47b9-a059-49f6-9ae6-d7147003e2f2 => generated 1698 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:28:08 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-2e76b57f-8030-4762-801d-0b680d7c5900 req-87bdc26a-8840-45e0-8f66-3c9cc9c91979 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eaae47b9-a059-49f6-9ae6-d7147003e2f2", "name": "network-vif-plugged", "status": "completed", "tag": "e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:28:08 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-2e76b57f-8030-4762-801d-0b680d7c5900 req-87bdc26a-8840-45e0-8f66-3c9cc9c91979 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:28:08 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-2e76b57f-8030-4762-801d-0b680d7c5900 req-87bdc26a-8840-45e0-8f66-3c9cc9c91979 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:28:09 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-2e76b57f-8030-4762-801d-0b680d7c5900 req-87bdc26a-8840-45e0-8f66-3c9cc9c91979 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:28:09 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-2e76b57f-8030-4762-801d-0b680d7c5900 req-87bdc26a-8840-45e0-8f66-3c9cc9c91979 service nova] Creating event network-vif-plugged:e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae for instance eaae47b9-a059-49f6-9ae6-d7147003e2f2 on user Apr 13 16:28:09 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [req-2e76b57f-8030-4762-801d-0b680d7c5900 req-87bdc26a-8840-45e0-8f66-3c9cc9c91979 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051243 Apr 13 16:28:09 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 155/459] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:28:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:28:11 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-09aaedfc-f30a-4d46-a722-7dd655f9b0fd req-bee1afec-575a-4c8d-9880-ed016b8cc870 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eaae47b9-a059-49f6-9ae6-d7147003e2f2", "name": "network-vif-plugged", "status": "completed", "tag": "e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:28:11 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-09aaedfc-f30a-4d46-a722-7dd655f9b0fd req-bee1afec-575a-4c8d-9880-ed016b8cc870 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:28:11 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-09aaedfc-f30a-4d46-a722-7dd655f9b0fd req-bee1afec-575a-4c8d-9880-ed016b8cc870 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:28:11 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-09aaedfc-f30a-4d46-a722-7dd655f9b0fd req-bee1afec-575a-4c8d-9880-ed016b8cc870 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:28:11 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-09aaedfc-f30a-4d46-a722-7dd655f9b0fd req-bee1afec-575a-4c8d-9880-ed016b8cc870 service nova] Creating event network-vif-plugged:e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae for instance eaae47b9-a059-49f6-9ae6-d7147003e2f2 on user Apr 13 16:28:11 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [req-09aaedfc-f30a-4d46-a722-7dd655f9b0fd req-bee1afec-575a-4c8d-9880-ed016b8cc870 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034003 Apr 13 16:28:11 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 154/460] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:28:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:28:25 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-45ec2948-c0fa-4607-887a-f33eac90e1d0 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:28:25 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-45ec2948-c0fa-4607-887a-f33eac90e1d0 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:28:25 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_api:SELECT=4 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:28:25 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_cell1:SELECT=8 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:28:25 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-45ec2948-c0fa-4607-887a-f33eac90e1d0 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:28:25 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-45ec2948-c0fa-4607-887a-f33eac90e1d0 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:28:25 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-45ec2948-c0fa-4607-887a-f33eac90e1d0 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:28:25 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-45ec2948-c0fa-4607-887a-f33eac90e1d0 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:28:25 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-45ec2948-c0fa-4607-887a-f33eac90e1d0 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:28:25 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-45ec2948-c0fa-4607-887a-f33eac90e1d0 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:28:25 user devstack@n-api.service[62055]: DEBUG nova.policy [None req-45ec2948-c0fa-4607-887a-f33eac90e1d0 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b3df1c5c5d441819bcef89ed6966815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980559734a504574a83224deb7423c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62055) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:28:25 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-45ec2948-c0fa-4607-887a-f33eac90e1d0 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] 10.0.0.210 "GET /compute/v2.1/servers/acbcaee0-a47b-4fee-8765-9b1c9597d515" status: 200 len: 1723 microversion: 2.1 time: 0.224927 Apr 13 16:28:25 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 152/461] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:28:25 2023] GET /compute/v2.1/servers/acbcaee0-a47b-4fee-8765-9b1c9597d515 => generated 1723 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:28:25 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_api:SELECT=5,nova_api:DELETE=1 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:28:25 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_cell1:SELECT=2 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:28:26 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-93c14154-953e-4a68-bc4c-f46f9d7c4bd8 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Action: 'create', calling method: .version_select at 0x7f96e49e7c70>, body: {"keypair": {"name": "tempest-SnapshotDataIntegrityTests-1768467450", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEWcfNxtsSrfqvopYusd+ZqI4KzA2ovArHxBPlxsew7LRP1txsdXHUeRRgEYzHNePmj25ZAs3NfqqgPBjo6KvTsbCCUknJjbmiyMs1ESu45VRGnYpt2phiwqtYQaA1tsdA=="}} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:28:26 user devstack@n-api.service[62054]: DEBUG nova.quota [None req-93c14154-953e-4a68-bc4c-f46f9d7c4bd8 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Getting quotas for project 18e15bc7bee7466a840fb0d0e85d58bd. Resources: {'key_pairs'} {{(pid=62054) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 16:28:26 user devstack@n-api.service[62054]: DEBUG nova.quota [None req-93c14154-953e-4a68-bc4c-f46f9d7c4bd8 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Getting quotas for user 1318d817c48e40988e043fa33e908312 and project 18e15bc7bee7466a840fb0d0e85d58bd. Resources: {'key_pairs'} {{(pid=62054) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 16:28:26 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-93c14154-953e-4a68-bc4c-f46f9d7c4bd8 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.225753 Apr 13 16:28:26 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 156/462] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 13 16:28:25 2023] POST /compute/v2.1/os-keypairs => generated 405 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:28:27 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_api:SELECT=4 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:28:27 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:28:27 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-38f289b4-d3a1-4d47-a8de-d9aa96d05988 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SnapshotDataIntegrityTests-server-1023997191", "imageRef": "708622a9-7465-4492-ade8-b827198f7e30", "flavorRef": "42", "key_name": "tempest-SnapshotDataIntegrityTests-1768467450", "security_groups": [{"name": "tempest-secgroup-smoke-990193358"}], "networks": [{"uuid": "531e0c0e-c7aa-4a8c-b994-cf304d6e9089"}]}} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:28:27 user devstack@n-api.service[62053]: DEBUG nova.network.neutron [None req-38f289b4-d3a1-4d47-a8de-d9aa96d05988 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] validate_networks() for [('531e0c0e-c7aa-4a8c-b994-cf304d6e9089', None, None, None, None, None)] {{(pid=62053) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 16:28:28 user devstack@n-api.service[62053]: DEBUG nova.virt.hardware [None req-38f289b4-d3a1-4d47-a8de-d9aa96d05988 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Flavor limits 0:0:0 {{(pid=62053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 16:28:28 user devstack@n-api.service[62053]: DEBUG nova.virt.hardware [None req-38f289b4-d3a1-4d47-a8de-d9aa96d05988 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Image limits 0:0:0 {{(pid=62053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 16:28:28 user devstack@n-api.service[62053]: DEBUG nova.virt.hardware [None req-38f289b4-d3a1-4d47-a8de-d9aa96d05988 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Flavor pref 0:0:0 {{(pid=62053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 16:28:28 user devstack@n-api.service[62053]: DEBUG nova.virt.hardware [None req-38f289b4-d3a1-4d47-a8de-d9aa96d05988 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Image pref 0:0:0 {{(pid=62053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 16:28:28 user devstack@n-api.service[62053]: DEBUG nova.virt.hardware [None req-38f289b4-d3a1-4d47-a8de-d9aa96d05988 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 16:28:28 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-38f289b4-d3a1-4d47-a8de-d9aa96d05988 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:28:28 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-38f289b4-d3a1-4d47-a8de-d9aa96d05988 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:28:28 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-38f289b4-d3a1-4d47-a8de-d9aa96d05988 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:28:28 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-38f289b4-d3a1-4d47-a8de-d9aa96d05988 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:28:28 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-38f289b4-d3a1-4d47-a8de-d9aa96d05988 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:28:28 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-38f289b4-d3a1-4d47-a8de-d9aa96d05988 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:28:28 user devstack@n-api.service[62053]: DEBUG nova.quota [None req-38f289b4-d3a1-4d47-a8de-d9aa96d05988 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Getting quotas for project 18e15bc7bee7466a840fb0d0e85d58bd. Resources: {'instances', 'cores', 'ram'} {{(pid=62053) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 16:28:28 user devstack@n-api.service[62053]: DEBUG nova.quota [None req-38f289b4-d3a1-4d47-a8de-d9aa96d05988 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Getting quotas for user 1318d817c48e40988e043fa33e908312 and project 18e15bc7bee7466a840fb0d0e85d58bd. Resources: {'instances', 'cores', 'ram'} {{(pid=62053) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 16:28:28 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-38f289b4-d3a1-4d47-a8de-d9aa96d05988 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Going to run 1 instances... {{(pid=62053) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 16:28:28 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-38f289b4-d3a1-4d47-a8de-d9aa96d05988 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='708622a9-7465-4492-ade8-b827198f7e30',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=62053) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 16:28:28 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-38f289b4-d3a1-4d47-a8de-d9aa96d05988 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.743840 Apr 13 16:28:28 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 155/463] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 16:28:27 2023] POST /compute/v2.1/servers => generated 403 bytes in 745 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 16:28:28 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-a583555c-6094-427c-8fc6-6a9c8b0f5835 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:28:28 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-a583555c-6094-427c-8fc6-6a9c8b0f5835 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:28:28 user devstack@n-api.service[62055]: DEBUG nova.policy [None req-a583555c-6094-427c-8fc6-6a9c8b0f5835 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1318d817c48e40988e043fa33e908312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e15bc7bee7466a840fb0d0e85d58bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62055) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:28:28 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-a583555c-6094-427c-8fc6-6a9c8b0f5835 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bf98c3a2-dbeb-4ae4-8423-ce55964c4258" status: 200 len: 1257 microversion: 2.1 time: 0.119294 Apr 13 16:28:28 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 153/464] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:28:28 2023] GET /compute/v2.1/servers/bf98c3a2-dbeb-4ae4-8423-ce55964c4258 => generated 1257 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:28:29 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-86c7043e-2041-4755-bcd3-a04916417758 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:28:29 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-86c7043e-2041-4755-bcd3-a04916417758 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:28:29 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-86c7043e-2041-4755-bcd3-a04916417758 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:28:29 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-86c7043e-2041-4755-bcd3-a04916417758 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:28:29 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-86c7043e-2041-4755-bcd3-a04916417758 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:28:29 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-86c7043e-2041-4755-bcd3-a04916417758 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:28:29 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-86c7043e-2041-4755-bcd3-a04916417758 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:28:29 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-86c7043e-2041-4755-bcd3-a04916417758 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:28:29 user devstack@n-api.service[62054]: INFO nova.api.openstack.wsgi [None req-86c7043e-2041-4755-bcd3-a04916417758 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] HTTP exception thrown: Instance bbcccf4b-e861-4254-9be3-a491776214e9 could not be found. Apr 13 16:28:29 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-86c7043e-2041-4755-bcd3-a04916417758 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Request method failure captured: Apr 13 16:28:29 user devstack@n-api.service[62054]: request: GET /compute/v2.1/servers/bbcccf4b-e861-4254-9be3-a491776214e9 HTTP/1.1 Apr 13 16:28:29 user devstack@n-api.service[62054]: Accept: application/json Apr 13 16:28:29 user devstack@n-api.service[62054]: Accept-Encoding: identity Apr 13 16:28:29 user devstack@n-api.service[62054]: Connection: close Apr 13 16:28:29 user devstack@n-api.service[62054]: Content-Length: 0 Apr 13 16:28:29 user devstack@n-api.service[62054]: Content-Type: application/json Apr 13 16:28:29 user devstack@n-api.service[62054]: Host: 10.0.0.210 Apr 13 16:28:29 user devstack@n-api.service[62054]: Openstack-System-Scope: None Apr 13 16:28:29 user devstack@n-api.service[62054]: User-Agent: python-urllib3/1.26.15 Apr 13 16:28:29 user devstack@n-api.service[62054]: X-Auth-Token: gAAAAABkOCvBTEZaRdAFPlcK1UyZIjdYGKwN29vyt3vL6AFhV-L3mi2WZTfpTH11fiN6EuMZm2w1XN1_Tk3Zk1knoFVOfx2nry_CDr6ML121idq1HSS7B9DzRV5yVfildn-roVLb61T7Q_VsABwzSE58lpE6QxFkS8-dhBVHBDszWEtGWiOYnls Apr 13 16:28:29 user devstack@n-api.service[62054]: X-Domain-Id: None Apr 13 16:28:29 user devstack@n-api.service[62054]: X-Domain-Name: None Apr 13 16:28:29 user devstack@n-api.service[62054]: X-Identity-Status: Confirmed Apr 13 16:28:29 user devstack@n-api.service[62054]: X-Is-Admin-Project: True Apr 13 16:28:29 user devstack@n-api.service[62054]: X-Project-Domain-Id: default Apr 13 16:28:29 user devstack@n-api.service[62054]: X-Project-Domain-Name: Default Apr 13 16:28:29 user devstack@n-api.service[62054]: X-Project-Id: 7061f2f041954ffe90b0c87b422890e4 Apr 13 16:28:29 user devstack@n-api.service[62054]: X-Project-Name: tempest-ServerStableDeviceRescueTest-1182397334 Apr 13 16:28:29 user devstack@n-api.service[62054]: X-Role: reader,member Apr 13 16:28:29 user devstack@n-api.service[62054]: X-Roles: reader,member Apr 13 16:28:29 user devstack@n-api.service[62054]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/7061f2f041954ffe90b0c87b422890e4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7061f2f041954ffe90b0c87b422890e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7061f2f041954ffe90b0c87b422890e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 13 16:28:29 user devstack@n-api.service[62054]: X-Tenant: tempest-ServerStableDeviceRescueTest-1182397334 Apr 13 16:28:29 user devstack@n-api.service[62054]: X-Tenant-Id: 7061f2f041954ffe90b0c87b422890e4 Apr 13 16:28:29 user devstack@n-api.service[62054]: X-Tenant-Name: tempest-ServerStableDeviceRescueTest-1182397334 Apr 13 16:28:29 user devstack@n-api.service[62054]: X-User: tempest-ServerStableDeviceRescueTest-1182397334-project-member Apr 13 16:28:29 user devstack@n-api.service[62054]: X-User-Domain-Id: default Apr 13 16:28:29 user devstack@n-api.service[62054]: X-User-Domain-Name: Default Apr 13 16:28:29 user devstack@n-api.service[62054]: X-User-Id: 9bf19848229f45baad45c490cf539508 Apr 13 16:28:29 user devstack@n-api.service[62054]: X-User-Name: tempest-ServerStableDeviceRescueTest-1182397334-project-member Apr 13 16:28:29 user devstack@n-api.service[62054]: method: > Apr 13 16:28:29 user devstack@n-api.service[62054]: exception: Instance bbcccf4b-e861-4254-9be3-a491776214e9 could not be found. Apr 13 16:28:29 user devstack@n-api.service[62054]: action_args: {'id': 'bbcccf4b-e861-4254-9be3-a491776214e9'} Apr 13 16:28:29 user devstack@n-api.service[62054]: {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 16:28:29 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:28:29 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 16:28:29 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 16:28:29 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 16:28:29 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 16:28:29 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 16:28:29 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 16:28:29 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 16:28:29 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 16:28:29 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbcccf4b-e861-4254-9be3-a491776214e9 could not be found. Apr 13 16:28:29 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:28:29 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:28:29 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:28:29 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:28:29 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 16:28:29 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 16:28:29 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 16:28:29 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 16:28:29 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 16:28:29 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 16:28:29 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 16:28:29 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 16:28:29 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 16:28:29 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 16:28:29 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 16:28:29 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 16:28:29 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbcccf4b-e861-4254-9be3-a491776214e9 could not be found. Apr 13 16:28:29 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:28:29 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:28:29 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:28:29 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:28:29 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 16:28:29 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 16:28:29 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 16:28:29 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 16:28:29 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbcccf4b-e861-4254-9be3-a491776214e9 could not be found. Apr 13 16:28:29 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:28:29 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-86c7043e-2041-4755-bcd3-a04916417758 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Returning 404 to user: Instance bbcccf4b-e861-4254-9be3-a491776214e9 could not be found. {{(pid=62054) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 16:28:29 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-86c7043e-2041-4755-bcd3-a04916417758 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bbcccf4b-e861-4254-9be3-a491776214e9" status: 404 len: 111 microversion: 2.1 time: 0.031435 Apr 13 16:28:29 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 157/465] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:28:29 2023] GET /compute/v2.1/servers/bbcccf4b-e861-4254-9be3-a491776214e9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 16:28:29 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-1c04a31a-a33b-44ca-a232-e6e880c7a81a tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Calling method '.version_select at 0x7f96e476e050>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:28:29 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-1c04a31a-a33b-44ca-a232-e6e880c7a81a tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-900897003" status: 202 len: 0 microversion: 2.1 time: 0.034901 Apr 13 16:28:29 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 156/466] 10.0.0.210 () {62 vars in 1295 bytes} [Thu Apr 13 16:28:29 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-900897003 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 16:28:31 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [req-4835f251-abe8-474b-aa7b-14f3c541a499 req-4375bed2-d51d-4ff4-b701-8d37c8d22f0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf98c3a2-dbeb-4ae4-8423-ce55964c4258", "tag": "58361670-0371-4eb7-83b9-ce67bf2a67bb"}]} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:28:31 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-4835f251-abe8-474b-aa7b-14f3c541a499 req-4375bed2-d51d-4ff4-b701-8d37c8d22f0f service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:28:31 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-4835f251-abe8-474b-aa7b-14f3c541a499 req-4375bed2-d51d-4ff4-b701-8d37c8d22f0f service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:28:31 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-4835f251-abe8-474b-aa7b-14f3c541a499 req-4375bed2-d51d-4ff4-b701-8d37c8d22f0f service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:28:31 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-4835f251-abe8-474b-aa7b-14f3c541a499 req-4375bed2-d51d-4ff4-b701-8d37c8d22f0f service nova] Creating event network-changed:58361670-0371-4eb7-83b9-ce67bf2a67bb for instance bf98c3a2-dbeb-4ae4-8423-ce55964c4258 on user Apr 13 16:28:31 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [req-4835f251-abe8-474b-aa7b-14f3c541a499 req-4375bed2-d51d-4ff4-b701-8d37c8d22f0f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040585 Apr 13 16:28:31 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 154/467] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:28:31 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:28:33 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-6432c220-0b35-4d4b-8ae4-a084c689e25e tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:28:33 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-6432c220-0b35-4d4b-8ae4-a084c689e25e tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] [instance: 5d50f597-3a29-4335-8166-6ab8e8149376] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:28:33 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-6432c220-0b35-4d4b-8ae4-a084c689e25e tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:28:33 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-6432c220-0b35-4d4b-8ae4-a084c689e25e tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:28:33 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-6432c220-0b35-4d4b-8ae4-a084c689e25e tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:28:33 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-6432c220-0b35-4d4b-8ae4-a084c689e25e tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:28:33 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-6432c220-0b35-4d4b-8ae4-a084c689e25e tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:28:33 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-6432c220-0b35-4d4b-8ae4-a084c689e25e tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:28:33 user devstack@n-api.service[62054]: DEBUG nova.policy [None req-6432c220-0b35-4d4b-8ae4-a084c689e25e tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa66202e2e5547d1b6e792557b335d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c33fd5889ce4d0b983f529767005267', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62054) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:28:33 user devstack@n-api.service[62054]: DEBUG nova.policy [None req-6432c220-0b35-4d4b-8ae4-a084c689e25e tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa66202e2e5547d1b6e792557b335d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c33fd5889ce4d0b983f529767005267', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62054) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:28:33 user devstack@n-api.service[62054]: DEBUG nova.policy [None req-6432c220-0b35-4d4b-8ae4-a084c689e25e tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa66202e2e5547d1b6e792557b335d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c33fd5889ce4d0b983f529767005267', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62054) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:28:33 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-6432c220-0b35-4d4b-8ae4-a084c689e25e tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5d50f597-3a29-4335-8166-6ab8e8149376" status: 200 len: 1628 microversion: 2.49 time: 0.278751 Apr 13 16:28:33 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 158/468] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 16:28:33 2023] GET /compute/v2.1/servers/5d50f597-3a29-4335-8166-6ab8e8149376 => generated 1628 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 16:28:34 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-5d24ac77-17ea-4f38-851c-885a3d0734d4 req-2f216627-78b2-434e-bf8d-4dbea0e17b31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf98c3a2-dbeb-4ae4-8423-ce55964c4258", "name": "network-vif-plugged", "status": "completed", "tag": "58361670-0371-4eb7-83b9-ce67bf2a67bb"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:28:34 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-5d24ac77-17ea-4f38-851c-885a3d0734d4 req-2f216627-78b2-434e-bf8d-4dbea0e17b31 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:28:34 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-5d24ac77-17ea-4f38-851c-885a3d0734d4 req-2f216627-78b2-434e-bf8d-4dbea0e17b31 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:28:34 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-5d24ac77-17ea-4f38-851c-885a3d0734d4 req-2f216627-78b2-434e-bf8d-4dbea0e17b31 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:28:34 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-5d24ac77-17ea-4f38-851c-885a3d0734d4 req-2f216627-78b2-434e-bf8d-4dbea0e17b31 service nova] Creating event network-vif-plugged:58361670-0371-4eb7-83b9-ce67bf2a67bb for instance bf98c3a2-dbeb-4ae4-8423-ce55964c4258 on user Apr 13 16:28:34 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [req-5d24ac77-17ea-4f38-851c-885a3d0734d4 req-2f216627-78b2-434e-bf8d-4dbea0e17b31 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072413 Apr 13 16:28:34 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 157/469] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:28:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:28:36 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [req-259c3bfc-7f63-4488-b945-42a2b02dbd0c req-3c75fdc1-0c0b-46f6-a4d1-c4981e895e10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf98c3a2-dbeb-4ae4-8423-ce55964c4258", "name": "network-vif-plugged", "status": "completed", "tag": "58361670-0371-4eb7-83b9-ce67bf2a67bb"}]} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:28:36 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-259c3bfc-7f63-4488-b945-42a2b02dbd0c req-3c75fdc1-0c0b-46f6-a4d1-c4981e895e10 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:28:36 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-259c3bfc-7f63-4488-b945-42a2b02dbd0c req-3c75fdc1-0c0b-46f6-a4d1-c4981e895e10 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:28:36 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-259c3bfc-7f63-4488-b945-42a2b02dbd0c req-3c75fdc1-0c0b-46f6-a4d1-c4981e895e10 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:28:36 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-259c3bfc-7f63-4488-b945-42a2b02dbd0c req-3c75fdc1-0c0b-46f6-a4d1-c4981e895e10 service nova] Creating event network-vif-plugged:58361670-0371-4eb7-83b9-ce67bf2a67bb for instance bf98c3a2-dbeb-4ae4-8423-ce55964c4258 on user Apr 13 16:28:36 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [req-259c3bfc-7f63-4488-b945-42a2b02dbd0c req-3c75fdc1-0c0b-46f6-a4d1-c4981e895e10 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035865 Apr 13 16:28:36 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 155/470] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:28:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:28:40 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_cell0:SELECT=4 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:28:40 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-e8af3450-95d4-43ea-8697-dd8495d32792 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Action: 'create', calling method: .version_select at 0x7f96e49e7d90>, body: {"keypair": {"name": "tempest-TestStampPattern-792944514", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL2QPQmeuQ3QMNshoDoMdPG3OSftqyMCUtV3Pr6v+/rhaN+olW1hWBQn7y9Ew+sQSET4+DncPzqCVC4fuapQVvR4RUPvk9/ysi6s66mNzl8HmL0L6OHOtrjR4F2tcMOgTw=="}} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:28:40 user devstack@n-api.service[62054]: DEBUG nova.quota [None req-e8af3450-95d4-43ea-8697-dd8495d32792 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Getting quotas for project bb7100b359f341759cb6f6753e1539a8. Resources: {'key_pairs'} {{(pid=62054) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 16:28:40 user devstack@n-api.service[62054]: DEBUG nova.quota [None req-e8af3450-95d4-43ea-8697-dd8495d32792 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Getting quotas for user f523740272844b6eb236477d0b116ddb and project bb7100b359f341759cb6f6753e1539a8. Resources: {'key_pairs'} {{(pid=62054) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 16:28:40 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-e8af3450-95d4-43ea-8697-dd8495d32792 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 394 microversion: 2.1 time: 0.216533 Apr 13 16:28:40 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 159/471] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 13 16:28:40 2023] POST /compute/v2.1/os-keypairs => generated 394 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:28:43 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_cell0:SELECT=2 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:28:43 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_cell0:SELECT=6 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:28:43 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-c38c07e1-2641-45b0-8a19-2ac6f0ca4df0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestStampPattern-server-1668766448", "imageRef": "708622a9-7465-4492-ade8-b827198f7e30", "flavorRef": "42", "key_name": "tempest-TestStampPattern-792944514", "security_groups": [{"name": "tempest-secgroup-smoke-1923082772"}], "networks": [{"uuid": "11386312-9ac6-4252-ab98-b3298a08599c"}]}} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:28:43 user devstack@n-api.service[62053]: DEBUG nova.network.neutron [None req-c38c07e1-2641-45b0-8a19-2ac6f0ca4df0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] validate_networks() for [('11386312-9ac6-4252-ab98-b3298a08599c', None, None, None, None, None)] {{(pid=62053) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 16:28:43 user devstack@n-api.service[62053]: DEBUG nova.virt.hardware [None req-c38c07e1-2641-45b0-8a19-2ac6f0ca4df0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Flavor limits 0:0:0 {{(pid=62053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 16:28:43 user devstack@n-api.service[62053]: DEBUG nova.virt.hardware [None req-c38c07e1-2641-45b0-8a19-2ac6f0ca4df0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Image limits 0:0:0 {{(pid=62053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 16:28:43 user devstack@n-api.service[62053]: DEBUG nova.virt.hardware [None req-c38c07e1-2641-45b0-8a19-2ac6f0ca4df0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Flavor pref 0:0:0 {{(pid=62053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 16:28:43 user devstack@n-api.service[62053]: DEBUG nova.virt.hardware [None req-c38c07e1-2641-45b0-8a19-2ac6f0ca4df0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Image pref 0:0:0 {{(pid=62053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 16:28:43 user devstack@n-api.service[62053]: DEBUG nova.virt.hardware [None req-c38c07e1-2641-45b0-8a19-2ac6f0ca4df0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 16:28:43 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-c38c07e1-2641-45b0-8a19-2ac6f0ca4df0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:28:43 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-c38c07e1-2641-45b0-8a19-2ac6f0ca4df0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:28:43 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-c38c07e1-2641-45b0-8a19-2ac6f0ca4df0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:28:43 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-c38c07e1-2641-45b0-8a19-2ac6f0ca4df0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:28:43 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-c38c07e1-2641-45b0-8a19-2ac6f0ca4df0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:28:43 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-c38c07e1-2641-45b0-8a19-2ac6f0ca4df0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:28:43 user devstack@n-api.service[62053]: DEBUG nova.quota [None req-c38c07e1-2641-45b0-8a19-2ac6f0ca4df0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Getting quotas for project bb7100b359f341759cb6f6753e1539a8. Resources: {'instances', 'cores', 'ram'} {{(pid=62053) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 16:28:43 user devstack@n-api.service[62053]: DEBUG nova.quota [None req-c38c07e1-2641-45b0-8a19-2ac6f0ca4df0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Getting quotas for user f523740272844b6eb236477d0b116ddb and project bb7100b359f341759cb6f6753e1539a8. Resources: {'instances', 'cores', 'ram'} {{(pid=62053) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 16:28:43 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-c38c07e1-2641-45b0-8a19-2ac6f0ca4df0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Going to run 1 instances... {{(pid=62053) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 16:28:43 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-c38c07e1-2641-45b0-8a19-2ac6f0ca4df0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] [instance: 32b18558-8bf2-4def-bc70-81c4e38fcc6f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='708622a9-7465-4492-ade8-b827198f7e30',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=62053) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 16:28:43 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-c38c07e1-2641-45b0-8a19-2ac6f0ca4df0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.643646 Apr 13 16:28:43 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 158/472] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 16:28:43 2023] POST /compute/v2.1/servers => generated 404 bytes in 645 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Apr 13 16:28:43 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_cell0:SELECT=2 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:28:43 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-b1fe8f3c-1ea0-473a-af99-16b36b539f58 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:28:43 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-b1fe8f3c-1ea0-473a-af99-16b36b539f58 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] [instance: 32b18558-8bf2-4def-bc70-81c4e38fcc6f] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:28:44 user devstack@n-api.service[62055]: DEBUG nova.policy [None req-b1fe8f3c-1ea0-473a-af99-16b36b539f58 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f523740272844b6eb236477d0b116ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7100b359f341759cb6f6753e1539a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62055) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:28:44 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-b1fe8f3c-1ea0-473a-af99-16b36b539f58 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] 10.0.0.210 "GET /compute/v2.1/servers/32b18558-8bf2-4def-bc70-81c4e38fcc6f" status: 200 len: 1236 microversion: 2.1 time: 0.080690 Apr 13 16:28:44 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 156/473] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:28:43 2023] GET /compute/v2.1/servers/32b18558-8bf2-4def-bc70-81c4e38fcc6f => generated 1236 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:28:46 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_cell1:SELECT=8 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:28:46 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-3b05077a-d964-41d3-9a1c-eaf504bd7253 req-d74ce808-60ce-440f-bad7-b5c9135e6c7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32b18558-8bf2-4def-bc70-81c4e38fcc6f", "tag": "f9afb5f6-d601-4106-85c8-6d6179433f28"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:28:46 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-3b05077a-d964-41d3-9a1c-eaf504bd7253 req-d74ce808-60ce-440f-bad7-b5c9135e6c7b service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:28:46 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-3b05077a-d964-41d3-9a1c-eaf504bd7253 req-d74ce808-60ce-440f-bad7-b5c9135e6c7b service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:28:46 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-3b05077a-d964-41d3-9a1c-eaf504bd7253 req-d74ce808-60ce-440f-bad7-b5c9135e6c7b service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:28:46 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-3b05077a-d964-41d3-9a1c-eaf504bd7253 req-d74ce808-60ce-440f-bad7-b5c9135e6c7b service nova] Creating event network-changed:f9afb5f6-d601-4106-85c8-6d6179433f28 for instance 32b18558-8bf2-4def-bc70-81c4e38fcc6f on user Apr 13 16:28:46 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [req-3b05077a-d964-41d3-9a1c-eaf504bd7253 req-d74ce808-60ce-440f-bad7-b5c9135e6c7b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034331 Apr 13 16:28:46 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 160/474] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:28:46 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:28:47 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-1e9a4262-6665-4e96-839e-b5a8009f095e tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-1877773095", "imageRef": "708622a9-7465-4492-ade8-b827198f7e30", "flavorRef": "42", "networks": [{"uuid": "5a7877ff-8230-470b-90b5-e5dcfc8f0cee"}]}} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:28:48 user devstack@n-api.service[62053]: DEBUG nova.network.neutron [None req-1e9a4262-6665-4e96-839e-b5a8009f095e tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] validate_networks() for [('5a7877ff-8230-470b-90b5-e5dcfc8f0cee', None, None, None, None, None)] {{(pid=62053) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 16:28:48 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-354267d9-6828-40cb-9e49-4edb3d9fa273 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:28:48 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-354267d9-6828-40cb-9e49-4edb3d9fa273 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 0f52d9e3-921c-4f79-9cdb-7d73500c8c35] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:28:48 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_cell1:SELECT=10 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:28:48 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-354267d9-6828-40cb-9e49-4edb3d9fa273 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:28:48 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-354267d9-6828-40cb-9e49-4edb3d9fa273 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:28:48 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-354267d9-6828-40cb-9e49-4edb3d9fa273 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:28:48 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-354267d9-6828-40cb-9e49-4edb3d9fa273 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:28:48 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-354267d9-6828-40cb-9e49-4edb3d9fa273 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:28:48 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-354267d9-6828-40cb-9e49-4edb3d9fa273 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:28:48 user devstack@n-api.service[62053]: DEBUG nova.virt.hardware [None req-1e9a4262-6665-4e96-839e-b5a8009f095e tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Flavor limits 0:0:0 {{(pid=62053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 16:28:48 user devstack@n-api.service[62053]: DEBUG nova.virt.hardware [None req-1e9a4262-6665-4e96-839e-b5a8009f095e tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Image limits 0:0:0 {{(pid=62053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 16:28:48 user devstack@n-api.service[62053]: DEBUG nova.virt.hardware [None req-1e9a4262-6665-4e96-839e-b5a8009f095e tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Flavor pref 0:0:0 {{(pid=62053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 16:28:48 user devstack@n-api.service[62053]: DEBUG nova.virt.hardware [None req-1e9a4262-6665-4e96-839e-b5a8009f095e tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Image pref 0:0:0 {{(pid=62053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 16:28:48 user devstack@n-api.service[62053]: DEBUG nova.virt.hardware [None req-1e9a4262-6665-4e96-839e-b5a8009f095e tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 16:28:48 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-1e9a4262-6665-4e96-839e-b5a8009f095e tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:28:48 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-1e9a4262-6665-4e96-839e-b5a8009f095e tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:28:48 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-1e9a4262-6665-4e96-839e-b5a8009f095e tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:28:48 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-1e9a4262-6665-4e96-839e-b5a8009f095e tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:28:48 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-1e9a4262-6665-4e96-839e-b5a8009f095e tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:28:48 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-1e9a4262-6665-4e96-839e-b5a8009f095e tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:28:48 user devstack@n-api.service[62053]: DEBUG nova.quota [None req-1e9a4262-6665-4e96-839e-b5a8009f095e tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Getting quotas for project b2d09a74bf684a9fb1dd1e95d6c23f3c. Resources: {'instances', 'cores', 'ram'} {{(pid=62053) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 16:28:48 user devstack@n-api.service[62053]: DEBUG nova.quota [None req-1e9a4262-6665-4e96-839e-b5a8009f095e tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Getting quotas for user e45a882dbafb4ea4976e4f45289eb2b8 and project b2d09a74bf684a9fb1dd1e95d6c23f3c. Resources: {'instances', 'cores', 'ram'} {{(pid=62053) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 16:28:48 user devstack@n-api.service[62055]: DEBUG nova.policy [None req-354267d9-6828-40cb-9e49-4edb3d9fa273 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e10f63cdd49a9a1ebe1fe4c9de0a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d451e0e239f486aa2b3abe9e273eab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62055) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:28:48 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-1e9a4262-6665-4e96-839e-b5a8009f095e tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Going to run 1 instances... {{(pid=62053) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 16:28:48 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-1e9a4262-6665-4e96-839e-b5a8009f095e tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 650427bd-4dad-4bcd-922d-c17e60b36807] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='708622a9-7465-4492-ade8-b827198f7e30',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=62053) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 16:28:48 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-354267d9-6828-40cb-9e49-4edb3d9fa273 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0f52d9e3-921c-4f79-9cdb-7d73500c8c35" status: 200 len: 1550 microversion: 2.1 time: 0.152800 Apr 13 16:28:48 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 157/475] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:28:48 2023] GET /compute/v2.1/servers/0f52d9e3-921c-4f79-9cdb-7d73500c8c35 => generated 1550 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:28:48 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-1e9a4262-6665-4e96-839e-b5a8009f095e tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.582139 Apr 13 16:28:48 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 159/476] 10.0.0.210 () {66 vars in 1265 bytes} [Thu Apr 13 16:28:47 2023] POST /compute/v2.1/servers => generated 378 bytes in 584 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 13 16:28:48 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-79960e97-630f-417e-a7ef-c84e3e23aa78 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:28:48 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-79960e97-630f-417e-a7ef-c84e3e23aa78 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 650427bd-4dad-4bcd-922d-c17e60b36807] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:28:48 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-90959a1e-1029-4303-89ae-1ebbc14087d7 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:28:48 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-90959a1e-1029-4303-89ae-1ebbc14087d7 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 0f52d9e3-921c-4f79-9cdb-7d73500c8c35] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:28:48 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-90959a1e-1029-4303-89ae-1ebbc14087d7 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:28:48 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-90959a1e-1029-4303-89ae-1ebbc14087d7 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:28:48 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-90959a1e-1029-4303-89ae-1ebbc14087d7 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:28:48 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-90959a1e-1029-4303-89ae-1ebbc14087d7 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:28:48 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-90959a1e-1029-4303-89ae-1ebbc14087d7 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:28:48 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-90959a1e-1029-4303-89ae-1ebbc14087d7 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:28:48 user devstack@n-api.service[62054]: DEBUG nova.policy [None req-79960e97-630f-417e-a7ef-c84e3e23aa78 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45a882dbafb4ea4976e4f45289eb2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d09a74bf684a9fb1dd1e95d6c23f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62054) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:28:48 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-90959a1e-1029-4303-89ae-1ebbc14087d7 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 0f52d9e3-921c-4f79-9cdb-7d73500c8c35] Going to try to terminate instance {{(pid=62055) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 16:28:48 user devstack@n-api.service[62054]: DEBUG nova.policy [None req-79960e97-630f-417e-a7ef-c84e3e23aa78 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e45a882dbafb4ea4976e4f45289eb2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d09a74bf684a9fb1dd1e95d6c23f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62054) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:28:48 user devstack@n-api.service[62054]: DEBUG nova.policy [None req-79960e97-630f-417e-a7ef-c84e3e23aa78 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e45a882dbafb4ea4976e4f45289eb2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d09a74bf684a9fb1dd1e95d6c23f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62054) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:28:48 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-79960e97-630f-417e-a7ef-c84e3e23aa78 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] 10.0.0.210 "GET /compute/v2.1/servers/650427bd-4dad-4bcd-922d-c17e60b36807" status: 200 len: 1395 microversion: 2.87 time: 0.082804 Apr 13 16:28:48 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 161/477] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 16:28:48 2023] GET /compute/v2.1/servers/650427bd-4dad-4bcd-922d-c17e60b36807 => generated 1395 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 16:28:48 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-90959a1e-1029-4303-89ae-1ebbc14087d7 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0f52d9e3-921c-4f79-9cdb-7d73500c8c35" status: 204 len: 0 microversion: 2.1 time: 0.168507 Apr 13 16:28:48 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 158/478] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 16:28:48 2023] DELETE /compute/v2.1/servers/0f52d9e3-921c-4f79-9cdb-7d73500c8c35 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 16:28:48 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-45f41de8-5d07-41a0-9238-0e36ab5125b3 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:28:48 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-45f41de8-5d07-41a0-9238-0e36ab5125b3 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 0f52d9e3-921c-4f79-9cdb-7d73500c8c35] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:28:48 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-45f41de8-5d07-41a0-9238-0e36ab5125b3 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:28:48 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-45f41de8-5d07-41a0-9238-0e36ab5125b3 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:28:48 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-45f41de8-5d07-41a0-9238-0e36ab5125b3 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:28:48 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-45f41de8-5d07-41a0-9238-0e36ab5125b3 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:28:48 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-45f41de8-5d07-41a0-9238-0e36ab5125b3 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:28:48 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-45f41de8-5d07-41a0-9238-0e36ab5125b3 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:28:48 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-bd6d6600-955f-4cd1-8d8d-1c14c97b9c11 req-db38f979-da7f-4ead-8e5f-a68cc2eec741 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32b18558-8bf2-4def-bc70-81c4e38fcc6f", "name": "network-vif-plugged", "status": "completed", "tag": "f9afb5f6-d601-4106-85c8-6d6179433f28"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:28:48 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-bd6d6600-955f-4cd1-8d8d-1c14c97b9c11 req-db38f979-da7f-4ead-8e5f-a68cc2eec741 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:28:48 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-bd6d6600-955f-4cd1-8d8d-1c14c97b9c11 req-db38f979-da7f-4ead-8e5f-a68cc2eec741 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:28:48 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-bd6d6600-955f-4cd1-8d8d-1c14c97b9c11 req-db38f979-da7f-4ead-8e5f-a68cc2eec741 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:28:48 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-bd6d6600-955f-4cd1-8d8d-1c14c97b9c11 req-db38f979-da7f-4ead-8e5f-a68cc2eec741 service nova] Creating event network-vif-plugged:f9afb5f6-d601-4106-85c8-6d6179433f28 for instance 32b18558-8bf2-4def-bc70-81c4e38fcc6f on user Apr 13 16:28:48 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [req-bd6d6600-955f-4cd1-8d8d-1c14c97b9c11 req-db38f979-da7f-4ead-8e5f-a68cc2eec741 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035959 Apr 13 16:28:48 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 162/479] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:28:48 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:28:49 user devstack@n-api.service[62053]: DEBUG nova.policy [None req-45f41de8-5d07-41a0-9238-0e36ab5125b3 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e10f63cdd49a9a1ebe1fe4c9de0a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d451e0e239f486aa2b3abe9e273eab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62053) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:28:49 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-45f41de8-5d07-41a0-9238-0e36ab5125b3 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0f52d9e3-921c-4f79-9cdb-7d73500c8c35" status: 200 len: 1556 microversion: 2.1 time: 0.305791 Apr 13 16:28:49 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 160/480] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:28:48 2023] GET /compute/v2.1/servers/0f52d9e3-921c-4f79-9cdb-7d73500c8c35 => generated 1556 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 13 16:28:49 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [req-be44ecdd-e15e-4fa3-bb3e-d9c230266153 req-46a8fb3c-88f3-408a-bdda-779a27a17ba4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f52d9e3-921c-4f79-9cdb-7d73500c8c35", "name": "network-vif-unplugged", "status": "completed", "tag": "d68dc4c7-5e6e-4d7f-8143-62eeb1816486"}]} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:28:49 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-be44ecdd-e15e-4fa3-bb3e-d9c230266153 req-46a8fb3c-88f3-408a-bdda-779a27a17ba4 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:28:49 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-be44ecdd-e15e-4fa3-bb3e-d9c230266153 req-46a8fb3c-88f3-408a-bdda-779a27a17ba4 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:28:49 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-be44ecdd-e15e-4fa3-bb3e-d9c230266153 req-46a8fb3c-88f3-408a-bdda-779a27a17ba4 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:28:49 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-be44ecdd-e15e-4fa3-bb3e-d9c230266153 req-46a8fb3c-88f3-408a-bdda-779a27a17ba4 service nova] Creating event network-vif-unplugged:d68dc4c7-5e6e-4d7f-8143-62eeb1816486 for instance 0f52d9e3-921c-4f79-9cdb-7d73500c8c35 on user Apr 13 16:28:49 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [req-be44ecdd-e15e-4fa3-bb3e-d9c230266153 req-46a8fb3c-88f3-408a-bdda-779a27a17ba4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031030 Apr 13 16:28:49 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 159/481] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:28:49 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:28:50 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-1fa43090-5ade-421c-87d0-dbd58c606df4 req-b8943f07-27f4-4de2-81bc-f608e150dbd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32b18558-8bf2-4def-bc70-81c4e38fcc6f", "name": "network-vif-plugged", "status": "completed", "tag": "f9afb5f6-d601-4106-85c8-6d6179433f28"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:28:50 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-1fa43090-5ade-421c-87d0-dbd58c606df4 req-b8943f07-27f4-4de2-81bc-f608e150dbd7 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:28:50 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-1fa43090-5ade-421c-87d0-dbd58c606df4 req-b8943f07-27f4-4de2-81bc-f608e150dbd7 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:28:50 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-1fa43090-5ade-421c-87d0-dbd58c606df4 req-b8943f07-27f4-4de2-81bc-f608e150dbd7 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:28:50 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-1fa43090-5ade-421c-87d0-dbd58c606df4 req-b8943f07-27f4-4de2-81bc-f608e150dbd7 service nova] Creating event network-vif-plugged:f9afb5f6-d601-4106-85c8-6d6179433f28 for instance 32b18558-8bf2-4def-bc70-81c4e38fcc6f on user Apr 13 16:28:51 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [req-1fa43090-5ade-421c-87d0-dbd58c606df4 req-b8943f07-27f4-4de2-81bc-f608e150dbd7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029484 Apr 13 16:28:51 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 163/482] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:28:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 16:28:51 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-8ceb01fa-6ba5-4edb-9ac9-47b670ceddcf req-97b01042-4ea9-4560-aefb-0507c639b1fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f52d9e3-921c-4f79-9cdb-7d73500c8c35", "name": "network-vif-plugged", "status": "completed", "tag": "d68dc4c7-5e6e-4d7f-8143-62eeb1816486"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:28:51 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-8ceb01fa-6ba5-4edb-9ac9-47b670ceddcf req-97b01042-4ea9-4560-aefb-0507c639b1fd service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:28:51 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-8ceb01fa-6ba5-4edb-9ac9-47b670ceddcf req-97b01042-4ea9-4560-aefb-0507c639b1fd service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:28:51 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-8ceb01fa-6ba5-4edb-9ac9-47b670ceddcf req-97b01042-4ea9-4560-aefb-0507c639b1fd service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:28:51 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-8ceb01fa-6ba5-4edb-9ac9-47b670ceddcf req-97b01042-4ea9-4560-aefb-0507c639b1fd service nova] Creating event network-vif-plugged:d68dc4c7-5e6e-4d7f-8143-62eeb1816486 for instance 0f52d9e3-921c-4f79-9cdb-7d73500c8c35 on user Apr 13 16:28:51 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [req-8ceb01fa-6ba5-4edb-9ac9-47b670ceddcf req-97b01042-4ea9-4560-aefb-0507c639b1fd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051923 Apr 13 16:28:51 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 161/483] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:28:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:28:52 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [req-e7f832fc-c2b2-4c3f-b329-98198bf6c67e req-51cbfe2c-5f9a-42d8-be57-2e70a8b5b16c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f52d9e3-921c-4f79-9cdb-7d73500c8c35", "name": "network-vif-deleted", "tag": "d68dc4c7-5e6e-4d7f-8143-62eeb1816486"}, {"name": "network-changed", "server_uuid": "650427bd-4dad-4bcd-922d-c17e60b36807", "tag": "c6fe8d62-f2ba-44d6-a5e3-da6f35679b3f"}]} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:28:52 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-e7f832fc-c2b2-4c3f-b329-98198bf6c67e req-51cbfe2c-5f9a-42d8-be57-2e70a8b5b16c service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:28:52 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-e7f832fc-c2b2-4c3f-b329-98198bf6c67e req-51cbfe2c-5f9a-42d8-be57-2e70a8b5b16c service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:28:52 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-e7f832fc-c2b2-4c3f-b329-98198bf6c67e req-51cbfe2c-5f9a-42d8-be57-2e70a8b5b16c service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:28:53 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-e7f832fc-c2b2-4c3f-b329-98198bf6c67e req-51cbfe2c-5f9a-42d8-be57-2e70a8b5b16c service nova] Creating event network-vif-deleted:d68dc4c7-5e6e-4d7f-8143-62eeb1816486 for instance 0f52d9e3-921c-4f79-9cdb-7d73500c8c35 on user Apr 13 16:28:53 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-e7f832fc-c2b2-4c3f-b329-98198bf6c67e req-51cbfe2c-5f9a-42d8-be57-2e70a8b5b16c service nova] Creating event network-changed:c6fe8d62-f2ba-44d6-a5e3-da6f35679b3f for instance 650427bd-4dad-4bcd-922d-c17e60b36807 on user Apr 13 16:28:53 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [req-e7f832fc-c2b2-4c3f-b329-98198bf6c67e req-51cbfe2c-5f9a-42d8-be57-2e70a8b5b16c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.034530 Apr 13 16:28:53 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 160/484] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:28:52 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:28:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-5d13024c-a1d8-4158-892a-42d361bbbc95 req-a4cbe64c-3205-43af-9677-987b64a6dd89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "650427bd-4dad-4bcd-922d-c17e60b36807", "name": "network-vif-plugged", "status": "completed", "tag": "c6fe8d62-f2ba-44d6-a5e3-da6f35679b3f"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:28:54 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-5d13024c-a1d8-4158-892a-42d361bbbc95 req-a4cbe64c-3205-43af-9677-987b64a6dd89 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:28:54 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-5d13024c-a1d8-4158-892a-42d361bbbc95 req-a4cbe64c-3205-43af-9677-987b64a6dd89 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:28:54 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-5d13024c-a1d8-4158-892a-42d361bbbc95 req-a4cbe64c-3205-43af-9677-987b64a6dd89 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:28:54 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-5d13024c-a1d8-4158-892a-42d361bbbc95 req-a4cbe64c-3205-43af-9677-987b64a6dd89 service nova] Creating event network-vif-plugged:c6fe8d62-f2ba-44d6-a5e3-da6f35679b3f for instance 650427bd-4dad-4bcd-922d-c17e60b36807 on user Apr 13 16:28:54 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [req-5d13024c-a1d8-4158-892a-42d361bbbc95 req-a4cbe64c-3205-43af-9677-987b64a6dd89 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042536 Apr 13 16:28:54 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 164/485] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:28:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:28:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-35f794da-d6be-4ea5-a208-dff68ae83cf0 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:28:54 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-35f794da-d6be-4ea5-a208-dff68ae83cf0 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:28:54 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-35f794da-d6be-4ea5-a208-dff68ae83cf0 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:28:54 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-35f794da-d6be-4ea5-a208-dff68ae83cf0 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:28:54 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-35f794da-d6be-4ea5-a208-dff68ae83cf0 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:28:54 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-35f794da-d6be-4ea5-a208-dff68ae83cf0 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:28:54 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-35f794da-d6be-4ea5-a208-dff68ae83cf0 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:28:54 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-35f794da-d6be-4ea5-a208-dff68ae83cf0 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:28:54 user devstack@n-api.service[62053]: DEBUG nova.policy [None req-35f794da-d6be-4ea5-a208-dff68ae83cf0 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fab402fb794a5a9281cfb7fe188813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24904988cf334657b084fd726c7ecf8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62053) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:28:54 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-35f794da-d6be-4ea5-a208-dff68ae83cf0 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eaae47b9-a059-49f6-9ae6-d7147003e2f2" status: 200 len: 1702 microversion: 2.1 time: 0.159084 Apr 13 16:28:54 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 162/486] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:28:54 2023] GET /compute/v2.1/servers/eaae47b9-a059-49f6-9ae6-d7147003e2f2 => generated 1702 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:28:56 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_cell0:SELECT=2 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:28:56 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [req-e6065c98-03a5-459e-9c1f-025a7c954eac req-68fc3da0-a0c5-4981-a074-32e0ce18bc47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "650427bd-4dad-4bcd-922d-c17e60b36807", "name": "network-vif-plugged", "status": "completed", "tag": "c6fe8d62-f2ba-44d6-a5e3-da6f35679b3f"}]} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:28:56 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:28:56 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-e6065c98-03a5-459e-9c1f-025a7c954eac req-68fc3da0-a0c5-4981-a074-32e0ce18bc47 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:28:56 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-e6065c98-03a5-459e-9c1f-025a7c954eac req-68fc3da0-a0c5-4981-a074-32e0ce18bc47 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:28:56 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-e6065c98-03a5-459e-9c1f-025a7c954eac req-68fc3da0-a0c5-4981-a074-32e0ce18bc47 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:28:56 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-e6065c98-03a5-459e-9c1f-025a7c954eac req-68fc3da0-a0c5-4981-a074-32e0ce18bc47 service nova] Creating event network-vif-plugged:c6fe8d62-f2ba-44d6-a5e3-da6f35679b3f for instance 650427bd-4dad-4bcd-922d-c17e60b36807 on user Apr 13 16:28:56 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [req-e6065c98-03a5-459e-9c1f-025a7c954eac req-68fc3da0-a0c5-4981-a074-32e0ce18bc47 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036169 Apr 13 16:28:56 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 161/487] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:28:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 16:28:59 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_cell0:SELECT=6 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:28:59 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-a7a6d389-73bf-49bc-8067-cb544cc0a4fd tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:28:59 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-a7a6d389-73bf-49bc-8067-cb544cc0a4fd tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] [instance: 0e731607-fce1-4f19-9e4b-5b892e760179] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:28:59 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=2 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:28:59 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-a7a6d389-73bf-49bc-8067-cb544cc0a4fd tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:28:59 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-a7a6d389-73bf-49bc-8067-cb544cc0a4fd tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:28:59 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-a7a6d389-73bf-49bc-8067-cb544cc0a4fd tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:28:59 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-a7a6d389-73bf-49bc-8067-cb544cc0a4fd tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:28:59 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-a7a6d389-73bf-49bc-8067-cb544cc0a4fd tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:28:59 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-a7a6d389-73bf-49bc-8067-cb544cc0a4fd tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:28:59 user devstack@n-api.service[62054]: INFO nova.api.openstack.wsgi [None req-a7a6d389-73bf-49bc-8067-cb544cc0a4fd tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] HTTP exception thrown: Instance 0e731607-fce1-4f19-9e4b-5b892e760179 could not be found. Apr 13 16:28:59 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-a7a6d389-73bf-49bc-8067-cb544cc0a4fd tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Request method failure captured: Apr 13 16:28:59 user devstack@n-api.service[62054]: request: DELETE /compute/v2.1/servers/0e731607-fce1-4f19-9e4b-5b892e760179 HTTP/1.1 Apr 13 16:28:59 user devstack@n-api.service[62054]: Accept: application/json Apr 13 16:28:59 user devstack@n-api.service[62054]: Accept-Encoding: identity Apr 13 16:28:59 user devstack@n-api.service[62054]: Connection: close Apr 13 16:28:59 user devstack@n-api.service[62054]: Content-Length: 0 Apr 13 16:28:59 user devstack@n-api.service[62054]: Content-Type: application/json Apr 13 16:28:59 user devstack@n-api.service[62054]: Host: 10.0.0.210 Apr 13 16:28:59 user devstack@n-api.service[62054]: Openstack-System-Scope: None Apr 13 16:28:59 user devstack@n-api.service[62054]: User-Agent: python-urllib3/1.26.15 Apr 13 16:28:59 user devstack@n-api.service[62054]: X-Auth-Token: gAAAAABkOCu7xvmudBrBXBLs2SCBDcK71oPknaVoa5c212HJ1YH5D1qqQ770FnyyQ769HR4gN3MWc8D4DgjQEtN69nkpO07yNpJgb9N95gGXJDJugJy1OfGoQrI6zjE_4e0z9MJFRRuCNbIXu0Si5G6jJIciNJHiNV9wx9koSjgJs77kT-szNSc Apr 13 16:28:59 user devstack@n-api.service[62054]: X-Domain-Id: None Apr 13 16:28:59 user devstack@n-api.service[62054]: X-Domain-Name: None Apr 13 16:28:59 user devstack@n-api.service[62054]: X-Identity-Status: Confirmed Apr 13 16:28:59 user devstack@n-api.service[62054]: X-Is-Admin-Project: True Apr 13 16:28:59 user devstack@n-api.service[62054]: X-Project-Domain-Id: default Apr 13 16:28:59 user devstack@n-api.service[62054]: X-Project-Domain-Name: Default Apr 13 16:28:59 user devstack@n-api.service[62054]: X-Project-Id: 5554aa7f1b4d471b8807a845ab1ea33f Apr 13 16:28:59 user devstack@n-api.service[62054]: X-Project-Name: tempest-ServersNegativeTestJSON-1820659348 Apr 13 16:28:59 user devstack@n-api.service[62054]: X-Role: reader,member Apr 13 16:28:59 user devstack@n-api.service[62054]: X-Roles: reader,member Apr 13 16:28:59 user devstack@n-api.service[62054]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5554aa7f1b4d471b8807a845ab1ea33f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5554aa7f1b4d471b8807a845ab1ea33f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5554aa7f1b4d471b8807a845ab1ea33f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 13 16:28:59 user devstack@n-api.service[62054]: X-Tenant: tempest-ServersNegativeTestJSON-1820659348 Apr 13 16:28:59 user devstack@n-api.service[62054]: X-Tenant-Id: 5554aa7f1b4d471b8807a845ab1ea33f Apr 13 16:28:59 user devstack@n-api.service[62054]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1820659348 Apr 13 16:28:59 user devstack@n-api.service[62054]: X-User: tempest-ServersNegativeTestJSON-1820659348-project-member Apr 13 16:28:59 user devstack@n-api.service[62054]: X-User-Domain-Id: default Apr 13 16:28:59 user devstack@n-api.service[62054]: X-User-Domain-Name: Default Apr 13 16:28:59 user devstack@n-api.service[62054]: X-User-Id: 4ddd547d240b43ccb213e9d459082309 Apr 13 16:28:59 user devstack@n-api.service[62054]: X-User-Name: tempest-ServersNegativeTestJSON-1820659348-project-member Apr 13 16:28:59 user devstack@n-api.service[62054]: method: > Apr 13 16:28:59 user devstack@n-api.service[62054]: exception: Instance 0e731607-fce1-4f19-9e4b-5b892e760179 could not be found. Apr 13 16:28:59 user devstack@n-api.service[62054]: action_args: {'id': '0e731607-fce1-4f19-9e4b-5b892e760179'} Apr 13 16:28:59 user devstack@n-api.service[62054]: {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 16:28:59 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:28:59 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 16:28:59 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 16:28:59 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 16:28:59 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 16:28:59 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 16:28:59 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 16:28:59 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 16:28:59 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 16:28:59 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e731607-fce1-4f19-9e4b-5b892e760179 could not be found. Apr 13 16:28:59 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:28:59 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:28:59 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:28:59 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:28:59 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 16:28:59 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 16:28:59 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 16:28:59 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 16:28:59 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 16:28:59 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 16:28:59 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 16:28:59 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 16:28:59 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 16:28:59 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 16:28:59 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 16:28:59 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 16:28:59 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 16:28:59 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 16:28:59 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e731607-fce1-4f19-9e4b-5b892e760179 could not be found. Apr 13 16:28:59 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:28:59 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:28:59 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:28:59 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:28:59 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 16:28:59 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 16:28:59 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 16:28:59 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 16:28:59 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e731607-fce1-4f19-9e4b-5b892e760179 could not be found. Apr 13 16:28:59 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:28:59 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-a7a6d389-73bf-49bc-8067-cb544cc0a4fd tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Returning 404 to user: Instance 0e731607-fce1-4f19-9e4b-5b892e760179 could not be found. {{(pid=62054) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 16:28:59 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-a7a6d389-73bf-49bc-8067-cb544cc0a4fd tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0e731607-fce1-4f19-9e4b-5b892e760179" status: 404 len: 111 microversion: 2.1 time: 0.034325 Apr 13 16:28:59 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 165/488] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 16:28:59 2023] DELETE /compute/v2.1/servers/0e731607-fce1-4f19-9e4b-5b892e760179 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 16:28:59 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-c0d1e69a-6025-476c-ab35-4ffa83abb2fb tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:28:59 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-c0d1e69a-6025-476c-ab35-4ffa83abb2fb tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] [instance: 0e731607-fce1-4f19-9e4b-5b892e760179] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:28:59 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_cell0:SELECT=4 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:28:59 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_cell0:SELECT=12 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:28:59 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=9,nova_api:DELETE=1 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:28:59 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-c0d1e69a-6025-476c-ab35-4ffa83abb2fb tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:28:59 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-c0d1e69a-6025-476c-ab35-4ffa83abb2fb tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:28:59 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-c0d1e69a-6025-476c-ab35-4ffa83abb2fb tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:28:59 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-c0d1e69a-6025-476c-ab35-4ffa83abb2fb tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:28:59 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-c0d1e69a-6025-476c-ab35-4ffa83abb2fb tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:28:59 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-c0d1e69a-6025-476c-ab35-4ffa83abb2fb tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:28:59 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_cell1:SELECT=23 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:28:59 user devstack@n-api.service[62053]: INFO nova.api.openstack.wsgi [None req-c0d1e69a-6025-476c-ab35-4ffa83abb2fb tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] HTTP exception thrown: Instance 0e731607-fce1-4f19-9e4b-5b892e760179 could not be found. Apr 13 16:28:59 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-c0d1e69a-6025-476c-ab35-4ffa83abb2fb tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Request method failure captured: Apr 13 16:28:59 user devstack@n-api.service[62053]: request: GET /compute/v2.1/servers/0e731607-fce1-4f19-9e4b-5b892e760179 HTTP/1.1 Apr 13 16:28:59 user devstack@n-api.service[62053]: Accept: application/json Apr 13 16:28:59 user devstack@n-api.service[62053]: Accept-Encoding: identity Apr 13 16:28:59 user devstack@n-api.service[62053]: Connection: close Apr 13 16:28:59 user devstack@n-api.service[62053]: Content-Length: 0 Apr 13 16:28:59 user devstack@n-api.service[62053]: Content-Type: application/json Apr 13 16:28:59 user devstack@n-api.service[62053]: Host: 10.0.0.210 Apr 13 16:28:59 user devstack@n-api.service[62053]: Openstack-System-Scope: None Apr 13 16:28:59 user devstack@n-api.service[62053]: User-Agent: python-urllib3/1.26.15 Apr 13 16:28:59 user devstack@n-api.service[62053]: X-Auth-Token: gAAAAABkOCu7xvmudBrBXBLs2SCBDcK71oPknaVoa5c212HJ1YH5D1qqQ770FnyyQ769HR4gN3MWc8D4DgjQEtN69nkpO07yNpJgb9N95gGXJDJugJy1OfGoQrI6zjE_4e0z9MJFRRuCNbIXu0Si5G6jJIciNJHiNV9wx9koSjgJs77kT-szNSc Apr 13 16:28:59 user devstack@n-api.service[62053]: X-Domain-Id: None Apr 13 16:28:59 user devstack@n-api.service[62053]: X-Domain-Name: None Apr 13 16:28:59 user devstack@n-api.service[62053]: X-Identity-Status: Confirmed Apr 13 16:28:59 user devstack@n-api.service[62053]: X-Is-Admin-Project: True Apr 13 16:28:59 user devstack@n-api.service[62053]: X-Project-Domain-Id: default Apr 13 16:28:59 user devstack@n-api.service[62053]: X-Project-Domain-Name: Default Apr 13 16:28:59 user devstack@n-api.service[62053]: X-Project-Id: 5554aa7f1b4d471b8807a845ab1ea33f Apr 13 16:28:59 user devstack@n-api.service[62053]: X-Project-Name: tempest-ServersNegativeTestJSON-1820659348 Apr 13 16:28:59 user devstack@n-api.service[62053]: X-Role: reader,member Apr 13 16:28:59 user devstack@n-api.service[62053]: X-Roles: reader,member Apr 13 16:28:59 user devstack@n-api.service[62053]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5554aa7f1b4d471b8807a845ab1ea33f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5554aa7f1b4d471b8807a845ab1ea33f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5554aa7f1b4d471b8807a845ab1ea33f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 13 16:28:59 user devstack@n-api.service[62053]: X-Tenant: tempest-ServersNegativeTestJSON-1820659348 Apr 13 16:28:59 user devstack@n-api.service[62053]: X-Tenant-Id: 5554aa7f1b4d471b8807a845ab1ea33f Apr 13 16:28:59 user devstack@n-api.service[62053]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1820659348 Apr 13 16:28:59 user devstack@n-api.service[62053]: X-User: tempest-ServersNegativeTestJSON-1820659348-project-member Apr 13 16:28:59 user devstack@n-api.service[62053]: X-User-Domain-Id: default Apr 13 16:28:59 user devstack@n-api.service[62053]: X-User-Domain-Name: Default Apr 13 16:28:59 user devstack@n-api.service[62053]: X-User-Id: 4ddd547d240b43ccb213e9d459082309 Apr 13 16:28:59 user devstack@n-api.service[62053]: X-User-Name: tempest-ServersNegativeTestJSON-1820659348-project-member Apr 13 16:28:59 user devstack@n-api.service[62053]: method: > Apr 13 16:28:59 user devstack@n-api.service[62053]: exception: Instance 0e731607-fce1-4f19-9e4b-5b892e760179 could not be found. Apr 13 16:28:59 user devstack@n-api.service[62053]: action_args: {'id': '0e731607-fce1-4f19-9e4b-5b892e760179'} Apr 13 16:28:59 user devstack@n-api.service[62053]: {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 16:28:59 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:28:59 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 16:28:59 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 16:28:59 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 16:28:59 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 16:28:59 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 16:28:59 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 16:28:59 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 16:28:59 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 16:28:59 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e731607-fce1-4f19-9e4b-5b892e760179 could not be found. Apr 13 16:28:59 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:28:59 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:28:59 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:28:59 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:28:59 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 16:28:59 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 16:28:59 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 16:28:59 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 16:28:59 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 16:28:59 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 16:28:59 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 16:28:59 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 16:28:59 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 16:28:59 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 16:28:59 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 16:28:59 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 16:28:59 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e731607-fce1-4f19-9e4b-5b892e760179 could not be found. Apr 13 16:28:59 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:28:59 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:28:59 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:28:59 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:28:59 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 16:28:59 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 16:28:59 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 16:28:59 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 16:28:59 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e731607-fce1-4f19-9e4b-5b892e760179 could not be found. Apr 13 16:28:59 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:28:59 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-c0d1e69a-6025-476c-ab35-4ffa83abb2fb tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Returning 404 to user: Instance 0e731607-fce1-4f19-9e4b-5b892e760179 could not be found. {{(pid=62053) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 16:28:59 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-c0d1e69a-6025-476c-ab35-4ffa83abb2fb tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0e731607-fce1-4f19-9e4b-5b892e760179" status: 404 len: 111 microversion: 2.1 time: 0.041542 Apr 13 16:28:59 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 163/489] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:28:59 2023] GET /compute/v2.1/servers/0e731607-fce1-4f19-9e4b-5b892e760179 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 16:28:59 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-2fb4fee4-773b-4925-8dd6-11c258205815 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:28:59 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-2fb4fee4-773b-4925-8dd6-11c258205815 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] [instance: 7973e93b-6311-44ed-91ff-e861c32d0277] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:28:59 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-2fb4fee4-773b-4925-8dd6-11c258205815 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:28:59 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-2fb4fee4-773b-4925-8dd6-11c258205815 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:28:59 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-2fb4fee4-773b-4925-8dd6-11c258205815 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:28:59 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-2fb4fee4-773b-4925-8dd6-11c258205815 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:28:59 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-2fb4fee4-773b-4925-8dd6-11c258205815 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:28:59 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-2fb4fee4-773b-4925-8dd6-11c258205815 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:28:59 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-2fb4fee4-773b-4925-8dd6-11c258205815 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] [instance: 7973e93b-6311-44ed-91ff-e861c32d0277] Going to try to terminate instance {{(pid=62055) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 16:28:59 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-2fb4fee4-773b-4925-8dd6-11c258205815 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/7973e93b-6311-44ed-91ff-e861c32d0277" status: 204 len: 0 microversion: 2.1 time: 0.122104 Apr 13 16:28:59 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 162/490] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 16:28:59 2023] DELETE /compute/v2.1/servers/7973e93b-6311-44ed-91ff-e861c32d0277 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 16:28:59 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-9fe2d879-b8b1-48af-8b9d-f3105f8c2276 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:28:59 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-9fe2d879-b8b1-48af-8b9d-f3105f8c2276 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] [instance: 7973e93b-6311-44ed-91ff-e861c32d0277] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:28:59 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-9fe2d879-b8b1-48af-8b9d-f3105f8c2276 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:28:59 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-9fe2d879-b8b1-48af-8b9d-f3105f8c2276 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:28:59 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-9fe2d879-b8b1-48af-8b9d-f3105f8c2276 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:28:59 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-9fe2d879-b8b1-48af-8b9d-f3105f8c2276 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:28:59 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-9fe2d879-b8b1-48af-8b9d-f3105f8c2276 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:28:59 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-9fe2d879-b8b1-48af-8b9d-f3105f8c2276 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:29:00 user devstack@n-api.service[62054]: DEBUG nova.policy [None req-9fe2d879-b8b1-48af-8b9d-f3105f8c2276 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ddd547d240b43ccb213e9d459082309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5554aa7f1b4d471b8807a845ab1ea33f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62054) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:29:00 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-9fe2d879-b8b1-48af-8b9d-f3105f8c2276 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7973e93b-6311-44ed-91ff-e861c32d0277" status: 200 len: 1499 microversion: 2.1 time: 0.282400 Apr 13 16:29:00 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 166/491] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:28:59 2023] GET /compute/v2.1/servers/7973e93b-6311-44ed-91ff-e861c32d0277 => generated 1499 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:29:00 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-58291c53-8365-4f59-89e8-f44ca313d475 req-a2046c69-b1f6-434a-8e9a-d980f6efa5a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7973e93b-6311-44ed-91ff-e861c32d0277", "name": "network-vif-unplugged", "status": "completed", "tag": "8ae83a6c-4fc7-4e2c-8f83-7aece5c239cd"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:29:00 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-58291c53-8365-4f59-89e8-f44ca313d475 req-a2046c69-b1f6-434a-8e9a-d980f6efa5a3 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:29:00 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-58291c53-8365-4f59-89e8-f44ca313d475 req-a2046c69-b1f6-434a-8e9a-d980f6efa5a3 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:29:00 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-58291c53-8365-4f59-89e8-f44ca313d475 req-a2046c69-b1f6-434a-8e9a-d980f6efa5a3 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:29:00 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-58291c53-8365-4f59-89e8-f44ca313d475 req-a2046c69-b1f6-434a-8e9a-d980f6efa5a3 service nova] Creating event network-vif-unplugged:8ae83a6c-4fc7-4e2c-8f83-7aece5c239cd for instance 7973e93b-6311-44ed-91ff-e861c32d0277 on user Apr 13 16:29:00 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [req-58291c53-8365-4f59-89e8-f44ca313d475 req-a2046c69-b1f6-434a-8e9a-d980f6efa5a3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030102 Apr 13 16:29:00 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 164/492] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:29:00 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:29:01 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [req-d58f29cb-363b-44a8-b295-b07a0da8eb16 req-d9f21674-c9c8-4bcf-abee-e893516b2bdd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7973e93b-6311-44ed-91ff-e861c32d0277", "name": "network-vif-deleted", "tag": "8ae83a6c-4fc7-4e2c-8f83-7aece5c239cd"}]} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:29:01 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-d58f29cb-363b-44a8-b295-b07a0da8eb16 req-d9f21674-c9c8-4bcf-abee-e893516b2bdd service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:29:01 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-d58f29cb-363b-44a8-b295-b07a0da8eb16 req-d9f21674-c9c8-4bcf-abee-e893516b2bdd service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:29:01 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-d58f29cb-363b-44a8-b295-b07a0da8eb16 req-d9f21674-c9c8-4bcf-abee-e893516b2bdd service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:29:01 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-d58f29cb-363b-44a8-b295-b07a0da8eb16 req-d9f21674-c9c8-4bcf-abee-e893516b2bdd service nova] Creating event network-vif-deleted:8ae83a6c-4fc7-4e2c-8f83-7aece5c239cd for instance 7973e93b-6311-44ed-91ff-e861c32d0277 on user Apr 13 16:29:01 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [req-d58f29cb-363b-44a8-b295-b07a0da8eb16 req-d9f21674-c9c8-4bcf-abee-e893516b2bdd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040917 Apr 13 16:29:01 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 163/493] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:29:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:29:02 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-461ce698-9712-4315-92ff-420c7d2e5d15 req-c5ea474e-5949-4775-92ef-2618c0721499 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7973e93b-6311-44ed-91ff-e861c32d0277", "name": "network-vif-plugged", "status": "completed", "tag": "8ae83a6c-4fc7-4e2c-8f83-7aece5c239cd"}, {"server_uuid": "7973e93b-6311-44ed-91ff-e861c32d0277", "name": "network-vif-plugged", "status": "completed", "tag": "8ae83a6c-4fc7-4e2c-8f83-7aece5c239cd"}, {"server_uuid": "7973e93b-6311-44ed-91ff-e861c32d0277", "name": "network-vif-plugged", "status": "completed", "tag": "8ae83a6c-4fc7-4e2c-8f83-7aece5c239cd"}, {"server_uuid": "7973e93b-6311-44ed-91ff-e861c32d0277", "name": "network-vif-plugged", "status": "completed", "tag": "8ae83a6c-4fc7-4e2c-8f83-7aece5c239cd"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:29:02 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-461ce698-9712-4315-92ff-420c7d2e5d15 req-c5ea474e-5949-4775-92ef-2618c0721499 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:29:02 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-461ce698-9712-4315-92ff-420c7d2e5d15 req-c5ea474e-5949-4775-92ef-2618c0721499 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:29:02 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-461ce698-9712-4315-92ff-420c7d2e5d15 req-c5ea474e-5949-4775-92ef-2618c0721499 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:29:02 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-461ce698-9712-4315-92ff-420c7d2e5d15 req-c5ea474e-5949-4775-92ef-2618c0721499 service nova] Creating event network-vif-plugged:8ae83a6c-4fc7-4e2c-8f83-7aece5c239cd for instance 7973e93b-6311-44ed-91ff-e861c32d0277 on user Apr 13 16:29:02 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-461ce698-9712-4315-92ff-420c7d2e5d15 req-c5ea474e-5949-4775-92ef-2618c0721499 service nova] Creating event network-vif-plugged:8ae83a6c-4fc7-4e2c-8f83-7aece5c239cd for instance 7973e93b-6311-44ed-91ff-e861c32d0277 on user Apr 13 16:29:02 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-461ce698-9712-4315-92ff-420c7d2e5d15 req-c5ea474e-5949-4775-92ef-2618c0721499 service nova] Creating event network-vif-plugged:8ae83a6c-4fc7-4e2c-8f83-7aece5c239cd for instance 7973e93b-6311-44ed-91ff-e861c32d0277 on user Apr 13 16:29:02 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-461ce698-9712-4315-92ff-420c7d2e5d15 req-c5ea474e-5949-4775-92ef-2618c0721499 service nova] Creating event network-vif-plugged:8ae83a6c-4fc7-4e2c-8f83-7aece5c239cd for instance 7973e93b-6311-44ed-91ff-e861c32d0277 on user Apr 13 16:29:02 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [req-461ce698-9712-4315-92ff-420c7d2e5d15 req-c5ea474e-5949-4775-92ef-2618c0721499 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.051178 Apr 13 16:29:02 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 167/494] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:29:02 2023] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:29:15 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_api:SELECT=3 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:29:15 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_cell1:SELECT=3 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:29:15 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-6bfd2c29-81cb-4b08-9963-8db7a9bad627 tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1825993154", "imageRef": "708622a9-7465-4492-ade8-b827198f7e30", "flavorRef": "42"}} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:29:15 user devstack@n-api.service[62053]: DEBUG nova.network.neutron [None req-6bfd2c29-81cb-4b08-9963-8db7a9bad627 tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] validate_networks() for None {{(pid=62053) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 16:29:16 user devstack@n-api.service[62053]: DEBUG nova.virt.hardware [None req-6bfd2c29-81cb-4b08-9963-8db7a9bad627 tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] Flavor limits 0:0:0 {{(pid=62053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 16:29:16 user devstack@n-api.service[62053]: DEBUG nova.virt.hardware [None req-6bfd2c29-81cb-4b08-9963-8db7a9bad627 tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] Image limits 0:0:0 {{(pid=62053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 16:29:16 user devstack@n-api.service[62053]: DEBUG nova.virt.hardware [None req-6bfd2c29-81cb-4b08-9963-8db7a9bad627 tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] Flavor pref 0:0:0 {{(pid=62053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 16:29:16 user devstack@n-api.service[62053]: DEBUG nova.virt.hardware [None req-6bfd2c29-81cb-4b08-9963-8db7a9bad627 tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] Image pref 0:0:0 {{(pid=62053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 16:29:16 user devstack@n-api.service[62053]: DEBUG nova.virt.hardware [None req-6bfd2c29-81cb-4b08-9963-8db7a9bad627 tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 16:29:16 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-6bfd2c29-81cb-4b08-9963-8db7a9bad627 tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:29:16 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-6bfd2c29-81cb-4b08-9963-8db7a9bad627 tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:29:16 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-6bfd2c29-81cb-4b08-9963-8db7a9bad627 tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:29:16 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-6bfd2c29-81cb-4b08-9963-8db7a9bad627 tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:29:16 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-6bfd2c29-81cb-4b08-9963-8db7a9bad627 tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:29:16 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-6bfd2c29-81cb-4b08-9963-8db7a9bad627 tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:29:16 user devstack@n-api.service[62053]: DEBUG nova.quota [None req-6bfd2c29-81cb-4b08-9963-8db7a9bad627 tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] Getting quotas for project c33101d535154c9a88cae865ee7ece46. Resources: {'instances', 'cores', 'ram'} {{(pid=62053) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 16:29:16 user devstack@n-api.service[62053]: DEBUG nova.quota [None req-6bfd2c29-81cb-4b08-9963-8db7a9bad627 tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] Getting quotas for user d7f9678e69654526b4d5dc9de05ac090 and project c33101d535154c9a88cae865ee7ece46. Resources: {'instances', 'cores', 'ram'} {{(pid=62053) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 16:29:16 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-6bfd2c29-81cb-4b08-9963-8db7a9bad627 tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] Going to run 1 instances... {{(pid=62053) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 16:29:16 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-6bfd2c29-81cb-4b08-9963-8db7a9bad627 tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] [instance: 71a2163b-fb6b-4b71-b93f-d682ad141b84] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='708622a9-7465-4492-ade8-b827198f7e30',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=62053) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 16:29:16 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-6bfd2c29-81cb-4b08-9963-8db7a9bad627 tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.376018 Apr 13 16:29:16 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 165/495] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 16:29:15 2023] POST /compute/v2.1/servers => generated 378 bytes in 377 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 16:29:16 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_api:SELECT=10,nova_api:UPDATE=1 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:29:16 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:29:16 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-719dbdf6-21fe-49b7-a2a2-0740fc684e13 tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:29:16 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-719dbdf6-21fe-49b7-a2a2-0740fc684e13 tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] [instance: 71a2163b-fb6b-4b71-b93f-d682ad141b84] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:29:16 user devstack@n-api.service[62055]: DEBUG nova.policy [None req-719dbdf6-21fe-49b7-a2a2-0740fc684e13 tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f9678e69654526b4d5dc9de05ac090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33101d535154c9a88cae865ee7ece46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62055) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:29:16 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-719dbdf6-21fe-49b7-a2a2-0740fc684e13 tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] 10.0.0.210 "GET /compute/v2.1/servers/71a2163b-fb6b-4b71-b93f-d682ad141b84" status: 200 len: 1209 microversion: 2.1 time: 0.092605 Apr 13 16:29:16 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 164/496] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:29:16 2023] GET /compute/v2.1/servers/71a2163b-fb6b-4b71-b93f-d682ad141b84 => generated 1209 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:29:18 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_api:SELECT=5 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:29:18 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_cell1:SELECT=18 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:29:18 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-d8f98cd1-15b6-42db-8781-8177e5315339 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:29:18 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-d8f98cd1-15b6-42db-8781-8177e5315339 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:29:18 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-d8f98cd1-15b6-42db-8781-8177e5315339 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:29:18 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-d8f98cd1-15b6-42db-8781-8177e5315339 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:29:18 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-d8f98cd1-15b6-42db-8781-8177e5315339 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:29:18 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-d8f98cd1-15b6-42db-8781-8177e5315339 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:29:18 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-d8f98cd1-15b6-42db-8781-8177e5315339 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:29:18 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-d8f98cd1-15b6-42db-8781-8177e5315339 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:29:18 user devstack@n-api.service[62054]: DEBUG nova.policy [None req-d8f98cd1-15b6-42db-8781-8177e5315339 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1318d817c48e40988e043fa33e908312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e15bc7bee7466a840fb0d0e85d58bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62054) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:29:18 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-d8f98cd1-15b6-42db-8781-8177e5315339 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bf98c3a2-dbeb-4ae4-8423-ce55964c4258" status: 200 len: 1567 microversion: 2.1 time: 0.173793 Apr 13 16:29:18 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 168/497] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:29:18 2023] GET /compute/v2.1/servers/bf98c3a2-dbeb-4ae4-8423-ce55964c4258 => generated 1567 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:29:19 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-8bd6e647-cd89-4d58-8bd8-bfbf762ade2c req-67e0b20e-46ca-4da1-91ec-d62cde17fdf3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71a2163b-fb6b-4b71-b93f-d682ad141b84", "tag": "da3b7e52-803c-4172-a058-238c8dcedbbc"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:29:19 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-8bd6e647-cd89-4d58-8bd8-bfbf762ade2c req-67e0b20e-46ca-4da1-91ec-d62cde17fdf3 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:29:19 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-8bd6e647-cd89-4d58-8bd8-bfbf762ade2c req-67e0b20e-46ca-4da1-91ec-d62cde17fdf3 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:29:19 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-8bd6e647-cd89-4d58-8bd8-bfbf762ade2c req-67e0b20e-46ca-4da1-91ec-d62cde17fdf3 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:29:19 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-8bd6e647-cd89-4d58-8bd8-bfbf762ade2c req-67e0b20e-46ca-4da1-91ec-d62cde17fdf3 service nova] Creating event network-changed:da3b7e52-803c-4172-a058-238c8dcedbbc for instance 71a2163b-fb6b-4b71-b93f-d682ad141b84 on user Apr 13 16:29:19 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [req-8bd6e647-cd89-4d58-8bd8-bfbf762ade2c req-67e0b20e-46ca-4da1-91ec-d62cde17fdf3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035197 Apr 13 16:29:19 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 166/498] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:29:19 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:29:21 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [req-77dff801-3c2e-40cd-9abc-d2097d5ccd97 req-f0c9af4a-2389-40c3-a7f6-d58049c68415 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71a2163b-fb6b-4b71-b93f-d682ad141b84", "name": "network-vif-plugged", "status": "completed", "tag": "da3b7e52-803c-4172-a058-238c8dcedbbc"}]} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:29:21 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-77dff801-3c2e-40cd-9abc-d2097d5ccd97 req-f0c9af4a-2389-40c3-a7f6-d58049c68415 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:29:21 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-77dff801-3c2e-40cd-9abc-d2097d5ccd97 req-f0c9af4a-2389-40c3-a7f6-d58049c68415 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:29:21 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-77dff801-3c2e-40cd-9abc-d2097d5ccd97 req-f0c9af4a-2389-40c3-a7f6-d58049c68415 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:29:21 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-77dff801-3c2e-40cd-9abc-d2097d5ccd97 req-f0c9af4a-2389-40c3-a7f6-d58049c68415 service nova] Creating event network-vif-plugged:da3b7e52-803c-4172-a058-238c8dcedbbc for instance 71a2163b-fb6b-4b71-b93f-d682ad141b84 on user Apr 13 16:29:21 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [req-77dff801-3c2e-40cd-9abc-d2097d5ccd97 req-f0c9af4a-2389-40c3-a7f6-d58049c68415 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033036 Apr 13 16:29:21 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 165/499] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:29:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:29:23 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-2e6284fe-c36f-49b1-a725-7e6bd3ca6e56 req-39cf557a-5e15-4023-8db7-294062b8fe3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71a2163b-fb6b-4b71-b93f-d682ad141b84", "name": "network-vif-plugged", "status": "completed", "tag": "da3b7e52-803c-4172-a058-238c8dcedbbc"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:29:23 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-2e6284fe-c36f-49b1-a725-7e6bd3ca6e56 req-39cf557a-5e15-4023-8db7-294062b8fe3a service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:29:23 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-2e6284fe-c36f-49b1-a725-7e6bd3ca6e56 req-39cf557a-5e15-4023-8db7-294062b8fe3a service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:29:23 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-2e6284fe-c36f-49b1-a725-7e6bd3ca6e56 req-39cf557a-5e15-4023-8db7-294062b8fe3a service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:29:23 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-2e6284fe-c36f-49b1-a725-7e6bd3ca6e56 req-39cf557a-5e15-4023-8db7-294062b8fe3a service nova] Creating event network-vif-plugged:da3b7e52-803c-4172-a058-238c8dcedbbc for instance 71a2163b-fb6b-4b71-b93f-d682ad141b84 on user Apr 13 16:29:23 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [req-2e6284fe-c36f-49b1-a725-7e6bd3ca6e56 req-39cf557a-5e15-4023-8db7-294062b8fe3a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030382 Apr 13 16:29:23 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 169/500] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:29:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:29:26 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-d81ab92d-46a6-4849-87d7-a3016bf8a4e2 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:29:26 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-d81ab92d-46a6-4849-87d7-a3016bf8a4e2 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:29:26 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-d81ab92d-46a6-4849-87d7-a3016bf8a4e2 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:29:26 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-d81ab92d-46a6-4849-87d7-a3016bf8a4e2 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:29:26 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-d81ab92d-46a6-4849-87d7-a3016bf8a4e2 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:29:26 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-d81ab92d-46a6-4849-87d7-a3016bf8a4e2 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:29:26 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-d81ab92d-46a6-4849-87d7-a3016bf8a4e2 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:29:26 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-d81ab92d-46a6-4849-87d7-a3016bf8a4e2 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:29:26 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_cell0:SELECT=2 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:29:26 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_cell0:SELECT=6 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:29:26 user devstack@n-api.service[62053]: DEBUG nova.policy [None req-d81ab92d-46a6-4849-87d7-a3016bf8a4e2 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b3df1c5c5d441819bcef89ed6966815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980559734a504574a83224deb7423c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62053) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:29:26 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-d81ab92d-46a6-4849-87d7-a3016bf8a4e2 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] 10.0.0.210 "GET /compute/v2.1/servers/acbcaee0-a47b-4fee-8765-9b1c9597d515" status: 200 len: 1723 microversion: 2.1 time: 0.335247 Apr 13 16:29:26 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 167/501] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:29:25 2023] GET /compute/v2.1/servers/acbcaee0-a47b-4fee-8765-9b1c9597d515 => generated 1723 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 13 16:29:26 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_cell0:SELECT=2 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:29:26 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-3a9db71f-b135-42ad-a1f5-91e594c13c45 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:29:26 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-3a9db71f-b135-42ad-a1f5-91e594c13c45 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:29:26 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-3a9db71f-b135-42ad-a1f5-91e594c13c45 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:29:26 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-3a9db71f-b135-42ad-a1f5-91e594c13c45 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:29:26 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-3a9db71f-b135-42ad-a1f5-91e594c13c45 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:29:26 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-3a9db71f-b135-42ad-a1f5-91e594c13c45 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:29:26 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-3a9db71f-b135-42ad-a1f5-91e594c13c45 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:29:26 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-3a9db71f-b135-42ad-a1f5-91e594c13c45 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:29:26 user devstack@n-api.service[62055]: DEBUG nova.policy [None req-3a9db71f-b135-42ad-a1f5-91e594c13c45 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b3df1c5c5d441819bcef89ed6966815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980559734a504574a83224deb7423c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62055) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:29:26 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-3a9db71f-b135-42ad-a1f5-91e594c13c45 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] 10.0.0.210 "GET /compute/v2.1/servers/acbcaee0-a47b-4fee-8765-9b1c9597d515" status: 200 len: 1723 microversion: 2.1 time: 0.199069 Apr 13 16:29:26 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 166/502] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:29:26 2023] GET /compute/v2.1/servers/acbcaee0-a47b-4fee-8765-9b1c9597d515 => generated 1723 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:29:33 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_api:SELECT=4 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:29:33 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_cell1:SELECT=8 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:29:33 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-fc031b11-3833-4f70-a282-eec11f905967 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:29:33 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-fc031b11-3833-4f70-a282-eec11f905967 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] [instance: 5d50f597-3a29-4335-8166-6ab8e8149376] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:29:33 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-fc031b11-3833-4f70-a282-eec11f905967 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:29:33 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-fc031b11-3833-4f70-a282-eec11f905967 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:29:33 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-fc031b11-3833-4f70-a282-eec11f905967 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:29:33 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-fc031b11-3833-4f70-a282-eec11f905967 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:29:33 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-fc031b11-3833-4f70-a282-eec11f905967 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:29:33 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-fc031b11-3833-4f70-a282-eec11f905967 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:29:33 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-fc031b11-3833-4f70-a282-eec11f905967 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5d50f597-3a29-4335-8166-6ab8e8149376/os-interface" status: 200 len: 283 microversion: 2.49 time: 0.102276 Apr 13 16:29:33 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 170/503] 10.0.0.210 () {64 vars in 1393 bytes} [Thu Apr 13 16:29:33 2023] GET /compute/v2.1/servers/5d50f597-3a29-4335-8166-6ab8e8149376/os-interface => generated 283 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 16:29:34 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-40d06f29-c1d2-4b6f-a7d4-d96bf9bb7cbb tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:29:34 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-40d06f29-c1d2-4b6f-a7d4-d96bf9bb7cbb tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] [instance: 32b18558-8bf2-4def-bc70-81c4e38fcc6f] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:29:34 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-40d06f29-c1d2-4b6f-a7d4-d96bf9bb7cbb tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:29:34 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-40d06f29-c1d2-4b6f-a7d4-d96bf9bb7cbb tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:29:34 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-40d06f29-c1d2-4b6f-a7d4-d96bf9bb7cbb tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:29:34 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-40d06f29-c1d2-4b6f-a7d4-d96bf9bb7cbb tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:29:34 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-40d06f29-c1d2-4b6f-a7d4-d96bf9bb7cbb tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:29:34 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-40d06f29-c1d2-4b6f-a7d4-d96bf9bb7cbb tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:29:34 user devstack@n-api.service[62053]: DEBUG nova.policy [None req-40d06f29-c1d2-4b6f-a7d4-d96bf9bb7cbb tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f523740272844b6eb236477d0b116ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7100b359f341759cb6f6753e1539a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62053) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:29:34 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-40d06f29-c1d2-4b6f-a7d4-d96bf9bb7cbb tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] 10.0.0.210 "GET /compute/v2.1/servers/32b18558-8bf2-4def-bc70-81c4e38fcc6f" status: 200 len: 1538 microversion: 2.1 time: 0.183444 Apr 13 16:29:34 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 168/504] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:29:34 2023] GET /compute/v2.1/servers/32b18558-8bf2-4def-bc70-81c4e38fcc6f => generated 1538 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 13 16:29:35 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [req-ac4c882a-87d8-4621-a63e-b4821140f626 req-cd942be9-4861-4cdc-9a07-1babebcd59a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d50f597-3a29-4335-8166-6ab8e8149376", "tag": "cde3b0f9-9ed1-4eba-8560-d5fa05166b2e"}]} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:29:35 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-ac4c882a-87d8-4621-a63e-b4821140f626 req-cd942be9-4861-4cdc-9a07-1babebcd59a0 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:29:35 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-ac4c882a-87d8-4621-a63e-b4821140f626 req-cd942be9-4861-4cdc-9a07-1babebcd59a0 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:29:35 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-ac4c882a-87d8-4621-a63e-b4821140f626 req-cd942be9-4861-4cdc-9a07-1babebcd59a0 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:29:35 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-ac4c882a-87d8-4621-a63e-b4821140f626 req-cd942be9-4861-4cdc-9a07-1babebcd59a0 service nova] Creating event network-changed:cde3b0f9-9ed1-4eba-8560-d5fa05166b2e for instance 5d50f597-3a29-4335-8166-6ab8e8149376 on user Apr 13 16:29:35 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [req-ac4c882a-87d8-4621-a63e-b4821140f626 req-cd942be9-4861-4cdc-9a07-1babebcd59a0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037792 Apr 13 16:29:35 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 167/505] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:29:35 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:29:35 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-f4d851bf-e53e-4470-897b-0cf990a2cf8b tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:29:35 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-f4d851bf-e53e-4470-897b-0cf990a2cf8b tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] [instance: 5d50f597-3a29-4335-8166-6ab8e8149376] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:29:35 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-f4d851bf-e53e-4470-897b-0cf990a2cf8b tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:29:35 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-f4d851bf-e53e-4470-897b-0cf990a2cf8b tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:29:35 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-f4d851bf-e53e-4470-897b-0cf990a2cf8b tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:29:35 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-f4d851bf-e53e-4470-897b-0cf990a2cf8b tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:29:35 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-f4d851bf-e53e-4470-897b-0cf990a2cf8b tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:29:35 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-f4d851bf-e53e-4470-897b-0cf990a2cf8b tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:29:35 user devstack@n-api.service[62054]: DEBUG nova.policy [None req-f4d851bf-e53e-4470-897b-0cf990a2cf8b tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa66202e2e5547d1b6e792557b335d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c33fd5889ce4d0b983f529767005267', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62054) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:29:35 user devstack@n-api.service[62054]: DEBUG nova.policy [None req-f4d851bf-e53e-4470-897b-0cf990a2cf8b tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa66202e2e5547d1b6e792557b335d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c33fd5889ce4d0b983f529767005267', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62054) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:29:35 user devstack@n-api.service[62054]: DEBUG nova.policy [None req-f4d851bf-e53e-4470-897b-0cf990a2cf8b tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa66202e2e5547d1b6e792557b335d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c33fd5889ce4d0b983f529767005267', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62054) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:29:35 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-f4d851bf-e53e-4470-897b-0cf990a2cf8b tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5d50f597-3a29-4335-8166-6ab8e8149376" status: 200 len: 1628 microversion: 2.49 time: 0.162799 Apr 13 16:29:35 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 171/506] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 16:29:35 2023] GET /compute/v2.1/servers/5d50f597-3a29-4335-8166-6ab8e8149376 => generated 1628 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 16:29:35 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-c43be997-c2da-443a-a90f-b31a5a50f870 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Action: 'create', calling method: >, body: {"interfaceAttachment": {"net_id": "80e09f45-b799-4c16-8c74-ee57ad2c4b6e", "tag": "nic-tag"}} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:29:35 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-c43be997-c2da-443a-a90f-b31a5a50f870 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] [instance: 5d50f597-3a29-4335-8166-6ab8e8149376] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:29:35 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-c43be997-c2da-443a-a90f-b31a5a50f870 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:29:35 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-c43be997-c2da-443a-a90f-b31a5a50f870 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:29:35 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-c43be997-c2da-443a-a90f-b31a5a50f870 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:29:35 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-c43be997-c2da-443a-a90f-b31a5a50f870 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:29:35 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-c43be997-c2da-443a-a90f-b31a5a50f870 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:29:35 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-c43be997-c2da-443a-a90f-b31a5a50f870 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:29:37 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [req-7dc52c63-9640-466a-9cbe-dedd9df61e4a req-8637e694-a25f-438f-b7a1-8fddae426f60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d50f597-3a29-4335-8166-6ab8e8149376", "tag": "deb6fd31-3a87-439d-b59c-4f4dbf9a11bc"}]} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:29:37 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-7dc52c63-9640-466a-9cbe-dedd9df61e4a req-8637e694-a25f-438f-b7a1-8fddae426f60 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:29:37 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-7dc52c63-9640-466a-9cbe-dedd9df61e4a req-8637e694-a25f-438f-b7a1-8fddae426f60 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:29:37 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-7dc52c63-9640-466a-9cbe-dedd9df61e4a req-8637e694-a25f-438f-b7a1-8fddae426f60 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:29:37 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-7dc52c63-9640-466a-9cbe-dedd9df61e4a req-8637e694-a25f-438f-b7a1-8fddae426f60 service nova] Creating event network-changed:deb6fd31-3a87-439d-b59c-4f4dbf9a11bc for instance 5d50f597-3a29-4335-8166-6ab8e8149376 on user Apr 13 16:29:37 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [req-7dc52c63-9640-466a-9cbe-dedd9df61e4a req-8637e694-a25f-438f-b7a1-8fddae426f60 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030987 Apr 13 16:29:37 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 168/507] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:29:37 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:29:38 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-9712e264-e805-4b7c-ab88-3296e455c4e0 req-9ab28491-6913-4637-9559-017a98c366ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d50f597-3a29-4335-8166-6ab8e8149376", "name": "network-vif-plugged", "status": "completed", "tag": "deb6fd31-3a87-439d-b59c-4f4dbf9a11bc"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:29:38 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-9712e264-e805-4b7c-ab88-3296e455c4e0 req-9ab28491-6913-4637-9559-017a98c366ac service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:29:38 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-9712e264-e805-4b7c-ab88-3296e455c4e0 req-9ab28491-6913-4637-9559-017a98c366ac service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:29:38 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-9712e264-e805-4b7c-ab88-3296e455c4e0 req-9ab28491-6913-4637-9559-017a98c366ac service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:29:38 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-9712e264-e805-4b7c-ab88-3296e455c4e0 req-9ab28491-6913-4637-9559-017a98c366ac service nova] Creating event network-vif-plugged:deb6fd31-3a87-439d-b59c-4f4dbf9a11bc for instance 5d50f597-3a29-4335-8166-6ab8e8149376 on user Apr 13 16:29:38 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [req-9712e264-e805-4b7c-ab88-3296e455c4e0 req-9ab28491-6913-4637-9559-017a98c366ac service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030650 Apr 13 16:29:38 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 172/508] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:29:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:29:38 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-c43be997-c2da-443a-a90f-b31a5a50f870 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] [instance: 5d50f597-3a29-4335-8166-6ab8e8149376] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:29:38 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-c43be997-c2da-443a-a90f-b31a5a50f870 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:29:38 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-c43be997-c2da-443a-a90f-b31a5a50f870 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:29:38 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-c43be997-c2da-443a-a90f-b31a5a50f870 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:29:38 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-c43be997-c2da-443a-a90f-b31a5a50f870 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:29:38 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-c43be997-c2da-443a-a90f-b31a5a50f870 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:29:38 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-c43be997-c2da-443a-a90f-b31a5a50f870 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:29:38 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-c43be997-c2da-443a-a90f-b31a5a50f870 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] 10.0.0.210 "POST /compute/v2.1/servers/5d50f597-3a29-4335-8166-6ab8e8149376/os-interface" status: 200 len: 283 microversion: 2.49 time: 3.122016 Apr 13 16:29:38 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 169/509] 10.0.0.210 () {66 vars in 1414 bytes} [Thu Apr 13 16:29:35 2023] POST /compute/v2.1/servers/5d50f597-3a29-4335-8166-6ab8e8149376/os-interface => generated 283 bytes in 3123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 16:29:38 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-ef04bf9c-d554-4767-be2e-adabe6106b03 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bc906e31-eece-4b17-adf4-55ad76b7e51a", "tag": "volume-tag"}} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:29:38 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-ef04bf9c-d554-4767-be2e-adabe6106b03 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] [instance: 5d50f597-3a29-4335-8166-6ab8e8149376] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:29:38 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-ef04bf9c-d554-4767-be2e-adabe6106b03 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:29:38 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-ef04bf9c-d554-4767-be2e-adabe6106b03 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:29:38 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-ef04bf9c-d554-4767-be2e-adabe6106b03 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:29:38 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-ef04bf9c-d554-4767-be2e-adabe6106b03 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:29:38 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-ef04bf9c-d554-4767-be2e-adabe6106b03 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:29:38 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-ef04bf9c-d554-4767-be2e-adabe6106b03 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:29:38 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-3772a070-4c4b-47e6-8166-e4108cd41dcf tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:29:38 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-3772a070-4c4b-47e6-8166-e4108cd41dcf tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 650427bd-4dad-4bcd-922d-c17e60b36807] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:29:38 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-3772a070-4c4b-47e6-8166-e4108cd41dcf tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:29:38 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-3772a070-4c4b-47e6-8166-e4108cd41dcf tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:29:38 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-3772a070-4c4b-47e6-8166-e4108cd41dcf tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:29:38 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-3772a070-4c4b-47e6-8166-e4108cd41dcf tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:29:38 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-3772a070-4c4b-47e6-8166-e4108cd41dcf tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:29:38 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-3772a070-4c4b-47e6-8166-e4108cd41dcf tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:29:38 user devstack@n-api.service[62054]: DEBUG nova.policy [None req-3772a070-4c4b-47e6-8166-e4108cd41dcf tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45a882dbafb4ea4976e4f45289eb2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d09a74bf684a9fb1dd1e95d6c23f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62054) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:29:38 user devstack@n-api.service[62054]: DEBUG nova.policy [None req-3772a070-4c4b-47e6-8166-e4108cd41dcf tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e45a882dbafb4ea4976e4f45289eb2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d09a74bf684a9fb1dd1e95d6c23f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62054) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:29:38 user devstack@n-api.service[62054]: DEBUG nova.policy [None req-3772a070-4c4b-47e6-8166-e4108cd41dcf tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e45a882dbafb4ea4976e4f45289eb2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d09a74bf684a9fb1dd1e95d6c23f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62054) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:29:38 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-3772a070-4c4b-47e6-8166-e4108cd41dcf tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] 10.0.0.210 "GET /compute/v2.1/servers/650427bd-4dad-4bcd-922d-c17e60b36807" status: 200 len: 1690 microversion: 2.87 time: 0.175935 Apr 13 16:29:38 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 173/510] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 16:29:38 2023] GET /compute/v2.1/servers/650427bd-4dad-4bcd-922d-c17e60b36807 => generated 1690 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 16:29:38 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-ef04bf9c-d554-4767-be2e-adabe6106b03 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] 10.0.0.210 "POST /compute/v2.1/servers/5d50f597-3a29-4335-8166-6ab8e8149376/os-volume_attachments" status: 200 len: 194 microversion: 2.49 time: 0.285243 Apr 13 16:29:38 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 169/511] 10.0.0.210 () {66 vars in 1441 bytes} [Thu Apr 13 16:29:38 2023] POST /compute/v2.1/servers/5d50f597-3a29-4335-8166-6ab8e8149376/os-volume_attachments => generated 194 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 16:29:39 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-06c989ea-58dd-448d-a4b4-b668da7a8f3b tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:29:39 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-06c989ea-58dd-448d-a4b4-b668da7a8f3b tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 0f52d9e3-921c-4f79-9cdb-7d73500c8c35] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:29:39 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-06c989ea-58dd-448d-a4b4-b668da7a8f3b tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:29:39 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-06c989ea-58dd-448d-a4b4-b668da7a8f3b tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:29:39 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-06c989ea-58dd-448d-a4b4-b668da7a8f3b tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:29:39 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-06c989ea-58dd-448d-a4b4-b668da7a8f3b tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:29:39 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-06c989ea-58dd-448d-a4b4-b668da7a8f3b tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:29:39 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-06c989ea-58dd-448d-a4b4-b668da7a8f3b tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:29:39 user devstack@n-api.service[62053]: INFO nova.api.openstack.wsgi [None req-06c989ea-58dd-448d-a4b4-b668da7a8f3b tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] HTTP exception thrown: Instance 0f52d9e3-921c-4f79-9cdb-7d73500c8c35 could not be found. Apr 13 16:29:39 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-06c989ea-58dd-448d-a4b4-b668da7a8f3b tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Request method failure captured: Apr 13 16:29:39 user devstack@n-api.service[62053]: request: GET /compute/v2.1/servers/0f52d9e3-921c-4f79-9cdb-7d73500c8c35 HTTP/1.1 Apr 13 16:29:39 user devstack@n-api.service[62053]: Accept: application/json Apr 13 16:29:39 user devstack@n-api.service[62053]: Accept-Encoding: identity Apr 13 16:29:39 user devstack@n-api.service[62053]: Connection: close Apr 13 16:29:39 user devstack@n-api.service[62053]: Content-Length: 0 Apr 13 16:29:39 user devstack@n-api.service[62053]: Content-Type: application/json Apr 13 16:29:39 user devstack@n-api.service[62053]: Host: 10.0.0.210 Apr 13 16:29:39 user devstack@n-api.service[62053]: Openstack-System-Scope: None Apr 13 16:29:39 user devstack@n-api.service[62053]: User-Agent: python-urllib3/1.26.15 Apr 13 16:29:39 user devstack@n-api.service[62053]: X-Auth-Token: gAAAAABkOCwkI2hCVv3q2RMbn5sWNaNksO2jlEae5ib0A_n2-4Ip_Pl-WyakKOiBGyr1g-8idBZHWfWrP88wr7DW2Z-7RXK4r2oTVrS71NZCSisAoUDBhj4KwKB40I0svywhzMPIjrB1h0EwajlcYKhM2GYo5FTaZ-MnJbSWEwEZAY8gyi1eSaE Apr 13 16:29:39 user devstack@n-api.service[62053]: X-Domain-Id: None Apr 13 16:29:39 user devstack@n-api.service[62053]: X-Domain-Name: None Apr 13 16:29:39 user devstack@n-api.service[62053]: X-Identity-Status: Confirmed Apr 13 16:29:39 user devstack@n-api.service[62053]: X-Is-Admin-Project: True Apr 13 16:29:39 user devstack@n-api.service[62053]: X-Project-Domain-Id: default Apr 13 16:29:39 user devstack@n-api.service[62053]: X-Project-Domain-Name: Default Apr 13 16:29:39 user devstack@n-api.service[62053]: X-Project-Id: 8d451e0e239f486aa2b3abe9e273eab3 Apr 13 16:29:39 user devstack@n-api.service[62053]: X-Project-Name: tempest-TestVolumeBootPattern-438786227 Apr 13 16:29:39 user devstack@n-api.service[62053]: X-Role: reader,member Apr 13 16:29:39 user devstack@n-api.service[62053]: X-Roles: reader,member Apr 13 16:29:39 user devstack@n-api.service[62053]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8d451e0e239f486aa2b3abe9e273eab3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8d451e0e239f486aa2b3abe9e273eab3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8d451e0e239f486aa2b3abe9e273eab3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 13 16:29:39 user devstack@n-api.service[62053]: X-Tenant: tempest-TestVolumeBootPattern-438786227 Apr 13 16:29:39 user devstack@n-api.service[62053]: X-Tenant-Id: 8d451e0e239f486aa2b3abe9e273eab3 Apr 13 16:29:39 user devstack@n-api.service[62053]: X-Tenant-Name: tempest-TestVolumeBootPattern-438786227 Apr 13 16:29:39 user devstack@n-api.service[62053]: X-User: tempest-TestVolumeBootPattern-438786227-project-member Apr 13 16:29:39 user devstack@n-api.service[62053]: X-User-Domain-Id: default Apr 13 16:29:39 user devstack@n-api.service[62053]: X-User-Domain-Name: Default Apr 13 16:29:39 user devstack@n-api.service[62053]: X-User-Id: d70e10f63cdd49a9a1ebe1fe4c9de0a2 Apr 13 16:29:39 user devstack@n-api.service[62053]: X-User-Name: tempest-TestVolumeBootPattern-438786227-project-member Apr 13 16:29:39 user devstack@n-api.service[62053]: method: > Apr 13 16:29:39 user devstack@n-api.service[62053]: exception: Instance 0f52d9e3-921c-4f79-9cdb-7d73500c8c35 could not be found. Apr 13 16:29:39 user devstack@n-api.service[62053]: action_args: {'id': '0f52d9e3-921c-4f79-9cdb-7d73500c8c35'} Apr 13 16:29:39 user devstack@n-api.service[62053]: {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 16:29:39 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:29:39 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 16:29:39 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 16:29:39 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 16:29:39 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 16:29:39 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 16:29:39 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 16:29:39 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 16:29:39 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 16:29:39 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f52d9e3-921c-4f79-9cdb-7d73500c8c35 could not be found. Apr 13 16:29:39 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:29:39 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:29:39 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:29:39 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:29:39 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 16:29:39 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 16:29:39 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 16:29:39 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 16:29:39 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 16:29:39 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 16:29:39 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 16:29:39 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 16:29:39 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 16:29:39 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 16:29:39 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 16:29:39 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 16:29:39 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f52d9e3-921c-4f79-9cdb-7d73500c8c35 could not be found. Apr 13 16:29:39 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:29:39 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:29:39 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:29:39 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:29:39 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 16:29:39 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 16:29:39 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 16:29:39 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 16:29:39 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f52d9e3-921c-4f79-9cdb-7d73500c8c35 could not be found. Apr 13 16:29:39 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:29:39 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-06c989ea-58dd-448d-a4b4-b668da7a8f3b tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Returning 404 to user: Instance 0f52d9e3-921c-4f79-9cdb-7d73500c8c35 could not be found. {{(pid=62053) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 16:29:39 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-06c989ea-58dd-448d-a4b4-b668da7a8f3b tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0f52d9e3-921c-4f79-9cdb-7d73500c8c35" status: 404 len: 111 microversion: 2.1 time: 0.028603 Apr 13 16:29:39 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 170/512] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:29:39 2023] GET /compute/v2.1/servers/0f52d9e3-921c-4f79-9cdb-7d73500c8c35 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 16:29:40 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-6da46d02-9025-4015-ba4a-f4a3cde0af2e req-46bef7cf-ab54-415c-bf91-cd43c9f02180 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d50f597-3a29-4335-8166-6ab8e8149376", "name": "network-vif-plugged", "status": "completed", "tag": "deb6fd31-3a87-439d-b59c-4f4dbf9a11bc"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:29:40 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-6da46d02-9025-4015-ba4a-f4a3cde0af2e req-46bef7cf-ab54-415c-bf91-cd43c9f02180 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:29:40 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-6da46d02-9025-4015-ba4a-f4a3cde0af2e req-46bef7cf-ab54-415c-bf91-cd43c9f02180 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:29:40 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-6da46d02-9025-4015-ba4a-f4a3cde0af2e req-46bef7cf-ab54-415c-bf91-cd43c9f02180 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:29:40 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-6da46d02-9025-4015-ba4a-f4a3cde0af2e req-46bef7cf-ab54-415c-bf91-cd43c9f02180 service nova] Creating event network-vif-plugged:deb6fd31-3a87-439d-b59c-4f4dbf9a11bc for instance 5d50f597-3a29-4335-8166-6ab8e8149376 on user Apr 13 16:29:40 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [req-6da46d02-9025-4015-ba4a-f4a3cde0af2e req-46bef7cf-ab54-415c-bf91-cd43c9f02180 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028250 Apr 13 16:29:40 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 174/513] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:29:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:29:45 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-9e46175c-c4ac-4ce5-8e70-84d97a448bb7 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:29:45 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-9e46175c-c4ac-4ce5-8e70-84d97a448bb7 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 5ea4ab6a-6501-4a2f-a8f7-04090024747d] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:29:45 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-9e46175c-c4ac-4ce5-8e70-84d97a448bb7 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:29:45 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-9e46175c-c4ac-4ce5-8e70-84d97a448bb7 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:29:45 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-9e46175c-c4ac-4ce5-8e70-84d97a448bb7 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:29:45 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-9e46175c-c4ac-4ce5-8e70-84d97a448bb7 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:29:45 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-9e46175c-c4ac-4ce5-8e70-84d97a448bb7 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:29:45 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-9e46175c-c4ac-4ce5-8e70-84d97a448bb7 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:29:45 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-9e46175c-c4ac-4ce5-8e70-84d97a448bb7 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 5ea4ab6a-6501-4a2f-a8f7-04090024747d] Going to try to terminate instance {{(pid=62055) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 16:29:45 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-9e46175c-c4ac-4ce5-8e70-84d97a448bb7 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5ea4ab6a-6501-4a2f-a8f7-04090024747d" status: 204 len: 0 microversion: 2.1 time: 0.136968 Apr 13 16:29:45 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 170/514] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 16:29:45 2023] DELETE /compute/v2.1/servers/5ea4ab6a-6501-4a2f-a8f7-04090024747d => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 16:29:45 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-1e8341cd-5894-4bbe-bbc0-fe040ab2350c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:29:45 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-1e8341cd-5894-4bbe-bbc0-fe040ab2350c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 5ea4ab6a-6501-4a2f-a8f7-04090024747d] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:29:45 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-1e8341cd-5894-4bbe-bbc0-fe040ab2350c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:29:45 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-1e8341cd-5894-4bbe-bbc0-fe040ab2350c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:29:45 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-1e8341cd-5894-4bbe-bbc0-fe040ab2350c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:29:45 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-1e8341cd-5894-4bbe-bbc0-fe040ab2350c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:29:45 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-1e8341cd-5894-4bbe-bbc0-fe040ab2350c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:29:45 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-1e8341cd-5894-4bbe-bbc0-fe040ab2350c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:29:45 user devstack@n-api.service[62053]: DEBUG nova.policy [None req-1e8341cd-5894-4bbe-bbc0-fe040ab2350c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e10f63cdd49a9a1ebe1fe4c9de0a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d451e0e239f486aa2b3abe9e273eab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62053) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:29:45 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-1e8341cd-5894-4bbe-bbc0-fe040ab2350c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5ea4ab6a-6501-4a2f-a8f7-04090024747d" status: 200 len: 1399 microversion: 2.1 time: 0.231485 Apr 13 16:29:45 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 171/515] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:29:45 2023] GET /compute/v2.1/servers/5ea4ab6a-6501-4a2f-a8f7-04090024747d => generated 1399 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:29:45 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-fefecb84-49b3-433a-9dd2-62ea6ab3780c req-dd4a5c56-6445-4090-98a1-60cf05146e02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ea4ab6a-6501-4a2f-a8f7-04090024747d", "name": "network-vif-unplugged", "status": "completed", "tag": "8a5c66fa-4693-4162-b5a8-2c80b33cf979"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:29:45 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-fefecb84-49b3-433a-9dd2-62ea6ab3780c req-dd4a5c56-6445-4090-98a1-60cf05146e02 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:29:45 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-fefecb84-49b3-433a-9dd2-62ea6ab3780c req-dd4a5c56-6445-4090-98a1-60cf05146e02 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:29:45 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-fefecb84-49b3-433a-9dd2-62ea6ab3780c req-dd4a5c56-6445-4090-98a1-60cf05146e02 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:29:45 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-fefecb84-49b3-433a-9dd2-62ea6ab3780c req-dd4a5c56-6445-4090-98a1-60cf05146e02 service nova] Creating event network-vif-unplugged:8a5c66fa-4693-4162-b5a8-2c80b33cf979 for instance 5ea4ab6a-6501-4a2f-a8f7-04090024747d on user Apr 13 16:29:45 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [req-fefecb84-49b3-433a-9dd2-62ea6ab3780c req-dd4a5c56-6445-4090-98a1-60cf05146e02 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037043 Apr 13 16:29:45 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 175/516] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:29:45 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:29:47 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-cfb1e1e0-df47-45b9-8026-83d103ce3a1d tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:29:47 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-cfb1e1e0-df47-45b9-8026-83d103ce3a1d tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] [instance: 5d50f597-3a29-4335-8166-6ab8e8149376] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:29:47 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:29:47 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-cfb1e1e0-df47-45b9-8026-83d103ce3a1d tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:29:47 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-cfb1e1e0-df47-45b9-8026-83d103ce3a1d tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:29:47 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-cfb1e1e0-df47-45b9-8026-83d103ce3a1d tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:29:47 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-cfb1e1e0-df47-45b9-8026-83d103ce3a1d tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:29:47 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-cfb1e1e0-df47-45b9-8026-83d103ce3a1d tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:29:47 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-cfb1e1e0-df47-45b9-8026-83d103ce3a1d tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:29:47 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:29:47 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-59bf4a51-c666-43ac-8f53-ec346d0b8620 req-e39ea0ee-f617-4e54-b15e-57e55bc13e3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ea4ab6a-6501-4a2f-a8f7-04090024747d", "name": "network-vif-plugged", "status": "completed", "tag": "8a5c66fa-4693-4162-b5a8-2c80b33cf979"}, {"server_uuid": "5ea4ab6a-6501-4a2f-a8f7-04090024747d", "name": "network-vif-deleted", "tag": "8a5c66fa-4693-4162-b5a8-2c80b33cf979"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:29:47 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=3 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:29:47 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-59bf4a51-c666-43ac-8f53-ec346d0b8620 req-e39ea0ee-f617-4e54-b15e-57e55bc13e3e service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:29:47 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-59bf4a51-c666-43ac-8f53-ec346d0b8620 req-e39ea0ee-f617-4e54-b15e-57e55bc13e3e service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:29:47 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-59bf4a51-c666-43ac-8f53-ec346d0b8620 req-e39ea0ee-f617-4e54-b15e-57e55bc13e3e service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:29:47 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_cell1:SELECT=34,nova_cell1:INSERT=1 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:29:47 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-59bf4a51-c666-43ac-8f53-ec346d0b8620 req-e39ea0ee-f617-4e54-b15e-57e55bc13e3e service nova] Creating event network-vif-plugged:8a5c66fa-4693-4162-b5a8-2c80b33cf979 for instance 5ea4ab6a-6501-4a2f-a8f7-04090024747d on user Apr 13 16:29:47 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-59bf4a51-c666-43ac-8f53-ec346d0b8620 req-e39ea0ee-f617-4e54-b15e-57e55bc13e3e service nova] Creating event network-vif-deleted:8a5c66fa-4693-4162-b5a8-2c80b33cf979 for instance 5ea4ab6a-6501-4a2f-a8f7-04090024747d on user Apr 13 16:29:47 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [req-59bf4a51-c666-43ac-8f53-ec346d0b8620 req-e39ea0ee-f617-4e54-b15e-57e55bc13e3e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.034491 Apr 13 16:29:47 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 172/517] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:29:47 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:29:48 user devstack@n-api.service[62055]: DEBUG nova.objects.instance [None req-cfb1e1e0-df47-45b9-8026-83d103ce3a1d tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Lazy-loading 'services' on Instance uuid 5d50f597-3a29-4335-8166-6ab8e8149376 {{(pid=62055) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 16:29:48 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-cfb1e1e0-df47-45b9-8026-83d103ce3a1d tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5d50f597-3a29-4335-8166-6ab8e8149376/os-volume_attachments/bc906e31-eece-4b17-adf4-55ad76b7e51a" status: 202 len: 0 microversion: 2.49 time: 0.265215 Apr 13 16:29:48 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 171/518] 10.0.0.210 () {64 vars in 1534 bytes} [Thu Apr 13 16:29:47 2023] DELETE /compute/v2.1/servers/5d50f597-3a29-4335-8166-6ab8e8149376/os-volume_attachments/bc906e31-eece-4b17-adf4-55ad76b7e51a => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 13 16:29:50 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-cf32ea9f-027a-477c-ab99-64e61239b391 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:29:50 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-cf32ea9f-027a-477c-ab99-64e61239b391 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] [instance: 7973e93b-6311-44ed-91ff-e861c32d0277] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:29:50 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-cf32ea9f-027a-477c-ab99-64e61239b391 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:29:50 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-cf32ea9f-027a-477c-ab99-64e61239b391 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:29:50 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-cf32ea9f-027a-477c-ab99-64e61239b391 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:29:50 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-cf32ea9f-027a-477c-ab99-64e61239b391 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:29:50 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-cf32ea9f-027a-477c-ab99-64e61239b391 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:29:50 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-cf32ea9f-027a-477c-ab99-64e61239b391 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:29:50 user devstack@n-api.service[62054]: INFO nova.api.openstack.wsgi [None req-cf32ea9f-027a-477c-ab99-64e61239b391 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] HTTP exception thrown: Instance 7973e93b-6311-44ed-91ff-e861c32d0277 could not be found. Apr 13 16:29:50 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-cf32ea9f-027a-477c-ab99-64e61239b391 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Request method failure captured: Apr 13 16:29:50 user devstack@n-api.service[62054]: request: GET /compute/v2.1/servers/7973e93b-6311-44ed-91ff-e861c32d0277 HTTP/1.1 Apr 13 16:29:50 user devstack@n-api.service[62054]: Accept: application/json Apr 13 16:29:50 user devstack@n-api.service[62054]: Accept-Encoding: identity Apr 13 16:29:50 user devstack@n-api.service[62054]: Connection: close Apr 13 16:29:50 user devstack@n-api.service[62054]: Content-Length: 0 Apr 13 16:29:50 user devstack@n-api.service[62054]: Content-Type: application/json Apr 13 16:29:50 user devstack@n-api.service[62054]: Host: 10.0.0.210 Apr 13 16:29:50 user devstack@n-api.service[62054]: Openstack-System-Scope: None Apr 13 16:29:50 user devstack@n-api.service[62054]: User-Agent: python-urllib3/1.26.15 Apr 13 16:29:50 user devstack@n-api.service[62054]: X-Auth-Token: gAAAAABkOCu7xvmudBrBXBLs2SCBDcK71oPknaVoa5c212HJ1YH5D1qqQ770FnyyQ769HR4gN3MWc8D4DgjQEtN69nkpO07yNpJgb9N95gGXJDJugJy1OfGoQrI6zjE_4e0z9MJFRRuCNbIXu0Si5G6jJIciNJHiNV9wx9koSjgJs77kT-szNSc Apr 13 16:29:50 user devstack@n-api.service[62054]: X-Domain-Id: None Apr 13 16:29:50 user devstack@n-api.service[62054]: X-Domain-Name: None Apr 13 16:29:50 user devstack@n-api.service[62054]: X-Identity-Status: Confirmed Apr 13 16:29:50 user devstack@n-api.service[62054]: X-Is-Admin-Project: True Apr 13 16:29:50 user devstack@n-api.service[62054]: X-Project-Domain-Id: default Apr 13 16:29:50 user devstack@n-api.service[62054]: X-Project-Domain-Name: Default Apr 13 16:29:50 user devstack@n-api.service[62054]: X-Project-Id: 5554aa7f1b4d471b8807a845ab1ea33f Apr 13 16:29:50 user devstack@n-api.service[62054]: X-Project-Name: tempest-ServersNegativeTestJSON-1820659348 Apr 13 16:29:50 user devstack@n-api.service[62054]: X-Role: reader,member Apr 13 16:29:50 user devstack@n-api.service[62054]: X-Roles: reader,member Apr 13 16:29:50 user devstack@n-api.service[62054]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5554aa7f1b4d471b8807a845ab1ea33f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5554aa7f1b4d471b8807a845ab1ea33f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5554aa7f1b4d471b8807a845ab1ea33f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 13 16:29:50 user devstack@n-api.service[62054]: X-Tenant: tempest-ServersNegativeTestJSON-1820659348 Apr 13 16:29:50 user devstack@n-api.service[62054]: X-Tenant-Id: 5554aa7f1b4d471b8807a845ab1ea33f Apr 13 16:29:50 user devstack@n-api.service[62054]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1820659348 Apr 13 16:29:50 user devstack@n-api.service[62054]: X-User: tempest-ServersNegativeTestJSON-1820659348-project-member Apr 13 16:29:50 user devstack@n-api.service[62054]: X-User-Domain-Id: default Apr 13 16:29:50 user devstack@n-api.service[62054]: X-User-Domain-Name: Default Apr 13 16:29:50 user devstack@n-api.service[62054]: X-User-Id: 4ddd547d240b43ccb213e9d459082309 Apr 13 16:29:50 user devstack@n-api.service[62054]: X-User-Name: tempest-ServersNegativeTestJSON-1820659348-project-member Apr 13 16:29:50 user devstack@n-api.service[62054]: method: > Apr 13 16:29:50 user devstack@n-api.service[62054]: exception: Instance 7973e93b-6311-44ed-91ff-e861c32d0277 could not be found. Apr 13 16:29:50 user devstack@n-api.service[62054]: action_args: {'id': '7973e93b-6311-44ed-91ff-e861c32d0277'} Apr 13 16:29:50 user devstack@n-api.service[62054]: {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 16:29:50 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:29:50 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 16:29:50 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 16:29:50 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 16:29:50 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 16:29:50 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 16:29:50 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 16:29:50 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 16:29:50 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 16:29:50 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7973e93b-6311-44ed-91ff-e861c32d0277 could not be found. Apr 13 16:29:50 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:29:50 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:29:50 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:29:50 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:29:50 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 16:29:50 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 16:29:50 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 16:29:50 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 16:29:50 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 16:29:50 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 16:29:50 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 16:29:50 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 16:29:50 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 16:29:50 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 16:29:50 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 16:29:50 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 16:29:50 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7973e93b-6311-44ed-91ff-e861c32d0277 could not be found. Apr 13 16:29:50 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:29:50 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:29:50 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:29:50 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:29:50 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 16:29:50 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 16:29:50 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 16:29:50 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 16:29:50 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7973e93b-6311-44ed-91ff-e861c32d0277 could not be found. Apr 13 16:29:50 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:29:50 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-cf32ea9f-027a-477c-ab99-64e61239b391 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Returning 404 to user: Instance 7973e93b-6311-44ed-91ff-e861c32d0277 could not be found. {{(pid=62054) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 16:29:50 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-cf32ea9f-027a-477c-ab99-64e61239b391 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7973e93b-6311-44ed-91ff-e861c32d0277" status: 404 len: 111 microversion: 2.1 time: 0.029787 Apr 13 16:29:50 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 176/519] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:29:50 2023] GET /compute/v2.1/servers/7973e93b-6311-44ed-91ff-e861c32d0277 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 16:29:51 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-036b777d-1ffe-43b6-b1f2-5a8ed4f4f6ec tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:29:51 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-036b777d-1ffe-43b6-b1f2-5a8ed4f4f6ec tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] [instance: 5d50f597-3a29-4335-8166-6ab8e8149376] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:29:51 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-036b777d-1ffe-43b6-b1f2-5a8ed4f4f6ec tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:29:51 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-036b777d-1ffe-43b6-b1f2-5a8ed4f4f6ec tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:29:51 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-036b777d-1ffe-43b6-b1f2-5a8ed4f4f6ec tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:29:51 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-036b777d-1ffe-43b6-b1f2-5a8ed4f4f6ec tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:29:51 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-036b777d-1ffe-43b6-b1f2-5a8ed4f4f6ec tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:29:51 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-036b777d-1ffe-43b6-b1f2-5a8ed4f4f6ec tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:29:51 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-036b777d-1ffe-43b6-b1f2-5a8ed4f4f6ec tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5d50f597-3a29-4335-8166-6ab8e8149376/os-interface/deb6fd31-3a87-439d-b59c-4f4dbf9a11bc" status: 202 len: 0 microversion: 2.49 time: 0.063935 Apr 13 16:29:51 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 173/520] 10.0.0.210 () {64 vars in 1507 bytes} [Thu Apr 13 16:29:51 2023] DELETE /compute/v2.1/servers/5d50f597-3a29-4335-8166-6ab8e8149376/os-interface/deb6fd31-3a87-439d-b59c-4f4dbf9a11bc => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 13 16:29:51 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-8b502b23-9b4d-4a79-9df8-7cd23e1fe2e4 tempest-TaggedAttachmentsTest-1471354305 tempest-TaggedAttachmentsTest-1471354305-project-admin] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:29:51 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-8b502b23-9b4d-4a79-9df8-7cd23e1fe2e4 tempest-TaggedAttachmentsTest-1471354305 tempest-TaggedAttachmentsTest-1471354305-project-admin] [instance: 5d50f597-3a29-4335-8166-6ab8e8149376] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:29:51 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-8b502b23-9b4d-4a79-9df8-7cd23e1fe2e4 tempest-TaggedAttachmentsTest-1471354305 tempest-TaggedAttachmentsTest-1471354305-project-admin] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:29:51 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-8b502b23-9b4d-4a79-9df8-7cd23e1fe2e4 tempest-TaggedAttachmentsTest-1471354305 tempest-TaggedAttachmentsTest-1471354305-project-admin] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:29:51 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-8b502b23-9b4d-4a79-9df8-7cd23e1fe2e4 tempest-TaggedAttachmentsTest-1471354305 tempest-TaggedAttachmentsTest-1471354305-project-admin] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:29:51 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-8b502b23-9b4d-4a79-9df8-7cd23e1fe2e4 tempest-TaggedAttachmentsTest-1471354305 tempest-TaggedAttachmentsTest-1471354305-project-admin] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:29:51 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-8b502b23-9b4d-4a79-9df8-7cd23e1fe2e4 tempest-TaggedAttachmentsTest-1471354305 tempest-TaggedAttachmentsTest-1471354305-project-admin] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:29:51 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-8b502b23-9b4d-4a79-9df8-7cd23e1fe2e4 tempest-TaggedAttachmentsTest-1471354305 tempest-TaggedAttachmentsTest-1471354305-project-admin] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:29:51 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-8b502b23-9b4d-4a79-9df8-7cd23e1fe2e4 tempest-TaggedAttachmentsTest-1471354305 tempest-TaggedAttachmentsTest-1471354305-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/5d50f597-3a29-4335-8166-6ab8e8149376/os-instance-actions/req-036b777d-1ffe-43b6-b1f2-5a8ed4f4f6ec" status: 200 len: 474 microversion: 2.49 time: 0.209880 Apr 13 16:29:51 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 172/521] 10.0.0.210 () {64 vars in 1537 bytes} [Thu Apr 13 16:29:51 2023] GET /compute/v2.1/servers/5d50f597-3a29-4335-8166-6ab8e8149376/os-instance-actions/req-036b777d-1ffe-43b6-b1f2-5a8ed4f4f6ec => generated 474 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 16:29:51 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-4c431ddf-d0a5-4573-b723-ea5ce5ffbf86 req-cd2b656b-374b-4584-9dee-37eed42f3b1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d50f597-3a29-4335-8166-6ab8e8149376", "name": "network-vif-unplugged", "status": "completed", "tag": "deb6fd31-3a87-439d-b59c-4f4dbf9a11bc"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:29:51 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-4c431ddf-d0a5-4573-b723-ea5ce5ffbf86 req-cd2b656b-374b-4584-9dee-37eed42f3b1f service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:29:51 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-4c431ddf-d0a5-4573-b723-ea5ce5ffbf86 req-cd2b656b-374b-4584-9dee-37eed42f3b1f service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:29:51 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-4c431ddf-d0a5-4573-b723-ea5ce5ffbf86 req-cd2b656b-374b-4584-9dee-37eed42f3b1f service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:29:51 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-4c431ddf-d0a5-4573-b723-ea5ce5ffbf86 req-cd2b656b-374b-4584-9dee-37eed42f3b1f service nova] Creating event network-vif-unplugged:deb6fd31-3a87-439d-b59c-4f4dbf9a11bc for instance 5d50f597-3a29-4335-8166-6ab8e8149376 on user Apr 13 16:29:51 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [req-4c431ddf-d0a5-4573-b723-ea5ce5ffbf86 req-cd2b656b-374b-4584-9dee-37eed42f3b1f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044106 Apr 13 16:29:51 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 177/522] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:29:51 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:29:52 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-d9a5f313-ef9a-4b65-a37e-834c317a5f35 req-a2b5f3c9-f9bc-4923-b95f-c13159f8077c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d50f597-3a29-4335-8166-6ab8e8149376", "name": "network-vif-deleted", "tag": "deb6fd31-3a87-439d-b59c-4f4dbf9a11bc"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:29:52 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-d9a5f313-ef9a-4b65-a37e-834c317a5f35 req-a2b5f3c9-f9bc-4923-b95f-c13159f8077c service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:29:52 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-d9a5f313-ef9a-4b65-a37e-834c317a5f35 req-a2b5f3c9-f9bc-4923-b95f-c13159f8077c service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:29:52 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-d9a5f313-ef9a-4b65-a37e-834c317a5f35 req-a2b5f3c9-f9bc-4923-b95f-c13159f8077c service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:29:52 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-d9a5f313-ef9a-4b65-a37e-834c317a5f35 req-a2b5f3c9-f9bc-4923-b95f-c13159f8077c service nova] Creating event network-vif-deleted:deb6fd31-3a87-439d-b59c-4f4dbf9a11bc for instance 5d50f597-3a29-4335-8166-6ab8e8149376 on user Apr 13 16:29:52 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [req-d9a5f313-ef9a-4b65-a37e-834c317a5f35 req-a2b5f3c9-f9bc-4923-b95f-c13159f8077c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038234 Apr 13 16:29:52 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 174/523] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:29:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 16:29:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [req-c423bc9d-ee8e-4631-ae71-5881cc0e2ea4 req-9d3dd53d-8899-4f1f-a39e-81c959327cc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d50f597-3a29-4335-8166-6ab8e8149376", "name": "network-vif-plugged", "status": "completed", "tag": "deb6fd31-3a87-439d-b59c-4f4dbf9a11bc"}]} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:29:54 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-c423bc9d-ee8e-4631-ae71-5881cc0e2ea4 req-9d3dd53d-8899-4f1f-a39e-81c959327cc4 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:29:54 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-c423bc9d-ee8e-4631-ae71-5881cc0e2ea4 req-9d3dd53d-8899-4f1f-a39e-81c959327cc4 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:29:54 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-c423bc9d-ee8e-4631-ae71-5881cc0e2ea4 req-9d3dd53d-8899-4f1f-a39e-81c959327cc4 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:29:54 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-c423bc9d-ee8e-4631-ae71-5881cc0e2ea4 req-9d3dd53d-8899-4f1f-a39e-81c959327cc4 service nova] Creating event network-vif-plugged:deb6fd31-3a87-439d-b59c-4f4dbf9a11bc for instance 5d50f597-3a29-4335-8166-6ab8e8149376 on user Apr 13 16:29:54 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [req-c423bc9d-ee8e-4631-ae71-5881cc0e2ea4 req-9d3dd53d-8899-4f1f-a39e-81c959327cc4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033094 Apr 13 16:29:54 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 173/524] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:29:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:29:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-4266630d-aeb5-4fa3-9987-971fa52c33be tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:29:55 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-4266630d-aeb5-4fa3-9987-971fa52c33be tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:29:55 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-4266630d-aeb5-4fa3-9987-971fa52c33be tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:29:55 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-4266630d-aeb5-4fa3-9987-971fa52c33be tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:29:55 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-4266630d-aeb5-4fa3-9987-971fa52c33be tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:29:55 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-4266630d-aeb5-4fa3-9987-971fa52c33be tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:29:55 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-4266630d-aeb5-4fa3-9987-971fa52c33be tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:29:55 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-4266630d-aeb5-4fa3-9987-971fa52c33be tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:29:55 user devstack@n-api.service[62054]: DEBUG nova.objects.instance [None req-4266630d-aeb5-4fa3-9987-971fa52c33be tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lazy-loading 'services' on Instance uuid eaae47b9-a059-49f6-9ae6-d7147003e2f2 {{(pid=62054) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 16:29:55 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-4266630d-aeb5-4fa3-9987-971fa52c33be tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/eaae47b9-a059-49f6-9ae6-d7147003e2f2/os-volume_attachments/eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6" status: 202 len: 0 microversion: 2.1 time: 0.396943 Apr 13 16:29:55 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 178/525] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 16:29:55 2023] DELETE /compute/v2.1/servers/eaae47b9-a059-49f6-9ae6-d7147003e2f2/os-volume_attachments/eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6 => generated 0 bytes in 400 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 16:29:57 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-7a6affc8-8378-4b47-b967-d3aa339be059 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:29:57 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-7a6affc8-8378-4b47-b967-d3aa339be059 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:29:57 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-7a6affc8-8378-4b47-b967-d3aa339be059 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:29:57 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-7a6affc8-8378-4b47-b967-d3aa339be059 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:29:57 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-7a6affc8-8378-4b47-b967-d3aa339be059 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Going to try to stop instance {{(pid=62053) force_stop /opt/stack/nova/nova/compute/api.py:2764}} Apr 13 16:29:57 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-7a6affc8-8378-4b47-b967-d3aa339be059 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] 10.0.0.210 "POST /compute/v2.1/servers/eaae47b9-a059-49f6-9ae6-d7147003e2f2/action" status: 202 len: 0 microversion: 2.1 time: 0.082678 Apr 13 16:29:57 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 175/526] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 16:29:57 2023] POST /compute/v2.1/servers/eaae47b9-a059-49f6-9ae6-d7147003e2f2/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 16:29:57 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-73a130bf-51e8-4ef4-a0c6-8617cfaaecf5 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:29:57 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-73a130bf-51e8-4ef4-a0c6-8617cfaaecf5 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:29:57 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-73a130bf-51e8-4ef4-a0c6-8617cfaaecf5 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:29:57 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-73a130bf-51e8-4ef4-a0c6-8617cfaaecf5 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:29:57 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-73a130bf-51e8-4ef4-a0c6-8617cfaaecf5 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:29:57 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-73a130bf-51e8-4ef4-a0c6-8617cfaaecf5 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:29:57 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-73a130bf-51e8-4ef4-a0c6-8617cfaaecf5 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:29:57 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-73a130bf-51e8-4ef4-a0c6-8617cfaaecf5 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:29:57 user devstack@n-api.service[62055]: DEBUG nova.policy [None req-73a130bf-51e8-4ef4-a0c6-8617cfaaecf5 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fab402fb794a5a9281cfb7fe188813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24904988cf334657b084fd726c7ecf8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62055) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:29:57 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-73a130bf-51e8-4ef4-a0c6-8617cfaaecf5 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eaae47b9-a059-49f6-9ae6-d7147003e2f2" status: 200 len: 1666 microversion: 2.1 time: 0.206532 Apr 13 16:29:57 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 174/527] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:29:57 2023] GET /compute/v2.1/servers/eaae47b9-a059-49f6-9ae6-d7147003e2f2 => generated 1666 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:29:58 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-a3d5b41f-ff43-4d5e-bbd4-404d5480635b req-70a74a64-64c4-4a92-aa13-b8342dabb074 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eaae47b9-a059-49f6-9ae6-d7147003e2f2", "name": "network-vif-unplugged", "status": "completed", "tag": "e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:29:58 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-a3d5b41f-ff43-4d5e-bbd4-404d5480635b req-70a74a64-64c4-4a92-aa13-b8342dabb074 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:29:58 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-a3d5b41f-ff43-4d5e-bbd4-404d5480635b req-70a74a64-64c4-4a92-aa13-b8342dabb074 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:29:58 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-a3d5b41f-ff43-4d5e-bbd4-404d5480635b req-70a74a64-64c4-4a92-aa13-b8342dabb074 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:29:58 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-a3d5b41f-ff43-4d5e-bbd4-404d5480635b req-70a74a64-64c4-4a92-aa13-b8342dabb074 service nova] Creating event network-vif-unplugged:e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae for instance eaae47b9-a059-49f6-9ae6-d7147003e2f2 on user Apr 13 16:29:58 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [req-a3d5b41f-ff43-4d5e-bbd4-404d5480635b req-70a74a64-64c4-4a92-aa13-b8342dabb074 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035828 Apr 13 16:29:58 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 179/528] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:29:58 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:30:00 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-7ea7b06d-2aec-40fb-b6f7-84190f876118 req-67f6fac1-73b3-4468-9867-6b05e9caf269 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eaae47b9-a059-49f6-9ae6-d7147003e2f2", "name": "network-vif-plugged", "status": "completed", "tag": "e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:30:00 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-7ea7b06d-2aec-40fb-b6f7-84190f876118 req-67f6fac1-73b3-4468-9867-6b05e9caf269 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:30:00 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-7ea7b06d-2aec-40fb-b6f7-84190f876118 req-67f6fac1-73b3-4468-9867-6b05e9caf269 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:30:00 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-7ea7b06d-2aec-40fb-b6f7-84190f876118 req-67f6fac1-73b3-4468-9867-6b05e9caf269 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:30:00 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-7ea7b06d-2aec-40fb-b6f7-84190f876118 req-67f6fac1-73b3-4468-9867-6b05e9caf269 service nova] Creating event network-vif-plugged:e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae for instance eaae47b9-a059-49f6-9ae6-d7147003e2f2 on user Apr 13 16:30:00 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [req-7ea7b06d-2aec-40fb-b6f7-84190f876118 req-67f6fac1-73b3-4468-9867-6b05e9caf269 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034824 Apr 13 16:30:00 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 176/529] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:30:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:30:06 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-7c96eaa7-3caa-439f-9755-2e1dd4d40e6f tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:30:06 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-7c96eaa7-3caa-439f-9755-2e1dd4d40e6f tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] [instance: 71a2163b-fb6b-4b71-b93f-d682ad141b84] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:30:06 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-7c96eaa7-3caa-439f-9755-2e1dd4d40e6f tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:30:06 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-7c96eaa7-3caa-439f-9755-2e1dd4d40e6f tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:30:06 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-7c96eaa7-3caa-439f-9755-2e1dd4d40e6f tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:30:06 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-7c96eaa7-3caa-439f-9755-2e1dd4d40e6f tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:30:06 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-7c96eaa7-3caa-439f-9755-2e1dd4d40e6f tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:30:06 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-7c96eaa7-3caa-439f-9755-2e1dd4d40e6f tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:30:06 user devstack@n-api.service[62055]: DEBUG nova.policy [None req-7c96eaa7-3caa-439f-9755-2e1dd4d40e6f tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f9678e69654526b4d5dc9de05ac090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33101d535154c9a88cae865ee7ece46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62055) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:30:06 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-7c96eaa7-3caa-439f-9755-2e1dd4d40e6f tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] 10.0.0.210 "GET /compute/v2.1/servers/71a2163b-fb6b-4b71-b93f-d682ad141b84" status: 200 len: 1455 microversion: 2.1 time: 0.356722 Apr 13 16:30:06 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 175/530] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:30:06 2023] GET /compute/v2.1/servers/71a2163b-fb6b-4b71-b93f-d682ad141b84 => generated 1455 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:30:18 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_api:SELECT=22 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:30:18 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_cell1:SELECT=37,nova_cell1:INSERT=1 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:30:18 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-475a5470-8843-4b47-bf2f-f583e3a4c73b tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:30:18 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-475a5470-8843-4b47-bf2f-f583e3a4c73b tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:30:18 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-475a5470-8843-4b47-bf2f-f583e3a4c73b tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:30:18 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-475a5470-8843-4b47-bf2f-f583e3a4c73b tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:30:18 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-475a5470-8843-4b47-bf2f-f583e3a4c73b tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:30:18 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-475a5470-8843-4b47-bf2f-f583e3a4c73b tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:30:18 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-475a5470-8843-4b47-bf2f-f583e3a4c73b tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:30:18 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-475a5470-8843-4b47-bf2f-f583e3a4c73b tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:30:19 user devstack@n-api.service[62054]: DEBUG nova.policy [None req-475a5470-8843-4b47-bf2f-f583e3a4c73b tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1318d817c48e40988e043fa33e908312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e15bc7bee7466a840fb0d0e85d58bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62054) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:30:19 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-475a5470-8843-4b47-bf2f-f583e3a4c73b tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bf98c3a2-dbeb-4ae4-8423-ce55964c4258" status: 200 len: 1567 microversion: 2.1 time: 0.436352 Apr 13 16:30:19 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 180/531] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:30:18 2023] GET /compute/v2.1/servers/bf98c3a2-dbeb-4ae4-8423-ce55964c4258 => generated 1567 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:30:22 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_api:SELECT=9 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:30:22 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_cell1:SELECT=20,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:30:22 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-ebb5ec15-c2b7-458a-aa12-204067ccd21a req-22f67eeb-f1e3-4ce7-9659-a99e811dd589 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf98c3a2-dbeb-4ae4-8423-ce55964c4258", "tag": "58361670-0371-4eb7-83b9-ce67bf2a67bb"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:30:22 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-ebb5ec15-c2b7-458a-aa12-204067ccd21a req-22f67eeb-f1e3-4ce7-9659-a99e811dd589 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:30:22 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-ebb5ec15-c2b7-458a-aa12-204067ccd21a req-22f67eeb-f1e3-4ce7-9659-a99e811dd589 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:30:22 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-ebb5ec15-c2b7-458a-aa12-204067ccd21a req-22f67eeb-f1e3-4ce7-9659-a99e811dd589 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:30:22 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-ebb5ec15-c2b7-458a-aa12-204067ccd21a req-22f67eeb-f1e3-4ce7-9659-a99e811dd589 service nova] Creating event network-changed:58361670-0371-4eb7-83b9-ce67bf2a67bb for instance bf98c3a2-dbeb-4ae4-8423-ce55964c4258 on user Apr 13 16:30:22 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [req-ebb5ec15-c2b7-458a-aa12-204067ccd21a req-22f67eeb-f1e3-4ce7-9659-a99e811dd589 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044044 Apr 13 16:30:22 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 177/532] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:30:22 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:30:22 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-9f479eaf-564d-4715-8d91-68a5e619be19 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5b3d0f80-78b5-444b-9440-b679010c3698"}} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:30:22 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-9f479eaf-564d-4715-8d91-68a5e619be19 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:30:22 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_api:SELECT=9 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:30:22 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_cell1:SELECT=30,nova_cell1:INSERT=1 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:30:22 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-9f479eaf-564d-4715-8d91-68a5e619be19 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:30:22 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-9f479eaf-564d-4715-8d91-68a5e619be19 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:30:22 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-9f479eaf-564d-4715-8d91-68a5e619be19 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:30:22 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-9f479eaf-564d-4715-8d91-68a5e619be19 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:30:22 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-9f479eaf-564d-4715-8d91-68a5e619be19 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:30:22 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-9f479eaf-564d-4715-8d91-68a5e619be19 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:30:23 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-9f479eaf-564d-4715-8d91-68a5e619be19 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] 10.0.0.210 "POST /compute/v2.1/servers/bf98c3a2-dbeb-4ae4-8423-ce55964c4258/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.293515 Apr 13 16:30:23 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 176/533] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 16:30:22 2023] POST /compute/v2.1/servers/bf98c3a2-dbeb-4ae4-8423-ce55964c4258/os-volume_attachments => generated 194 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 16:30:26 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-d3ff97e3-c1eb-4deb-a4d6-176498695190 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:30:26 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-d3ff97e3-c1eb-4deb-a4d6-176498695190 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:30:26 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-d3ff97e3-c1eb-4deb-a4d6-176498695190 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:30:26 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-d3ff97e3-c1eb-4deb-a4d6-176498695190 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:30:26 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-d3ff97e3-c1eb-4deb-a4d6-176498695190 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:30:26 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-d3ff97e3-c1eb-4deb-a4d6-176498695190 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:30:26 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-d3ff97e3-c1eb-4deb-a4d6-176498695190 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:30:26 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-d3ff97e3-c1eb-4deb-a4d6-176498695190 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:30:26 user devstack@n-api.service[62054]: DEBUG nova.objects.instance [None req-d3ff97e3-c1eb-4deb-a4d6-176498695190 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lazy-loading 'services' on Instance uuid acbcaee0-a47b-4fee-8765-9b1c9597d515 {{(pid=62054) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 16:30:26 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-d3ff97e3-c1eb-4deb-a4d6-176498695190 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/acbcaee0-a47b-4fee-8765-9b1c9597d515/os-volume_attachments/d53e720e-a9ca-499b-aacd-aad1a169a874" status: 202 len: 0 microversion: 2.1 time: 0.162010 Apr 13 16:30:26 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 181/534] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 16:30:26 2023] DELETE /compute/v2.1/servers/acbcaee0-a47b-4fee-8765-9b1c9597d515/os-volume_attachments/d53e720e-a9ca-499b-aacd-aad1a169a874 => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 16:30:26 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-6351fb27-6e1e-48c7-9b38-6f8d7fbe97f6 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:30:26 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-6351fb27-6e1e-48c7-9b38-6f8d7fbe97f6 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:30:26 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-6351fb27-6e1e-48c7-9b38-6f8d7fbe97f6 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:30:26 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-6351fb27-6e1e-48c7-9b38-6f8d7fbe97f6 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:30:26 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-6351fb27-6e1e-48c7-9b38-6f8d7fbe97f6 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:30:26 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-6351fb27-6e1e-48c7-9b38-6f8d7fbe97f6 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:30:26 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-6351fb27-6e1e-48c7-9b38-6f8d7fbe97f6 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:30:26 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-6351fb27-6e1e-48c7-9b38-6f8d7fbe97f6 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:30:26 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-6351fb27-6e1e-48c7-9b38-6f8d7fbe97f6 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] 10.0.0.210 "GET /compute/v2.1/servers/acbcaee0-a47b-4fee-8765-9b1c9597d515/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061457 Apr 13 16:30:26 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 178/535] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 16:30:26 2023] GET /compute/v2.1/servers/acbcaee0-a47b-4fee-8765-9b1c9597d515/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:30:34 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_api:SELECT=2 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:30:34 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:30:34 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-3bf92eaf-140c-4221-af24-83955a626441 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:30:34 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-3bf92eaf-140c-4221-af24-83955a626441 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] [instance: 32b18558-8bf2-4def-bc70-81c4e38fcc6f] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:30:34 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-3bf92eaf-140c-4221-af24-83955a626441 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:30:34 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-3bf92eaf-140c-4221-af24-83955a626441 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:30:34 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-3bf92eaf-140c-4221-af24-83955a626441 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:30:34 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-3bf92eaf-140c-4221-af24-83955a626441 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:30:34 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-3bf92eaf-140c-4221-af24-83955a626441 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:30:34 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-3bf92eaf-140c-4221-af24-83955a626441 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:30:34 user devstack@n-api.service[62055]: DEBUG nova.policy [None req-3bf92eaf-140c-4221-af24-83955a626441 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f523740272844b6eb236477d0b116ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7100b359f341759cb6f6753e1539a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62055) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:30:34 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-3bf92eaf-140c-4221-af24-83955a626441 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] 10.0.0.210 "GET /compute/v2.1/servers/32b18558-8bf2-4def-bc70-81c4e38fcc6f" status: 200 len: 1538 microversion: 2.1 time: 0.159722 Apr 13 16:30:34 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 177/536] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:30:34 2023] GET /compute/v2.1/servers/32b18558-8bf2-4def-bc70-81c4e38fcc6f => generated 1538 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:30:35 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-be4538fb-4477-484a-91b6-4eb26579e3ca tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:30:35 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-be4538fb-4477-484a-91b6-4eb26579e3ca tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 5ea4ab6a-6501-4a2f-a8f7-04090024747d] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:30:35 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-be4538fb-4477-484a-91b6-4eb26579e3ca tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:30:35 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-be4538fb-4477-484a-91b6-4eb26579e3ca tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:30:35 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-be4538fb-4477-484a-91b6-4eb26579e3ca tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:30:35 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-be4538fb-4477-484a-91b6-4eb26579e3ca tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:30:35 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-be4538fb-4477-484a-91b6-4eb26579e3ca tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:30:35 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-be4538fb-4477-484a-91b6-4eb26579e3ca tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:30:35 user devstack@n-api.service[62054]: INFO nova.api.openstack.wsgi [None req-be4538fb-4477-484a-91b6-4eb26579e3ca tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] HTTP exception thrown: Instance 5ea4ab6a-6501-4a2f-a8f7-04090024747d could not be found. Apr 13 16:30:35 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-be4538fb-4477-484a-91b6-4eb26579e3ca tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Request method failure captured: Apr 13 16:30:35 user devstack@n-api.service[62054]: request: GET /compute/v2.1/servers/5ea4ab6a-6501-4a2f-a8f7-04090024747d HTTP/1.1 Apr 13 16:30:35 user devstack@n-api.service[62054]: Accept: application/json Apr 13 16:30:35 user devstack@n-api.service[62054]: Accept-Encoding: identity Apr 13 16:30:35 user devstack@n-api.service[62054]: Connection: close Apr 13 16:30:35 user devstack@n-api.service[62054]: Content-Length: 0 Apr 13 16:30:35 user devstack@n-api.service[62054]: Content-Type: application/json Apr 13 16:30:35 user devstack@n-api.service[62054]: Host: 10.0.0.210 Apr 13 16:30:35 user devstack@n-api.service[62054]: Openstack-System-Scope: None Apr 13 16:30:35 user devstack@n-api.service[62054]: User-Agent: python-urllib3/1.26.15 Apr 13 16:30:35 user devstack@n-api.service[62054]: X-Auth-Token: gAAAAABkOCwkI2hCVv3q2RMbn5sWNaNksO2jlEae5ib0A_n2-4Ip_Pl-WyakKOiBGyr1g-8idBZHWfWrP88wr7DW2Z-7RXK4r2oTVrS71NZCSisAoUDBhj4KwKB40I0svywhzMPIjrB1h0EwajlcYKhM2GYo5FTaZ-MnJbSWEwEZAY8gyi1eSaE Apr 13 16:30:35 user devstack@n-api.service[62054]: X-Domain-Id: None Apr 13 16:30:35 user devstack@n-api.service[62054]: X-Domain-Name: None Apr 13 16:30:35 user devstack@n-api.service[62054]: X-Identity-Status: Confirmed Apr 13 16:30:35 user devstack@n-api.service[62054]: X-Is-Admin-Project: True Apr 13 16:30:35 user devstack@n-api.service[62054]: X-Project-Domain-Id: default Apr 13 16:30:35 user devstack@n-api.service[62054]: X-Project-Domain-Name: Default Apr 13 16:30:35 user devstack@n-api.service[62054]: X-Project-Id: 8d451e0e239f486aa2b3abe9e273eab3 Apr 13 16:30:35 user devstack@n-api.service[62054]: X-Project-Name: tempest-TestVolumeBootPattern-438786227 Apr 13 16:30:35 user devstack@n-api.service[62054]: X-Role: reader,member Apr 13 16:30:35 user devstack@n-api.service[62054]: X-Roles: reader,member Apr 13 16:30:35 user devstack@n-api.service[62054]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8d451e0e239f486aa2b3abe9e273eab3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8d451e0e239f486aa2b3abe9e273eab3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8d451e0e239f486aa2b3abe9e273eab3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 13 16:30:35 user devstack@n-api.service[62054]: X-Tenant: tempest-TestVolumeBootPattern-438786227 Apr 13 16:30:35 user devstack@n-api.service[62054]: X-Tenant-Id: 8d451e0e239f486aa2b3abe9e273eab3 Apr 13 16:30:35 user devstack@n-api.service[62054]: X-Tenant-Name: tempest-TestVolumeBootPattern-438786227 Apr 13 16:30:35 user devstack@n-api.service[62054]: X-User: tempest-TestVolumeBootPattern-438786227-project-member Apr 13 16:30:35 user devstack@n-api.service[62054]: X-User-Domain-Id: default Apr 13 16:30:35 user devstack@n-api.service[62054]: X-User-Domain-Name: Default Apr 13 16:30:35 user devstack@n-api.service[62054]: X-User-Id: d70e10f63cdd49a9a1ebe1fe4c9de0a2 Apr 13 16:30:35 user devstack@n-api.service[62054]: X-User-Name: tempest-TestVolumeBootPattern-438786227-project-member Apr 13 16:30:35 user devstack@n-api.service[62054]: method: > Apr 13 16:30:35 user devstack@n-api.service[62054]: exception: Instance 5ea4ab6a-6501-4a2f-a8f7-04090024747d could not be found. Apr 13 16:30:35 user devstack@n-api.service[62054]: action_args: {'id': '5ea4ab6a-6501-4a2f-a8f7-04090024747d'} Apr 13 16:30:35 user devstack@n-api.service[62054]: {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 16:30:35 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:30:35 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 16:30:35 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 16:30:35 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 16:30:35 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 16:30:35 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 16:30:35 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 16:30:35 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 16:30:35 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 16:30:35 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ea4ab6a-6501-4a2f-a8f7-04090024747d could not be found. Apr 13 16:30:35 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:30:35 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:30:35 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:30:35 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:30:35 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 16:30:35 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 16:30:35 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 16:30:35 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 16:30:35 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 16:30:35 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 16:30:35 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 16:30:35 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 16:30:35 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 16:30:35 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 16:30:35 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 16:30:35 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 16:30:35 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ea4ab6a-6501-4a2f-a8f7-04090024747d could not be found. Apr 13 16:30:35 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:30:35 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:30:35 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:30:35 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:30:35 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 16:30:35 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 16:30:35 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 16:30:35 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 16:30:35 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ea4ab6a-6501-4a2f-a8f7-04090024747d could not be found. Apr 13 16:30:35 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:30:35 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-be4538fb-4477-484a-91b6-4eb26579e3ca tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Returning 404 to user: Instance 5ea4ab6a-6501-4a2f-a8f7-04090024747d could not be found. {{(pid=62054) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 16:30:35 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-be4538fb-4477-484a-91b6-4eb26579e3ca tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5ea4ab6a-6501-4a2f-a8f7-04090024747d" status: 404 len: 111 microversion: 2.1 time: 0.035631 Apr 13 16:30:35 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 182/537] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:30:35 2023] GET /compute/v2.1/servers/5ea4ab6a-6501-4a2f-a8f7-04090024747d => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 16:30:35 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-275a5ba8-9963-4b4d-a07d-80d01ca7923c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:30:35 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-275a5ba8-9963-4b4d-a07d-80d01ca7923c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 0f52d9e3-921c-4f79-9cdb-7d73500c8c35] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:30:35 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-275a5ba8-9963-4b4d-a07d-80d01ca7923c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:30:35 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-275a5ba8-9963-4b4d-a07d-80d01ca7923c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:30:35 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-275a5ba8-9963-4b4d-a07d-80d01ca7923c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:30:35 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-275a5ba8-9963-4b4d-a07d-80d01ca7923c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:30:35 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-275a5ba8-9963-4b4d-a07d-80d01ca7923c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:30:35 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-275a5ba8-9963-4b4d-a07d-80d01ca7923c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:30:35 user devstack@n-api.service[62053]: INFO nova.api.openstack.wsgi [None req-275a5ba8-9963-4b4d-a07d-80d01ca7923c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] HTTP exception thrown: Instance 0f52d9e3-921c-4f79-9cdb-7d73500c8c35 could not be found. Apr 13 16:30:35 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-275a5ba8-9963-4b4d-a07d-80d01ca7923c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Request method failure captured: Apr 13 16:30:35 user devstack@n-api.service[62053]: request: DELETE /compute/v2.1/servers/0f52d9e3-921c-4f79-9cdb-7d73500c8c35 HTTP/1.1 Apr 13 16:30:35 user devstack@n-api.service[62053]: Accept: application/json Apr 13 16:30:35 user devstack@n-api.service[62053]: Accept-Encoding: identity Apr 13 16:30:35 user devstack@n-api.service[62053]: Connection: close Apr 13 16:30:35 user devstack@n-api.service[62053]: Content-Length: 0 Apr 13 16:30:35 user devstack@n-api.service[62053]: Content-Type: application/json Apr 13 16:30:35 user devstack@n-api.service[62053]: Host: 10.0.0.210 Apr 13 16:30:35 user devstack@n-api.service[62053]: Openstack-System-Scope: None Apr 13 16:30:35 user devstack@n-api.service[62053]: User-Agent: python-urllib3/1.26.15 Apr 13 16:30:35 user devstack@n-api.service[62053]: X-Auth-Token: gAAAAABkOCwkI2hCVv3q2RMbn5sWNaNksO2jlEae5ib0A_n2-4Ip_Pl-WyakKOiBGyr1g-8idBZHWfWrP88wr7DW2Z-7RXK4r2oTVrS71NZCSisAoUDBhj4KwKB40I0svywhzMPIjrB1h0EwajlcYKhM2GYo5FTaZ-MnJbSWEwEZAY8gyi1eSaE Apr 13 16:30:35 user devstack@n-api.service[62053]: X-Domain-Id: None Apr 13 16:30:35 user devstack@n-api.service[62053]: X-Domain-Name: None Apr 13 16:30:35 user devstack@n-api.service[62053]: X-Identity-Status: Confirmed Apr 13 16:30:35 user devstack@n-api.service[62053]: X-Is-Admin-Project: True Apr 13 16:30:35 user devstack@n-api.service[62053]: X-Project-Domain-Id: default Apr 13 16:30:35 user devstack@n-api.service[62053]: X-Project-Domain-Name: Default Apr 13 16:30:35 user devstack@n-api.service[62053]: X-Project-Id: 8d451e0e239f486aa2b3abe9e273eab3 Apr 13 16:30:35 user devstack@n-api.service[62053]: X-Project-Name: tempest-TestVolumeBootPattern-438786227 Apr 13 16:30:35 user devstack@n-api.service[62053]: X-Role: reader,member Apr 13 16:30:35 user devstack@n-api.service[62053]: X-Roles: reader,member Apr 13 16:30:35 user devstack@n-api.service[62053]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8d451e0e239f486aa2b3abe9e273eab3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8d451e0e239f486aa2b3abe9e273eab3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8d451e0e239f486aa2b3abe9e273eab3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 13 16:30:35 user devstack@n-api.service[62053]: X-Tenant: tempest-TestVolumeBootPattern-438786227 Apr 13 16:30:35 user devstack@n-api.service[62053]: X-Tenant-Id: 8d451e0e239f486aa2b3abe9e273eab3 Apr 13 16:30:35 user devstack@n-api.service[62053]: X-Tenant-Name: tempest-TestVolumeBootPattern-438786227 Apr 13 16:30:35 user devstack@n-api.service[62053]: X-User: tempest-TestVolumeBootPattern-438786227-project-member Apr 13 16:30:35 user devstack@n-api.service[62053]: X-User-Domain-Id: default Apr 13 16:30:35 user devstack@n-api.service[62053]: X-User-Domain-Name: Default Apr 13 16:30:35 user devstack@n-api.service[62053]: X-User-Id: d70e10f63cdd49a9a1ebe1fe4c9de0a2 Apr 13 16:30:35 user devstack@n-api.service[62053]: X-User-Name: tempest-TestVolumeBootPattern-438786227-project-member Apr 13 16:30:35 user devstack@n-api.service[62053]: method: > Apr 13 16:30:35 user devstack@n-api.service[62053]: exception: Instance 0f52d9e3-921c-4f79-9cdb-7d73500c8c35 could not be found. Apr 13 16:30:35 user devstack@n-api.service[62053]: action_args: {'id': '0f52d9e3-921c-4f79-9cdb-7d73500c8c35'} Apr 13 16:30:35 user devstack@n-api.service[62053]: {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 16:30:35 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:30:35 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 16:30:35 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 16:30:35 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 16:30:35 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 16:30:35 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 16:30:35 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 16:30:35 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 16:30:35 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 16:30:35 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f52d9e3-921c-4f79-9cdb-7d73500c8c35 could not be found. Apr 13 16:30:35 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:30:35 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:30:35 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:30:35 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:30:35 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 16:30:35 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 16:30:35 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 16:30:35 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 16:30:35 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 16:30:35 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 16:30:35 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 16:30:35 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 16:30:35 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 16:30:35 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 16:30:35 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 16:30:35 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 16:30:35 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 16:30:35 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 16:30:35 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f52d9e3-921c-4f79-9cdb-7d73500c8c35 could not be found. Apr 13 16:30:35 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:30:35 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:30:35 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:30:35 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:30:35 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 16:30:35 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 16:30:35 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 16:30:35 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 16:30:35 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f52d9e3-921c-4f79-9cdb-7d73500c8c35 could not be found. Apr 13 16:30:35 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:30:35 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-275a5ba8-9963-4b4d-a07d-80d01ca7923c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Returning 404 to user: Instance 0f52d9e3-921c-4f79-9cdb-7d73500c8c35 could not be found. {{(pid=62053) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 16:30:35 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-275a5ba8-9963-4b4d-a07d-80d01ca7923c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0f52d9e3-921c-4f79-9cdb-7d73500c8c35" status: 404 len: 111 microversion: 2.1 time: 0.028047 Apr 13 16:30:35 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 179/538] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 16:30:35 2023] DELETE /compute/v2.1/servers/0f52d9e3-921c-4f79-9cdb-7d73500c8c35 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 16:30:35 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-0c806e3c-203d-45be-bd9b-1416b981945d tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:30:35 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-0c806e3c-203d-45be-bd9b-1416b981945d tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 0f52d9e3-921c-4f79-9cdb-7d73500c8c35] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:30:35 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-0c806e3c-203d-45be-bd9b-1416b981945d tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:30:35 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-0c806e3c-203d-45be-bd9b-1416b981945d tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:30:35 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-0c806e3c-203d-45be-bd9b-1416b981945d tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:30:35 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-0c806e3c-203d-45be-bd9b-1416b981945d tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:30:35 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-0c806e3c-203d-45be-bd9b-1416b981945d tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:30:35 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-0c806e3c-203d-45be-bd9b-1416b981945d tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:30:35 user devstack@n-api.service[62055]: INFO nova.api.openstack.wsgi [None req-0c806e3c-203d-45be-bd9b-1416b981945d tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] HTTP exception thrown: Instance 0f52d9e3-921c-4f79-9cdb-7d73500c8c35 could not be found. Apr 13 16:30:35 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-0c806e3c-203d-45be-bd9b-1416b981945d tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Request method failure captured: Apr 13 16:30:35 user devstack@n-api.service[62055]: request: GET /compute/v2.1/servers/0f52d9e3-921c-4f79-9cdb-7d73500c8c35 HTTP/1.1 Apr 13 16:30:35 user devstack@n-api.service[62055]: Accept: application/json Apr 13 16:30:35 user devstack@n-api.service[62055]: Accept-Encoding: identity Apr 13 16:30:35 user devstack@n-api.service[62055]: Connection: close Apr 13 16:30:35 user devstack@n-api.service[62055]: Content-Length: 0 Apr 13 16:30:35 user devstack@n-api.service[62055]: Content-Type: application/json Apr 13 16:30:35 user devstack@n-api.service[62055]: Host: 10.0.0.210 Apr 13 16:30:35 user devstack@n-api.service[62055]: Openstack-System-Scope: None Apr 13 16:30:35 user devstack@n-api.service[62055]: User-Agent: python-urllib3/1.26.15 Apr 13 16:30:35 user devstack@n-api.service[62055]: X-Auth-Token: gAAAAABkOCwkI2hCVv3q2RMbn5sWNaNksO2jlEae5ib0A_n2-4Ip_Pl-WyakKOiBGyr1g-8idBZHWfWrP88wr7DW2Z-7RXK4r2oTVrS71NZCSisAoUDBhj4KwKB40I0svywhzMPIjrB1h0EwajlcYKhM2GYo5FTaZ-MnJbSWEwEZAY8gyi1eSaE Apr 13 16:30:35 user devstack@n-api.service[62055]: X-Domain-Id: None Apr 13 16:30:35 user devstack@n-api.service[62055]: X-Domain-Name: None Apr 13 16:30:35 user devstack@n-api.service[62055]: X-Identity-Status: Confirmed Apr 13 16:30:35 user devstack@n-api.service[62055]: X-Is-Admin-Project: True Apr 13 16:30:35 user devstack@n-api.service[62055]: X-Project-Domain-Id: default Apr 13 16:30:35 user devstack@n-api.service[62055]: X-Project-Domain-Name: Default Apr 13 16:30:35 user devstack@n-api.service[62055]: X-Project-Id: 8d451e0e239f486aa2b3abe9e273eab3 Apr 13 16:30:35 user devstack@n-api.service[62055]: X-Project-Name: tempest-TestVolumeBootPattern-438786227 Apr 13 16:30:35 user devstack@n-api.service[62055]: X-Role: reader,member Apr 13 16:30:35 user devstack@n-api.service[62055]: X-Roles: reader,member Apr 13 16:30:35 user devstack@n-api.service[62055]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8d451e0e239f486aa2b3abe9e273eab3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8d451e0e239f486aa2b3abe9e273eab3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8d451e0e239f486aa2b3abe9e273eab3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 13 16:30:35 user devstack@n-api.service[62055]: X-Tenant: tempest-TestVolumeBootPattern-438786227 Apr 13 16:30:35 user devstack@n-api.service[62055]: X-Tenant-Id: 8d451e0e239f486aa2b3abe9e273eab3 Apr 13 16:30:35 user devstack@n-api.service[62055]: X-Tenant-Name: tempest-TestVolumeBootPattern-438786227 Apr 13 16:30:35 user devstack@n-api.service[62055]: X-User: tempest-TestVolumeBootPattern-438786227-project-member Apr 13 16:30:35 user devstack@n-api.service[62055]: X-User-Domain-Id: default Apr 13 16:30:35 user devstack@n-api.service[62055]: X-User-Domain-Name: Default Apr 13 16:30:35 user devstack@n-api.service[62055]: X-User-Id: d70e10f63cdd49a9a1ebe1fe4c9de0a2 Apr 13 16:30:35 user devstack@n-api.service[62055]: X-User-Name: tempest-TestVolumeBootPattern-438786227-project-member Apr 13 16:30:35 user devstack@n-api.service[62055]: method: > Apr 13 16:30:35 user devstack@n-api.service[62055]: exception: Instance 0f52d9e3-921c-4f79-9cdb-7d73500c8c35 could not be found. Apr 13 16:30:35 user devstack@n-api.service[62055]: action_args: {'id': '0f52d9e3-921c-4f79-9cdb-7d73500c8c35'} Apr 13 16:30:35 user devstack@n-api.service[62055]: {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 16:30:35 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:30:35 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 16:30:35 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 16:30:35 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 16:30:35 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 16:30:35 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 16:30:35 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 16:30:35 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 16:30:35 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 16:30:35 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f52d9e3-921c-4f79-9cdb-7d73500c8c35 could not be found. Apr 13 16:30:35 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:30:35 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:30:35 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:30:35 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:30:35 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 16:30:35 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 16:30:35 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 16:30:35 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 16:30:35 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 16:30:35 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 16:30:35 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 16:30:35 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 16:30:35 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 16:30:35 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 16:30:35 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 16:30:35 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 16:30:35 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f52d9e3-921c-4f79-9cdb-7d73500c8c35 could not be found. Apr 13 16:30:35 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:30:35 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:30:35 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:30:35 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:30:35 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 16:30:35 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 16:30:35 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 16:30:35 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 16:30:35 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f52d9e3-921c-4f79-9cdb-7d73500c8c35 could not be found. Apr 13 16:30:35 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:30:35 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-0c806e3c-203d-45be-bd9b-1416b981945d tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Returning 404 to user: Instance 0f52d9e3-921c-4f79-9cdb-7d73500c8c35 could not be found. {{(pid=62055) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 16:30:35 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-0c806e3c-203d-45be-bd9b-1416b981945d tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0f52d9e3-921c-4f79-9cdb-7d73500c8c35" status: 404 len: 111 microversion: 2.1 time: 0.035586 Apr 13 16:30:35 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 178/539] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:30:35 2023] GET /compute/v2.1/servers/0f52d9e3-921c-4f79-9cdb-7d73500c8c35 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 16:30:36 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-f1fe3a4a-0e4b-4118-a197-f327af21edee tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:30:36 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-f1fe3a4a-0e4b-4118-a197-f327af21edee tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 5ea4ab6a-6501-4a2f-a8f7-04090024747d] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:30:36 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-f1fe3a4a-0e4b-4118-a197-f327af21edee tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:30:36 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-f1fe3a4a-0e4b-4118-a197-f327af21edee tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:30:36 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-f1fe3a4a-0e4b-4118-a197-f327af21edee tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:30:36 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-f1fe3a4a-0e4b-4118-a197-f327af21edee tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:30:36 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-f1fe3a4a-0e4b-4118-a197-f327af21edee tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:30:36 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-f1fe3a4a-0e4b-4118-a197-f327af21edee tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:30:36 user devstack@n-api.service[62054]: INFO nova.api.openstack.wsgi [None req-f1fe3a4a-0e4b-4118-a197-f327af21edee tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] HTTP exception thrown: Instance 5ea4ab6a-6501-4a2f-a8f7-04090024747d could not be found. Apr 13 16:30:36 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-f1fe3a4a-0e4b-4118-a197-f327af21edee tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Request method failure captured: Apr 13 16:30:36 user devstack@n-api.service[62054]: request: DELETE /compute/v2.1/servers/5ea4ab6a-6501-4a2f-a8f7-04090024747d HTTP/1.1 Apr 13 16:30:36 user devstack@n-api.service[62054]: Accept: application/json Apr 13 16:30:36 user devstack@n-api.service[62054]: Accept-Encoding: identity Apr 13 16:30:36 user devstack@n-api.service[62054]: Connection: close Apr 13 16:30:36 user devstack@n-api.service[62054]: Content-Length: 0 Apr 13 16:30:36 user devstack@n-api.service[62054]: Content-Type: application/json Apr 13 16:30:36 user devstack@n-api.service[62054]: Host: 10.0.0.210 Apr 13 16:30:36 user devstack@n-api.service[62054]: Openstack-System-Scope: None Apr 13 16:30:36 user devstack@n-api.service[62054]: User-Agent: python-urllib3/1.26.15 Apr 13 16:30:36 user devstack@n-api.service[62054]: X-Auth-Token: gAAAAABkOCwkI2hCVv3q2RMbn5sWNaNksO2jlEae5ib0A_n2-4Ip_Pl-WyakKOiBGyr1g-8idBZHWfWrP88wr7DW2Z-7RXK4r2oTVrS71NZCSisAoUDBhj4KwKB40I0svywhzMPIjrB1h0EwajlcYKhM2GYo5FTaZ-MnJbSWEwEZAY8gyi1eSaE Apr 13 16:30:36 user devstack@n-api.service[62054]: X-Domain-Id: None Apr 13 16:30:36 user devstack@n-api.service[62054]: X-Domain-Name: None Apr 13 16:30:36 user devstack@n-api.service[62054]: X-Identity-Status: Confirmed Apr 13 16:30:36 user devstack@n-api.service[62054]: X-Is-Admin-Project: True Apr 13 16:30:36 user devstack@n-api.service[62054]: X-Project-Domain-Id: default Apr 13 16:30:36 user devstack@n-api.service[62054]: X-Project-Domain-Name: Default Apr 13 16:30:36 user devstack@n-api.service[62054]: X-Project-Id: 8d451e0e239f486aa2b3abe9e273eab3 Apr 13 16:30:36 user devstack@n-api.service[62054]: X-Project-Name: tempest-TestVolumeBootPattern-438786227 Apr 13 16:30:36 user devstack@n-api.service[62054]: X-Role: reader,member Apr 13 16:30:36 user devstack@n-api.service[62054]: X-Roles: reader,member Apr 13 16:30:36 user devstack@n-api.service[62054]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8d451e0e239f486aa2b3abe9e273eab3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8d451e0e239f486aa2b3abe9e273eab3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8d451e0e239f486aa2b3abe9e273eab3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 13 16:30:36 user devstack@n-api.service[62054]: X-Tenant: tempest-TestVolumeBootPattern-438786227 Apr 13 16:30:36 user devstack@n-api.service[62054]: X-Tenant-Id: 8d451e0e239f486aa2b3abe9e273eab3 Apr 13 16:30:36 user devstack@n-api.service[62054]: X-Tenant-Name: tempest-TestVolumeBootPattern-438786227 Apr 13 16:30:36 user devstack@n-api.service[62054]: X-User: tempest-TestVolumeBootPattern-438786227-project-member Apr 13 16:30:36 user devstack@n-api.service[62054]: X-User-Domain-Id: default Apr 13 16:30:36 user devstack@n-api.service[62054]: X-User-Domain-Name: Default Apr 13 16:30:36 user devstack@n-api.service[62054]: X-User-Id: d70e10f63cdd49a9a1ebe1fe4c9de0a2 Apr 13 16:30:36 user devstack@n-api.service[62054]: X-User-Name: tempest-TestVolumeBootPattern-438786227-project-member Apr 13 16:30:36 user devstack@n-api.service[62054]: method: > Apr 13 16:30:36 user devstack@n-api.service[62054]: exception: Instance 5ea4ab6a-6501-4a2f-a8f7-04090024747d could not be found. Apr 13 16:30:36 user devstack@n-api.service[62054]: action_args: {'id': '5ea4ab6a-6501-4a2f-a8f7-04090024747d'} Apr 13 16:30:36 user devstack@n-api.service[62054]: {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 16:30:36 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:30:36 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 16:30:36 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 16:30:36 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 16:30:36 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 16:30:36 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 16:30:36 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 16:30:36 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 16:30:36 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 16:30:36 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ea4ab6a-6501-4a2f-a8f7-04090024747d could not be found. Apr 13 16:30:36 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:30:36 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:30:36 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:30:36 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:30:36 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 16:30:36 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 16:30:36 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 16:30:36 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 16:30:36 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 16:30:36 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 16:30:36 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 16:30:36 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 16:30:36 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 16:30:36 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 16:30:36 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 16:30:36 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 16:30:36 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 16:30:36 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 16:30:36 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ea4ab6a-6501-4a2f-a8f7-04090024747d could not be found. Apr 13 16:30:36 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:30:36 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:30:36 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:30:36 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:30:36 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 16:30:36 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 16:30:36 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 16:30:36 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 16:30:36 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ea4ab6a-6501-4a2f-a8f7-04090024747d could not be found. Apr 13 16:30:36 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:30:36 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-f1fe3a4a-0e4b-4118-a197-f327af21edee tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Returning 404 to user: Instance 5ea4ab6a-6501-4a2f-a8f7-04090024747d could not be found. {{(pid=62054) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 16:30:36 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-f1fe3a4a-0e4b-4118-a197-f327af21edee tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5ea4ab6a-6501-4a2f-a8f7-04090024747d" status: 404 len: 111 microversion: 2.1 time: 0.028443 Apr 13 16:30:36 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 183/540] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 16:30:36 2023] DELETE /compute/v2.1/servers/5ea4ab6a-6501-4a2f-a8f7-04090024747d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 16:30:36 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-231d5c7e-785b-4f95-8d5e-908bd7fe3638 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:30:36 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-231d5c7e-785b-4f95-8d5e-908bd7fe3638 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 5ea4ab6a-6501-4a2f-a8f7-04090024747d] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:30:36 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-231d5c7e-785b-4f95-8d5e-908bd7fe3638 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:30:36 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-231d5c7e-785b-4f95-8d5e-908bd7fe3638 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:30:36 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-231d5c7e-785b-4f95-8d5e-908bd7fe3638 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:30:36 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-231d5c7e-785b-4f95-8d5e-908bd7fe3638 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:30:36 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-231d5c7e-785b-4f95-8d5e-908bd7fe3638 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:30:36 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-231d5c7e-785b-4f95-8d5e-908bd7fe3638 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:30:36 user devstack@n-api.service[62053]: INFO nova.api.openstack.wsgi [None req-231d5c7e-785b-4f95-8d5e-908bd7fe3638 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] HTTP exception thrown: Instance 5ea4ab6a-6501-4a2f-a8f7-04090024747d could not be found. Apr 13 16:30:36 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-231d5c7e-785b-4f95-8d5e-908bd7fe3638 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Request method failure captured: Apr 13 16:30:36 user devstack@n-api.service[62053]: request: GET /compute/v2.1/servers/5ea4ab6a-6501-4a2f-a8f7-04090024747d HTTP/1.1 Apr 13 16:30:36 user devstack@n-api.service[62053]: Accept: application/json Apr 13 16:30:36 user devstack@n-api.service[62053]: Accept-Encoding: identity Apr 13 16:30:36 user devstack@n-api.service[62053]: Connection: close Apr 13 16:30:36 user devstack@n-api.service[62053]: Content-Length: 0 Apr 13 16:30:36 user devstack@n-api.service[62053]: Content-Type: application/json Apr 13 16:30:36 user devstack@n-api.service[62053]: Host: 10.0.0.210 Apr 13 16:30:36 user devstack@n-api.service[62053]: Openstack-System-Scope: None Apr 13 16:30:36 user devstack@n-api.service[62053]: User-Agent: python-urllib3/1.26.15 Apr 13 16:30:36 user devstack@n-api.service[62053]: X-Auth-Token: gAAAAABkOCwkI2hCVv3q2RMbn5sWNaNksO2jlEae5ib0A_n2-4Ip_Pl-WyakKOiBGyr1g-8idBZHWfWrP88wr7DW2Z-7RXK4r2oTVrS71NZCSisAoUDBhj4KwKB40I0svywhzMPIjrB1h0EwajlcYKhM2GYo5FTaZ-MnJbSWEwEZAY8gyi1eSaE Apr 13 16:30:36 user devstack@n-api.service[62053]: X-Domain-Id: None Apr 13 16:30:36 user devstack@n-api.service[62053]: X-Domain-Name: None Apr 13 16:30:36 user devstack@n-api.service[62053]: X-Identity-Status: Confirmed Apr 13 16:30:36 user devstack@n-api.service[62053]: X-Is-Admin-Project: True Apr 13 16:30:36 user devstack@n-api.service[62053]: X-Project-Domain-Id: default Apr 13 16:30:36 user devstack@n-api.service[62053]: X-Project-Domain-Name: Default Apr 13 16:30:36 user devstack@n-api.service[62053]: X-Project-Id: 8d451e0e239f486aa2b3abe9e273eab3 Apr 13 16:30:36 user devstack@n-api.service[62053]: X-Project-Name: tempest-TestVolumeBootPattern-438786227 Apr 13 16:30:36 user devstack@n-api.service[62053]: X-Role: reader,member Apr 13 16:30:36 user devstack@n-api.service[62053]: X-Roles: reader,member Apr 13 16:30:36 user devstack@n-api.service[62053]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8d451e0e239f486aa2b3abe9e273eab3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8d451e0e239f486aa2b3abe9e273eab3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8d451e0e239f486aa2b3abe9e273eab3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 13 16:30:36 user devstack@n-api.service[62053]: X-Tenant: tempest-TestVolumeBootPattern-438786227 Apr 13 16:30:36 user devstack@n-api.service[62053]: X-Tenant-Id: 8d451e0e239f486aa2b3abe9e273eab3 Apr 13 16:30:36 user devstack@n-api.service[62053]: X-Tenant-Name: tempest-TestVolumeBootPattern-438786227 Apr 13 16:30:36 user devstack@n-api.service[62053]: X-User: tempest-TestVolumeBootPattern-438786227-project-member Apr 13 16:30:36 user devstack@n-api.service[62053]: X-User-Domain-Id: default Apr 13 16:30:36 user devstack@n-api.service[62053]: X-User-Domain-Name: Default Apr 13 16:30:36 user devstack@n-api.service[62053]: X-User-Id: d70e10f63cdd49a9a1ebe1fe4c9de0a2 Apr 13 16:30:36 user devstack@n-api.service[62053]: X-User-Name: tempest-TestVolumeBootPattern-438786227-project-member Apr 13 16:30:36 user devstack@n-api.service[62053]: method: > Apr 13 16:30:36 user devstack@n-api.service[62053]: exception: Instance 5ea4ab6a-6501-4a2f-a8f7-04090024747d could not be found. Apr 13 16:30:36 user devstack@n-api.service[62053]: action_args: {'id': '5ea4ab6a-6501-4a2f-a8f7-04090024747d'} Apr 13 16:30:36 user devstack@n-api.service[62053]: {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 16:30:36 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:30:36 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 16:30:36 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 16:30:36 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 16:30:36 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 16:30:36 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 16:30:36 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 16:30:36 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 16:30:36 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 16:30:36 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ea4ab6a-6501-4a2f-a8f7-04090024747d could not be found. Apr 13 16:30:36 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:30:36 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:30:36 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:30:36 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:30:36 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 16:30:36 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 16:30:36 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 16:30:36 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 16:30:36 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 16:30:36 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 16:30:36 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 16:30:36 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 16:30:36 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 16:30:36 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 16:30:36 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 16:30:36 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 16:30:36 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ea4ab6a-6501-4a2f-a8f7-04090024747d could not be found. Apr 13 16:30:36 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:30:36 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:30:36 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:30:36 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:30:36 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 16:30:36 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 16:30:36 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 16:30:36 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 16:30:36 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ea4ab6a-6501-4a2f-a8f7-04090024747d could not be found. Apr 13 16:30:36 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:30:36 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-231d5c7e-785b-4f95-8d5e-908bd7fe3638 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Returning 404 to user: Instance 5ea4ab6a-6501-4a2f-a8f7-04090024747d could not be found. {{(pid=62053) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 16:30:36 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-231d5c7e-785b-4f95-8d5e-908bd7fe3638 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5ea4ab6a-6501-4a2f-a8f7-04090024747d" status: 404 len: 111 microversion: 2.1 time: 0.027938 Apr 13 16:30:36 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 180/541] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:30:36 2023] GET /compute/v2.1/servers/5ea4ab6a-6501-4a2f-a8f7-04090024747d => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 16:30:36 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-2d52abc7-7181-447e-b02b-1c859e13b802 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Action: 'create', calling method: .version_select at 0x7f96dc72bc70>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1747083001", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIspJuW0ouAVIXdRkaEFP67MIl/YPuQkC9G3HjohNK4Y6ERboR/Jfb2q58aDhzUN+56TLqbLCfdFh2NtWLgvjHOwe+zpPoSYOKAkWLX+NSuU860pg4Djj9vwVgJj/Bkydw=="}} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:30:36 user devstack@n-api.service[62055]: DEBUG nova.quota [None req-2d52abc7-7181-447e-b02b-1c859e13b802 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Getting quotas for project 8d451e0e239f486aa2b3abe9e273eab3. Resources: {'key_pairs'} {{(pid=62055) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 16:30:36 user devstack@n-api.service[62055]: DEBUG nova.quota [None req-2d52abc7-7181-447e-b02b-1c859e13b802 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Getting quotas for user d70e10f63cdd49a9a1ebe1fe4c9de0a2 and project 8d451e0e239f486aa2b3abe9e273eab3. Resources: {'key_pairs'} {{(pid=62055) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 16:30:36 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-2d52abc7-7181-447e-b02b-1c859e13b802 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.058542 Apr 13 16:30:36 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 179/542] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 13 16:30:36 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:30:36 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-2497c27c-581d-4b6e-8ac3-bdd7e80963b2 req-a12d7ac5-4c23-41ef-af1b-6180bdd2322c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32b18558-8bf2-4def-bc70-81c4e38fcc6f", "tag": "f9afb5f6-d601-4106-85c8-6d6179433f28"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:30:36 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-2497c27c-581d-4b6e-8ac3-bdd7e80963b2 req-a12d7ac5-4c23-41ef-af1b-6180bdd2322c service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:30:36 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-2497c27c-581d-4b6e-8ac3-bdd7e80963b2 req-a12d7ac5-4c23-41ef-af1b-6180bdd2322c service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:30:36 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-2497c27c-581d-4b6e-8ac3-bdd7e80963b2 req-a12d7ac5-4c23-41ef-af1b-6180bdd2322c service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:30:36 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-48ff9fac-adf2-4223-b7ea-2b7a8d8d129a tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3030feb6-6893-43c8-84b8-46b8535c3077"}} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:30:36 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-48ff9fac-adf2-4223-b7ea-2b7a8d8d129a tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] [instance: 32b18558-8bf2-4def-bc70-81c4e38fcc6f] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:30:36 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-2497c27c-581d-4b6e-8ac3-bdd7e80963b2 req-a12d7ac5-4c23-41ef-af1b-6180bdd2322c service nova] Creating event network-changed:f9afb5f6-d601-4106-85c8-6d6179433f28 for instance 32b18558-8bf2-4def-bc70-81c4e38fcc6f on user Apr 13 16:30:36 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-48ff9fac-adf2-4223-b7ea-2b7a8d8d129a tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:30:36 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-48ff9fac-adf2-4223-b7ea-2b7a8d8d129a tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:30:36 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-48ff9fac-adf2-4223-b7ea-2b7a8d8d129a tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:30:36 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [req-2497c27c-581d-4b6e-8ac3-bdd7e80963b2 req-a12d7ac5-4c23-41ef-af1b-6180bdd2322c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.148468 Apr 13 16:30:36 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-48ff9fac-adf2-4223-b7ea-2b7a8d8d129a tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:30:36 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-48ff9fac-adf2-4223-b7ea-2b7a8d8d129a tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:30:36 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 184/543] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:30:36 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 16:30:36 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-48ff9fac-adf2-4223-b7ea-2b7a8d8d129a tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:30:36 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-48ff9fac-adf2-4223-b7ea-2b7a8d8d129a tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] 10.0.0.210 "POST /compute/v2.1/servers/32b18558-8bf2-4def-bc70-81c4e38fcc6f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.371872 Apr 13 16:30:36 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 181/544] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 16:30:36 2023] POST /compute/v2.1/servers/32b18558-8bf2-4def-bc70-81c4e38fcc6f/os-volume_attachments => generated 194 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 16:30:38 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-32354ff0-230a-4b7b-9e77-ae2db00b523b tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-462365621"}} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:30:38 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-32354ff0-230a-4b7b-9e77-ae2db00b523b tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 650427bd-4dad-4bcd-922d-c17e60b36807] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:30:38 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-32354ff0-230a-4b7b-9e77-ae2db00b523b tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:30:38 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-32354ff0-230a-4b7b-9e77-ae2db00b523b tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:30:38 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-32354ff0-230a-4b7b-9e77-ae2db00b523b tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:30:38 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-32354ff0-230a-4b7b-9e77-ae2db00b523b tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:30:38 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-32354ff0-230a-4b7b-9e77-ae2db00b523b tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:30:38 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-32354ff0-230a-4b7b-9e77-ae2db00b523b tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:30:39 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-d0e8136b-0448-434b-b21e-b9faa8ce66d1 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:30:39 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-d0e8136b-0448-434b-b21e-b9faa8ce66d1 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:30:39 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-d0e8136b-0448-434b-b21e-b9faa8ce66d1 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:30:39 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-d0e8136b-0448-434b-b21e-b9faa8ce66d1 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:30:39 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-d0e8136b-0448-434b-b21e-b9faa8ce66d1 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:30:39 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-d0e8136b-0448-434b-b21e-b9faa8ce66d1 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:30:39 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-d0e8136b-0448-434b-b21e-b9faa8ce66d1 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:30:39 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-d0e8136b-0448-434b-b21e-b9faa8ce66d1 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:30:39 user devstack@n-api.service[62054]: DEBUG nova.objects.instance [None req-d0e8136b-0448-434b-b21e-b9faa8ce66d1 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lazy-loading 'services' on Instance uuid bf98c3a2-dbeb-4ae4-8423-ce55964c4258 {{(pid=62054) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 16:30:39 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-d0e8136b-0448-434b-b21e-b9faa8ce66d1 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/bf98c3a2-dbeb-4ae4-8423-ce55964c4258/os-volume_attachments/5b3d0f80-78b5-444b-9440-b679010c3698" status: 202 len: 0 microversion: 2.1 time: 0.187410 Apr 13 16:30:39 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 185/545] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 16:30:39 2023] DELETE /compute/v2.1/servers/bf98c3a2-dbeb-4ae4-8423-ce55964c4258/os-volume_attachments/5b3d0f80-78b5-444b-9440-b679010c3698 => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 16:30:39 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-03cd582d-7d65-4c29-a1df-d658f543a78e tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:30:39 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-03cd582d-7d65-4c29-a1df-d658f543a78e tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:30:39 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-03cd582d-7d65-4c29-a1df-d658f543a78e tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:30:39 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-03cd582d-7d65-4c29-a1df-d658f543a78e tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:30:39 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-03cd582d-7d65-4c29-a1df-d658f543a78e tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:30:39 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-03cd582d-7d65-4c29-a1df-d658f543a78e tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:30:39 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-03cd582d-7d65-4c29-a1df-d658f543a78e tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:30:39 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-03cd582d-7d65-4c29-a1df-d658f543a78e tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:30:39 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-32354ff0-230a-4b7b-9e77-ae2db00b523b tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] 10.0.0.210 "POST /compute/v2.1/servers/650427bd-4dad-4bcd-922d-c17e60b36807/action" status: 202 len: 52 microversion: 2.87 time: 0.964739 Apr 13 16:30:39 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 180/546] 10.0.0.210 () {66 vars in 1396 bytes} [Thu Apr 13 16:30:38 2023] POST /compute/v2.1/servers/650427bd-4dad-4bcd-922d-c17e60b36807/action => generated 52 bytes in 969 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Apr 13 16:30:39 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-03cd582d-7d65-4c29-a1df-d658f543a78e tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bf98c3a2-dbeb-4ae4-8423-ce55964c4258/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048551 Apr 13 16:30:39 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 182/547] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 16:30:39 2023] GET /compute/v2.1/servers/bf98c3a2-dbeb-4ae4-8423-ce55964c4258/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:30:41 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-69ee0e73-9794-415c-a1cf-a95d8d739e7c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1444057207", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestVolumeBootPattern-1747083001", "security_groups": [{"name": "tempest-secgroup-smoke-1493908618"}], "block_device_mapping_v2": [{"uuid": "c2088266-1d33-4bb1-ac5b-1de832ff7985", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d36bc206-f629-4d6e-8a3f-458061d7b525"}]}} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:30:41 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-ade38467-36da-418f-960e-597337a037c6 tempest-TaggedAttachmentsTest-1471354305 tempest-TaggedAttachmentsTest-1471354305-project-admin] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:30:41 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-ade38467-36da-418f-960e-597337a037c6 tempest-TaggedAttachmentsTest-1471354305 tempest-TaggedAttachmentsTest-1471354305-project-admin] [instance: 5d50f597-3a29-4335-8166-6ab8e8149376] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:30:41 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-ade38467-36da-418f-960e-597337a037c6 tempest-TaggedAttachmentsTest-1471354305 tempest-TaggedAttachmentsTest-1471354305-project-admin] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:30:41 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-ade38467-36da-418f-960e-597337a037c6 tempest-TaggedAttachmentsTest-1471354305 tempest-TaggedAttachmentsTest-1471354305-project-admin] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:30:41 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-ade38467-36da-418f-960e-597337a037c6 tempest-TaggedAttachmentsTest-1471354305 tempest-TaggedAttachmentsTest-1471354305-project-admin] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:30:41 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-ade38467-36da-418f-960e-597337a037c6 tempest-TaggedAttachmentsTest-1471354305 tempest-TaggedAttachmentsTest-1471354305-project-admin] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:30:41 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-ade38467-36da-418f-960e-597337a037c6 tempest-TaggedAttachmentsTest-1471354305 tempest-TaggedAttachmentsTest-1471354305-project-admin] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:30:41 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-ade38467-36da-418f-960e-597337a037c6 tempest-TaggedAttachmentsTest-1471354305 tempest-TaggedAttachmentsTest-1471354305-project-admin] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:30:41 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-ade38467-36da-418f-960e-597337a037c6 tempest-TaggedAttachmentsTest-1471354305 tempest-TaggedAttachmentsTest-1471354305-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/5d50f597-3a29-4335-8166-6ab8e8149376/os-instance-actions/req-036b777d-1ffe-43b6-b1f2-5a8ed4f4f6ec" status: 200 len: 503 microversion: 2.49 time: 0.068948 Apr 13 16:30:41 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 181/548] 10.0.0.210 () {64 vars in 1537 bytes} [Thu Apr 13 16:30:41 2023] GET /compute/v2.1/servers/5d50f597-3a29-4335-8166-6ab8e8149376/os-instance-actions/req-036b777d-1ffe-43b6-b1f2-5a8ed4f4f6ec => generated 503 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 13 16:30:41 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-2635e911-7cf2-41c4-8857-3d0846050468 tempest-TaggedAttachmentsTest-1471354305 tempest-TaggedAttachmentsTest-1471354305-project-admin] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:30:41 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-2635e911-7cf2-41c4-8857-3d0846050468 tempest-TaggedAttachmentsTest-1471354305 tempest-TaggedAttachmentsTest-1471354305-project-admin] [instance: 5d50f597-3a29-4335-8166-6ab8e8149376] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:30:41 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-2635e911-7cf2-41c4-8857-3d0846050468 tempest-TaggedAttachmentsTest-1471354305 tempest-TaggedAttachmentsTest-1471354305-project-admin] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:30:41 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-2635e911-7cf2-41c4-8857-3d0846050468 tempest-TaggedAttachmentsTest-1471354305 tempest-TaggedAttachmentsTest-1471354305-project-admin] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:30:41 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-2635e911-7cf2-41c4-8857-3d0846050468 tempest-TaggedAttachmentsTest-1471354305 tempest-TaggedAttachmentsTest-1471354305-project-admin] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:30:41 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-2635e911-7cf2-41c4-8857-3d0846050468 tempest-TaggedAttachmentsTest-1471354305 tempest-TaggedAttachmentsTest-1471354305-project-admin] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:30:41 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-2635e911-7cf2-41c4-8857-3d0846050468 tempest-TaggedAttachmentsTest-1471354305 tempest-TaggedAttachmentsTest-1471354305-project-admin] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:30:41 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-2635e911-7cf2-41c4-8857-3d0846050468 tempest-TaggedAttachmentsTest-1471354305 tempest-TaggedAttachmentsTest-1471354305-project-admin] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:30:42 user devstack@n-api.service[62054]: DEBUG nova.network.neutron [None req-69ee0e73-9794-415c-a1cf-a95d8d739e7c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] validate_networks() for [('d36bc206-f629-4d6e-8a3f-458061d7b525', None, None, None, None, None)] {{(pid=62054) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 16:30:42 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-2635e911-7cf2-41c4-8857-3d0846050468 tempest-TaggedAttachmentsTest-1471354305 tempest-TaggedAttachmentsTest-1471354305-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/5d50f597-3a29-4335-8166-6ab8e8149376/os-instance-actions/req-036b777d-1ffe-43b6-b1f2-5a8ed4f4f6ec" status: 200 len: 503 microversion: 2.49 time: 0.109920 Apr 13 16:30:42 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 183/549] 10.0.0.210 () {64 vars in 1537 bytes} [Thu Apr 13 16:30:41 2023] GET /compute/v2.1/servers/5d50f597-3a29-4335-8166-6ab8e8149376/os-instance-actions/req-036b777d-1ffe-43b6-b1f2-5a8ed4f4f6ec => generated 503 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 16:30:42 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-deeb7d05-6b1d-469f-94b7-c0e411ab34dd tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:30:42 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-deeb7d05-6b1d-469f-94b7-c0e411ab34dd tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] [instance: 5d50f597-3a29-4335-8166-6ab8e8149376] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:30:42 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-deeb7d05-6b1d-469f-94b7-c0e411ab34dd tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:30:42 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-deeb7d05-6b1d-469f-94b7-c0e411ab34dd tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:30:42 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-deeb7d05-6b1d-469f-94b7-c0e411ab34dd tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:30:42 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-deeb7d05-6b1d-469f-94b7-c0e411ab34dd tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:30:42 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-deeb7d05-6b1d-469f-94b7-c0e411ab34dd tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:30:42 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-deeb7d05-6b1d-469f-94b7-c0e411ab34dd tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:30:42 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-deeb7d05-6b1d-469f-94b7-c0e411ab34dd tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5d50f597-3a29-4335-8166-6ab8e8149376/os-volume_attachments" status: 200 len: 25 microversion: 2.49 time: 0.061031 Apr 13 16:30:42 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 182/550] 10.0.0.210 () {64 vars in 1420 bytes} [Thu Apr 13 16:30:42 2023] GET /compute/v2.1/servers/5d50f597-3a29-4335-8166-6ab8e8149376/os-volume_attachments => generated 25 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:30:42 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-34ba711f-5e49-496e-be03-94a3b737449a tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:30:42 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-34ba711f-5e49-496e-be03-94a3b737449a tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] [instance: 5d50f597-3a29-4335-8166-6ab8e8149376] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:30:42 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-34ba711f-5e49-496e-be03-94a3b737449a tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:30:42 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-34ba711f-5e49-496e-be03-94a3b737449a tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:30:42 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-34ba711f-5e49-496e-be03-94a3b737449a tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:30:42 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-34ba711f-5e49-496e-be03-94a3b737449a tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:30:42 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-34ba711f-5e49-496e-be03-94a3b737449a tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:30:42 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-34ba711f-5e49-496e-be03-94a3b737449a tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:30:42 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-34ba711f-5e49-496e-be03-94a3b737449a tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] [instance: 5d50f597-3a29-4335-8166-6ab8e8149376] Going to try to terminate instance {{(pid=62053) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 16:30:42 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-34ba711f-5e49-496e-be03-94a3b737449a tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5d50f597-3a29-4335-8166-6ab8e8149376" status: 204 len: 0 microversion: 2.49 time: 0.259689 Apr 13 16:30:42 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 184/551] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 13 16:30:42 2023] DELETE /compute/v2.1/servers/5d50f597-3a29-4335-8166-6ab8e8149376 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 13 16:30:42 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-250e33ee-d947-4acb-9c3a-b8a221d711a3 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:30:42 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-250e33ee-d947-4acb-9c3a-b8a221d711a3 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] [instance: 5d50f597-3a29-4335-8166-6ab8e8149376] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:30:42 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-250e33ee-d947-4acb-9c3a-b8a221d711a3 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:30:42 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-250e33ee-d947-4acb-9c3a-b8a221d711a3 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:30:42 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-250e33ee-d947-4acb-9c3a-b8a221d711a3 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:30:42 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-250e33ee-d947-4acb-9c3a-b8a221d711a3 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:30:42 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-250e33ee-d947-4acb-9c3a-b8a221d711a3 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:30:42 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-250e33ee-d947-4acb-9c3a-b8a221d711a3 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:30:42 user devstack@n-api.service[62054]: DEBUG nova.virt.hardware [None req-69ee0e73-9794-415c-a1cf-a95d8d739e7c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Flavor limits 0:0:0 {{(pid=62054) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 16:30:42 user devstack@n-api.service[62054]: DEBUG nova.virt.hardware [None req-69ee0e73-9794-415c-a1cf-a95d8d739e7c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Image limits 0:0:0 {{(pid=62054) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 16:30:42 user devstack@n-api.service[62054]: DEBUG nova.virt.hardware [None req-69ee0e73-9794-415c-a1cf-a95d8d739e7c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Flavor pref 0:0:0 {{(pid=62054) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 16:30:42 user devstack@n-api.service[62054]: DEBUG nova.virt.hardware [None req-69ee0e73-9794-415c-a1cf-a95d8d739e7c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Image pref 0:0:0 {{(pid=62054) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 16:30:42 user devstack@n-api.service[62054]: DEBUG nova.virt.hardware [None req-69ee0e73-9794-415c-a1cf-a95d8d739e7c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62054) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 16:30:42 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-69ee0e73-9794-415c-a1cf-a95d8d739e7c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:30:42 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-69ee0e73-9794-415c-a1cf-a95d8d739e7c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:30:42 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-69ee0e73-9794-415c-a1cf-a95d8d739e7c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:30:42 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-69ee0e73-9794-415c-a1cf-a95d8d739e7c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:30:42 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-69ee0e73-9794-415c-a1cf-a95d8d739e7c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:30:42 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-69ee0e73-9794-415c-a1cf-a95d8d739e7c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:30:42 user devstack@n-api.service[62054]: DEBUG nova.quota [None req-69ee0e73-9794-415c-a1cf-a95d8d739e7c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Getting quotas for project 8d451e0e239f486aa2b3abe9e273eab3. Resources: {'instances', 'cores', 'ram'} {{(pid=62054) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 16:30:42 user devstack@n-api.service[62054]: DEBUG nova.quota [None req-69ee0e73-9794-415c-a1cf-a95d8d739e7c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Getting quotas for user d70e10f63cdd49a9a1ebe1fe4c9de0a2 and project 8d451e0e239f486aa2b3abe9e273eab3. Resources: {'instances', 'cores', 'ram'} {{(pid=62054) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 16:30:42 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-69ee0e73-9794-415c-a1cf-a95d8d739e7c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Going to run 1 instances... {{(pid=62054) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 16:30:42 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-69ee0e73-9794-415c-a1cf-a95d8d739e7c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 03200054-c651-4333-acce-3bea3defe22a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c2088266-1d33-4bb1-ac5b-1de832ff7985',volume_size=None,volume_type=None)] {{(pid=62054) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 16:30:42 user devstack@n-api.service[62055]: DEBUG nova.policy [None req-250e33ee-d947-4acb-9c3a-b8a221d711a3 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa66202e2e5547d1b6e792557b335d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c33fd5889ce4d0b983f529767005267', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62055) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:30:42 user devstack@n-api.service[62055]: DEBUG nova.policy [None req-250e33ee-d947-4acb-9c3a-b8a221d711a3 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa66202e2e5547d1b6e792557b335d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c33fd5889ce4d0b983f529767005267', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62055) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:30:42 user devstack@n-api.service[62055]: DEBUG nova.policy [None req-250e33ee-d947-4acb-9c3a-b8a221d711a3 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa66202e2e5547d1b6e792557b335d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c33fd5889ce4d0b983f529767005267', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62055) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:30:42 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-250e33ee-d947-4acb-9c3a-b8a221d711a3 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5d50f597-3a29-4335-8166-6ab8e8149376" status: 200 len: 1752 microversion: 2.49 time: 0.214196 Apr 13 16:30:42 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 183/552] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 16:30:42 2023] GET /compute/v2.1/servers/5d50f597-3a29-4335-8166-6ab8e8149376 => generated 1752 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 16:30:42 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-2a011e1d-ec85-48e4-b9ee-ce47673ce07c req-b843d21e-7bae-4584-b0cd-1966b5162a5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d50f597-3a29-4335-8166-6ab8e8149376", "name": "network-vif-unplugged", "status": "completed", "tag": "cde3b0f9-9ed1-4eba-8560-d5fa05166b2e"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:30:42 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-2a011e1d-ec85-48e4-b9ee-ce47673ce07c req-b843d21e-7bae-4584-b0cd-1966b5162a5d service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:30:42 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-2a011e1d-ec85-48e4-b9ee-ce47673ce07c req-b843d21e-7bae-4584-b0cd-1966b5162a5d service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:30:42 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-2a011e1d-ec85-48e4-b9ee-ce47673ce07c req-b843d21e-7bae-4584-b0cd-1966b5162a5d service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:30:42 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-2a011e1d-ec85-48e4-b9ee-ce47673ce07c req-b843d21e-7bae-4584-b0cd-1966b5162a5d service nova] Creating event network-vif-unplugged:cde3b0f9-9ed1-4eba-8560-d5fa05166b2e for instance 5d50f597-3a29-4335-8166-6ab8e8149376 on user Apr 13 16:30:42 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [req-2a011e1d-ec85-48e4-b9ee-ce47673ce07c req-b843d21e-7bae-4584-b0cd-1966b5162a5d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030499 Apr 13 16:30:42 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 185/553] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:30:42 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:30:42 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-69ee0e73-9794-415c-a1cf-a95d8d739e7c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.088209 Apr 13 16:30:42 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 186/554] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 16:30:41 2023] POST /compute/v2.1/servers => generated 404 bytes in 1091 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 16:30:42 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-2f4de15c-39e8-4fcf-8ec0-31039977f257 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:30:42 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-2f4de15c-39e8-4fcf-8ec0-31039977f257 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 03200054-c651-4333-acce-3bea3defe22a] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:30:42 user devstack@n-api.service[62055]: DEBUG nova.policy [None req-2f4de15c-39e8-4fcf-8ec0-31039977f257 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e10f63cdd49a9a1ebe1fe4c9de0a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d451e0e239f486aa2b3abe9e273eab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62055) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:30:42 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-2f4de15c-39e8-4fcf-8ec0-31039977f257 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] 10.0.0.210 "GET /compute/v2.1/servers/03200054-c651-4333-acce-3bea3defe22a" status: 200 len: 1090 microversion: 2.1 time: 0.074054 Apr 13 16:30:42 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 184/555] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:30:42 2023] GET /compute/v2.1/servers/03200054-c651-4333-acce-3bea3defe22a => generated 1090 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:30:44 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-4fdfad25-a0e7-4a63-835b-010ad4699d6f req-7b8921da-db66-431a-987b-0656f94565cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d50f597-3a29-4335-8166-6ab8e8149376", "name": "network-vif-deleted", "tag": "cde3b0f9-9ed1-4eba-8560-d5fa05166b2e"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:30:44 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-4fdfad25-a0e7-4a63-835b-010ad4699d6f req-7b8921da-db66-431a-987b-0656f94565cb service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:30:44 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-4fdfad25-a0e7-4a63-835b-010ad4699d6f req-7b8921da-db66-431a-987b-0656f94565cb service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:30:44 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-4fdfad25-a0e7-4a63-835b-010ad4699d6f req-7b8921da-db66-431a-987b-0656f94565cb service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:30:44 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-4fdfad25-a0e7-4a63-835b-010ad4699d6f req-7b8921da-db66-431a-987b-0656f94565cb service nova] Creating event network-vif-deleted:cde3b0f9-9ed1-4eba-8560-d5fa05166b2e for instance 5d50f597-3a29-4335-8166-6ab8e8149376 on user Apr 13 16:30:44 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [req-4fdfad25-a0e7-4a63-835b-010ad4699d6f req-7b8921da-db66-431a-987b-0656f94565cb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.162452 Apr 13 16:30:44 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 186/556] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:30:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:30:44 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-3183e0d3-6e40-41a4-a3cc-04000e361226 req-9f808166-ef82-4ca3-a791-544ed27cf5d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d50f597-3a29-4335-8166-6ab8e8149376", "name": "network-vif-plugged", "status": "completed", "tag": "cde3b0f9-9ed1-4eba-8560-d5fa05166b2e"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:30:44 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-3183e0d3-6e40-41a4-a3cc-04000e361226 req-9f808166-ef82-4ca3-a791-544ed27cf5d4 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:30:44 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-3183e0d3-6e40-41a4-a3cc-04000e361226 req-9f808166-ef82-4ca3-a791-544ed27cf5d4 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:30:44 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-3183e0d3-6e40-41a4-a3cc-04000e361226 req-9f808166-ef82-4ca3-a791-544ed27cf5d4 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:30:44 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-3183e0d3-6e40-41a4-a3cc-04000e361226 req-9f808166-ef82-4ca3-a791-544ed27cf5d4 service nova] Creating event network-vif-plugged:cde3b0f9-9ed1-4eba-8560-d5fa05166b2e for instance 5d50f597-3a29-4335-8166-6ab8e8149376 on user Apr 13 16:30:44 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [req-3183e0d3-6e40-41a4-a3cc-04000e361226 req-9f808166-ef82-4ca3-a791-544ed27cf5d4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031729 Apr 13 16:30:44 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 187/557] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:30:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:30:45 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-5e04a646-dfd2-4f9c-b26f-ed3f0ac90e9a tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:30:45 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-5e04a646-dfd2-4f9c-b26f-ed3f0ac90e9a tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 650427bd-4dad-4bcd-922d-c17e60b36807] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:30:45 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-5e04a646-dfd2-4f9c-b26f-ed3f0ac90e9a tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:30:45 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-5e04a646-dfd2-4f9c-b26f-ed3f0ac90e9a tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:30:45 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-5e04a646-dfd2-4f9c-b26f-ed3f0ac90e9a tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:30:45 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-5e04a646-dfd2-4f9c-b26f-ed3f0ac90e9a tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:30:45 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-5e04a646-dfd2-4f9c-b26f-ed3f0ac90e9a tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:30:45 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-5e04a646-dfd2-4f9c-b26f-ed3f0ac90e9a tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:30:45 user devstack@n-api.service[62055]: DEBUG nova.policy [None req-5e04a646-dfd2-4f9c-b26f-ed3f0ac90e9a tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45a882dbafb4ea4976e4f45289eb2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d09a74bf684a9fb1dd1e95d6c23f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62055) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:30:45 user devstack@n-api.service[62055]: DEBUG nova.policy [None req-5e04a646-dfd2-4f9c-b26f-ed3f0ac90e9a tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e45a882dbafb4ea4976e4f45289eb2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d09a74bf684a9fb1dd1e95d6c23f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62055) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:30:45 user devstack@n-api.service[62055]: DEBUG nova.policy [None req-5e04a646-dfd2-4f9c-b26f-ed3f0ac90e9a tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e45a882dbafb4ea4976e4f45289eb2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d09a74bf684a9fb1dd1e95d6c23f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62055) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:30:45 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-5e04a646-dfd2-4f9c-b26f-ed3f0ac90e9a tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] 10.0.0.210 "GET /compute/v2.1/servers/650427bd-4dad-4bcd-922d-c17e60b36807" status: 200 len: 1690 microversion: 2.87 time: 0.169158 Apr 13 16:30:45 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 185/558] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 16:30:45 2023] GET /compute/v2.1/servers/650427bd-4dad-4bcd-922d-c17e60b36807 => generated 1690 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 16:30:46 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-ba49f720-5a2e-44a2-81e0-be5cf81a932b tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:30:46 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-ba49f720-5a2e-44a2-81e0-be5cf81a932b tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] [instance: 32b18558-8bf2-4def-bc70-81c4e38fcc6f] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:30:46 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-ba49f720-5a2e-44a2-81e0-be5cf81a932b tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:30:46 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-ba49f720-5a2e-44a2-81e0-be5cf81a932b tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:30:46 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-ba49f720-5a2e-44a2-81e0-be5cf81a932b tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:30:46 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-ba49f720-5a2e-44a2-81e0-be5cf81a932b tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:30:46 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-ba49f720-5a2e-44a2-81e0-be5cf81a932b tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:30:46 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-ba49f720-5a2e-44a2-81e0-be5cf81a932b tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:30:46 user devstack@n-api.service[62053]: DEBUG nova.objects.instance [None req-ba49f720-5a2e-44a2-81e0-be5cf81a932b tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lazy-loading 'services' on Instance uuid 32b18558-8bf2-4def-bc70-81c4e38fcc6f {{(pid=62053) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 16:30:46 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-ba49f720-5a2e-44a2-81e0-be5cf81a932b tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/32b18558-8bf2-4def-bc70-81c4e38fcc6f/os-volume_attachments/3030feb6-6893-43c8-84b8-46b8535c3077" status: 202 len: 0 microversion: 2.1 time: 0.156862 Apr 13 16:30:46 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 187/559] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 16:30:46 2023] DELETE /compute/v2.1/servers/32b18558-8bf2-4def-bc70-81c4e38fcc6f/os-volume_attachments/3030feb6-6893-43c8-84b8-46b8535c3077 => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 16:30:46 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-4e92935e-620c-49a8-abd6-eb4933e7d2fe tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:30:46 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-4e92935e-620c-49a8-abd6-eb4933e7d2fe tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] [instance: 32b18558-8bf2-4def-bc70-81c4e38fcc6f] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:30:46 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-4e92935e-620c-49a8-abd6-eb4933e7d2fe tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:30:46 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-4e92935e-620c-49a8-abd6-eb4933e7d2fe tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:30:46 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-4e92935e-620c-49a8-abd6-eb4933e7d2fe tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:30:46 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-4e92935e-620c-49a8-abd6-eb4933e7d2fe tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:30:46 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-4e92935e-620c-49a8-abd6-eb4933e7d2fe tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:30:46 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-4e92935e-620c-49a8-abd6-eb4933e7d2fe tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:30:46 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-4e92935e-620c-49a8-abd6-eb4933e7d2fe tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] 10.0.0.210 "GET /compute/v2.1/servers/32b18558-8bf2-4def-bc70-81c4e38fcc6f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045292 Apr 13 16:30:46 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 188/560] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 16:30:46 2023] GET /compute/v2.1/servers/32b18558-8bf2-4def-bc70-81c4e38fcc6f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:30:46 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [req-37e32117-64c6-4958-8485-a357dee5f0f2 req-c77f4b07-e406-4895-b3eb-ace836a6432b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03200054-c651-4333-acce-3bea3defe22a", "tag": "b40a4a40-0a9a-42f8-8d44-41bf4042454b"}]} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:30:46 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-37e32117-64c6-4958-8485-a357dee5f0f2 req-c77f4b07-e406-4895-b3eb-ace836a6432b service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:30:46 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-37e32117-64c6-4958-8485-a357dee5f0f2 req-c77f4b07-e406-4895-b3eb-ace836a6432b service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:30:46 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-37e32117-64c6-4958-8485-a357dee5f0f2 req-c77f4b07-e406-4895-b3eb-ace836a6432b service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:30:46 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-37e32117-64c6-4958-8485-a357dee5f0f2 req-c77f4b07-e406-4895-b3eb-ace836a6432b service nova] Creating event network-changed:b40a4a40-0a9a-42f8-8d44-41bf4042454b for instance 03200054-c651-4333-acce-3bea3defe22a on user Apr 13 16:30:46 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [req-37e32117-64c6-4958-8485-a357dee5f0f2 req-c77f4b07-e406-4895-b3eb-ace836a6432b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035801 Apr 13 16:30:46 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 186/561] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:30:46 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:30:48 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-caf0474c-f9cc-4394-a5c2-ba9208634440 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:30:48 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-caf0474c-f9cc-4394-a5c2-ba9208634440 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:30:48 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-caf0474c-f9cc-4394-a5c2-ba9208634440 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:30:48 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-caf0474c-f9cc-4394-a5c2-ba9208634440 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:30:48 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-caf0474c-f9cc-4394-a5c2-ba9208634440 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:30:48 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-caf0474c-f9cc-4394-a5c2-ba9208634440 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:30:48 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-caf0474c-f9cc-4394-a5c2-ba9208634440 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:30:48 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-caf0474c-f9cc-4394-a5c2-ba9208634440 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:30:48 user devstack@n-api.service[62053]: DEBUG nova.policy [None req-caf0474c-f9cc-4394-a5c2-ba9208634440 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fab402fb794a5a9281cfb7fe188813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24904988cf334657b084fd726c7ecf8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62053) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:30:48 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-caf0474c-f9cc-4394-a5c2-ba9208634440 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eaae47b9-a059-49f6-9ae6-d7147003e2f2" status: 200 len: 1643 microversion: 2.1 time: 0.162590 Apr 13 16:30:48 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 188/562] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:30:48 2023] GET /compute/v2.1/servers/eaae47b9-a059-49f6-9ae6-d7147003e2f2 => generated 1643 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:30:52 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-560cad9d-05e2-442c-a00f-13b7e4283147 req-502839c3-9d51-4f9a-8c73-6d6ddf160e07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03200054-c651-4333-acce-3bea3defe22a", "name": "network-vif-plugged", "status": "completed", "tag": "b40a4a40-0a9a-42f8-8d44-41bf4042454b"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:30:52 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:30:52 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-560cad9d-05e2-442c-a00f-13b7e4283147 req-502839c3-9d51-4f9a-8c73-6d6ddf160e07 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:30:52 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-560cad9d-05e2-442c-a00f-13b7e4283147 req-502839c3-9d51-4f9a-8c73-6d6ddf160e07 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:30:52 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-560cad9d-05e2-442c-a00f-13b7e4283147 req-502839c3-9d51-4f9a-8c73-6d6ddf160e07 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:30:52 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_cell1:SELECT=41,nova_cell1:INSERT=2 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:30:52 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-560cad9d-05e2-442c-a00f-13b7e4283147 req-502839c3-9d51-4f9a-8c73-6d6ddf160e07 service nova] Creating event network-vif-plugged:b40a4a40-0a9a-42f8-8d44-41bf4042454b for instance 03200054-c651-4333-acce-3bea3defe22a on user Apr 13 16:30:52 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [req-560cad9d-05e2-442c-a00f-13b7e4283147 req-502839c3-9d51-4f9a-8c73-6d6ddf160e07 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042316 Apr 13 16:30:52 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 189/563] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:30:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:30:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [req-bb5600a4-feae-400e-ac22-cb19748f7429 req-5b13243e-e4db-4f54-847b-5f42b972eb66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03200054-c651-4333-acce-3bea3defe22a", "name": "network-vif-plugged", "status": "completed", "tag": "b40a4a40-0a9a-42f8-8d44-41bf4042454b"}]} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:30:54 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_cell0:SELECT=6 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:30:54 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-bb5600a4-feae-400e-ac22-cb19748f7429 req-5b13243e-e4db-4f54-847b-5f42b972eb66 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:30:54 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-bb5600a4-feae-400e-ac22-cb19748f7429 req-5b13243e-e4db-4f54-847b-5f42b972eb66 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:30:54 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-bb5600a4-feae-400e-ac22-cb19748f7429 req-5b13243e-e4db-4f54-847b-5f42b972eb66 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:30:54 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-bb5600a4-feae-400e-ac22-cb19748f7429 req-5b13243e-e4db-4f54-847b-5f42b972eb66 service nova] Creating event network-vif-plugged:b40a4a40-0a9a-42f8-8d44-41bf4042454b for instance 03200054-c651-4333-acce-3bea3defe22a on user Apr 13 16:30:54 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [req-bb5600a4-feae-400e-ac22-cb19748f7429 req-5b13243e-e4db-4f54-847b-5f42b972eb66 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033761 Apr 13 16:30:54 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 187/564] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:30:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:31:06 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:31:06 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:31:06 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-2e0a7286-20ea-48c6-8aca-7f816ea381bb tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:31:06 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-2e0a7286-20ea-48c6-8aca-7f816ea381bb tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] [instance: 71a2163b-fb6b-4b71-b93f-d682ad141b84] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:31:06 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-2e0a7286-20ea-48c6-8aca-7f816ea381bb tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:31:06 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-2e0a7286-20ea-48c6-8aca-7f816ea381bb tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:31:06 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-2e0a7286-20ea-48c6-8aca-7f816ea381bb tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:31:06 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-2e0a7286-20ea-48c6-8aca-7f816ea381bb tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:31:06 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-2e0a7286-20ea-48c6-8aca-7f816ea381bb tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:31:06 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-2e0a7286-20ea-48c6-8aca-7f816ea381bb tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:31:06 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-2e0a7286-20ea-48c6-8aca-7f816ea381bb tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] [instance: 71a2163b-fb6b-4b71-b93f-d682ad141b84] Going to try to terminate instance {{(pid=62053) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 16:31:06 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-2e0a7286-20ea-48c6-8aca-7f816ea381bb tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/71a2163b-fb6b-4b71-b93f-d682ad141b84" status: 204 len: 0 microversion: 2.1 time: 0.114064 Apr 13 16:31:06 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 189/565] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 16:31:06 2023] DELETE /compute/v2.1/servers/71a2163b-fb6b-4b71-b93f-d682ad141b84 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 16:31:06 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-24e97f8a-fd2b-497f-8575-ef7e1a7ff74d tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:31:06 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-24e97f8a-fd2b-497f-8575-ef7e1a7ff74d tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] [instance: 71a2163b-fb6b-4b71-b93f-d682ad141b84] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:31:06 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_cell0:SELECT=2 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:31:06 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_cell0:SELECT=6 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:31:06 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_api:SELECT=1 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:31:06 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_cell1:SELECT=1 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:31:06 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-24e97f8a-fd2b-497f-8575-ef7e1a7ff74d tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:31:06 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-24e97f8a-fd2b-497f-8575-ef7e1a7ff74d tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:31:06 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-24e97f8a-fd2b-497f-8575-ef7e1a7ff74d tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:31:06 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-24e97f8a-fd2b-497f-8575-ef7e1a7ff74d tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:31:06 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-24e97f8a-fd2b-497f-8575-ef7e1a7ff74d tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:31:06 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-24e97f8a-fd2b-497f-8575-ef7e1a7ff74d tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:31:07 user devstack@n-api.service[62054]: DEBUG nova.policy [None req-24e97f8a-fd2b-497f-8575-ef7e1a7ff74d tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f9678e69654526b4d5dc9de05ac090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33101d535154c9a88cae865ee7ece46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62054) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:31:07 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-24e97f8a-fd2b-497f-8575-ef7e1a7ff74d tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] 10.0.0.210 "GET /compute/v2.1/servers/71a2163b-fb6b-4b71-b93f-d682ad141b84" status: 200 len: 1461 microversion: 2.1 time: 0.243704 Apr 13 16:31:07 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 190/566] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:31:06 2023] GET /compute/v2.1/servers/71a2163b-fb6b-4b71-b93f-d682ad141b84 => generated 1461 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:31:07 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:31:07 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:31:07 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [req-88228ecb-7b91-462e-b27d-64e2448b54bc req-f0d0c791-4dc0-4486-a193-d2495cdb864e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71a2163b-fb6b-4b71-b93f-d682ad141b84", "name": "network-vif-unplugged", "status": "completed", "tag": "da3b7e52-803c-4172-a058-238c8dcedbbc"}]} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:31:07 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-88228ecb-7b91-462e-b27d-64e2448b54bc req-f0d0c791-4dc0-4486-a193-d2495cdb864e service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:31:07 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-88228ecb-7b91-462e-b27d-64e2448b54bc req-f0d0c791-4dc0-4486-a193-d2495cdb864e service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:31:07 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-88228ecb-7b91-462e-b27d-64e2448b54bc req-f0d0c791-4dc0-4486-a193-d2495cdb864e service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:31:07 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-88228ecb-7b91-462e-b27d-64e2448b54bc req-f0d0c791-4dc0-4486-a193-d2495cdb864e service nova] Creating event network-vif-unplugged:da3b7e52-803c-4172-a058-238c8dcedbbc for instance 71a2163b-fb6b-4b71-b93f-d682ad141b84 on user Apr 13 16:31:07 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [req-88228ecb-7b91-462e-b27d-64e2448b54bc req-f0d0c791-4dc0-4486-a193-d2495cdb864e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047041 Apr 13 16:31:07 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 188/567] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:31:07 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:31:08 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-bb5c0815-110d-472b-99ae-87b05a4a446b req-96084f46-401a-4471-9a25-ecd436ea8abd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71a2163b-fb6b-4b71-b93f-d682ad141b84", "name": "network-vif-deleted", "tag": "da3b7e52-803c-4172-a058-238c8dcedbbc"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:31:08 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-bb5c0815-110d-472b-99ae-87b05a4a446b req-96084f46-401a-4471-9a25-ecd436ea8abd service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:31:08 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-bb5c0815-110d-472b-99ae-87b05a4a446b req-96084f46-401a-4471-9a25-ecd436ea8abd service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:31:08 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-bb5c0815-110d-472b-99ae-87b05a4a446b req-96084f46-401a-4471-9a25-ecd436ea8abd service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:31:08 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-bb5c0815-110d-472b-99ae-87b05a4a446b req-96084f46-401a-4471-9a25-ecd436ea8abd service nova] Creating event network-vif-deleted:da3b7e52-803c-4172-a058-238c8dcedbbc for instance 71a2163b-fb6b-4b71-b93f-d682ad141b84 on user Apr 13 16:31:08 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [req-bb5c0815-110d-472b-99ae-87b05a4a446b req-96084f46-401a-4471-9a25-ecd436ea8abd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032808 Apr 13 16:31:08 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 190/568] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:31:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:31:09 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-0f33c503-8c39-49d6-9eac-12abae51c37c req-10fd4e84-4a1a-43f5-a907-0fbbef82beac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71a2163b-fb6b-4b71-b93f-d682ad141b84", "name": "network-vif-plugged", "status": "completed", "tag": "da3b7e52-803c-4172-a058-238c8dcedbbc"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:31:09 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-0f33c503-8c39-49d6-9eac-12abae51c37c req-10fd4e84-4a1a-43f5-a907-0fbbef82beac service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:31:09 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-0f33c503-8c39-49d6-9eac-12abae51c37c req-10fd4e84-4a1a-43f5-a907-0fbbef82beac service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:31:09 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-0f33c503-8c39-49d6-9eac-12abae51c37c req-10fd4e84-4a1a-43f5-a907-0fbbef82beac service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:31:09 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-0f33c503-8c39-49d6-9eac-12abae51c37c req-10fd4e84-4a1a-43f5-a907-0fbbef82beac service nova] Creating event network-vif-plugged:da3b7e52-803c-4172-a058-238c8dcedbbc for instance 71a2163b-fb6b-4b71-b93f-d682ad141b84 on user Apr 13 16:31:09 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [req-0f33c503-8c39-49d6-9eac-12abae51c37c req-10fd4e84-4a1a-43f5-a907-0fbbef82beac service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028399 Apr 13 16:31:09 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 191/569] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:31:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:31:16 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-475a3a51-d00c-40cb-9b49-b2d74a65708e tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:31:16 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-475a3a51-d00c-40cb-9b49-b2d74a65708e tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:31:17 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-475a3a51-d00c-40cb-9b49-b2d74a65708e tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:31:17 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-475a3a51-d00c-40cb-9b49-b2d74a65708e tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:31:17 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-475a3a51-d00c-40cb-9b49-b2d74a65708e tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:31:17 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-475a3a51-d00c-40cb-9b49-b2d74a65708e tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:31:17 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-475a3a51-d00c-40cb-9b49-b2d74a65708e tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:31:17 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-475a3a51-d00c-40cb-9b49-b2d74a65708e tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:31:17 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-475a3a51-d00c-40cb-9b49-b2d74a65708e tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] 10.0.0.210 "GET /compute/v2.1/servers/acbcaee0-a47b-4fee-8765-9b1c9597d515/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050175 Apr 13 16:31:17 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 189/570] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 16:31:16 2023] GET /compute/v2.1/servers/acbcaee0-a47b-4fee-8765-9b1c9597d515/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 16:31:17 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-a610691b-33f9-4099-83b7-d5d7abedc850 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:31:17 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-a610691b-33f9-4099-83b7-d5d7abedc850 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:31:17 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-a610691b-33f9-4099-83b7-d5d7abedc850 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:31:17 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-a610691b-33f9-4099-83b7-d5d7abedc850 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:31:17 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-a610691b-33f9-4099-83b7-d5d7abedc850 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:31:17 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-a610691b-33f9-4099-83b7-d5d7abedc850 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:31:17 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-a610691b-33f9-4099-83b7-d5d7abedc850 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:31:17 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-a610691b-33f9-4099-83b7-d5d7abedc850 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:31:17 user devstack@n-api.service[62053]: DEBUG nova.policy [None req-a610691b-33f9-4099-83b7-d5d7abedc850 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b3df1c5c5d441819bcef89ed6966815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980559734a504574a83224deb7423c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62053) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:31:17 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-a610691b-33f9-4099-83b7-d5d7abedc850 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] 10.0.0.210 "GET /compute/v2.1/servers/acbcaee0-a47b-4fee-8765-9b1c9597d515" status: 200 len: 1677 microversion: 2.1 time: 0.155974 Apr 13 16:31:17 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 191/571] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:31:17 2023] GET /compute/v2.1/servers/acbcaee0-a47b-4fee-8765-9b1c9597d515 => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:31:17 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-7f23c360-9aa0-4f03-a5b4-5d9dd1d57462 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:31:17 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-7f23c360-9aa0-4f03-a5b4-5d9dd1d57462 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:31:17 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-7f23c360-9aa0-4f03-a5b4-5d9dd1d57462 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:31:17 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-7f23c360-9aa0-4f03-a5b4-5d9dd1d57462 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:31:17 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-7f23c360-9aa0-4f03-a5b4-5d9dd1d57462 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:31:17 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-7f23c360-9aa0-4f03-a5b4-5d9dd1d57462 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:31:17 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-7f23c360-9aa0-4f03-a5b4-5d9dd1d57462 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:31:17 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-7f23c360-9aa0-4f03-a5b4-5d9dd1d57462 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:31:17 user devstack@n-api.service[62054]: DEBUG nova.policy [None req-7f23c360-9aa0-4f03-a5b4-5d9dd1d57462 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b3df1c5c5d441819bcef89ed6966815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980559734a504574a83224deb7423c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62054) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:31:17 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-7f23c360-9aa0-4f03-a5b4-5d9dd1d57462 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] 10.0.0.210 "GET /compute/v2.1/servers/acbcaee0-a47b-4fee-8765-9b1c9597d515" status: 200 len: 1677 microversion: 2.1 time: 0.149022 Apr 13 16:31:17 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 192/572] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:31:17 2023] GET /compute/v2.1/servers/acbcaee0-a47b-4fee-8765-9b1c9597d515 => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:31:17 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-1c3b11af-a598-4f68-8ced-03736a68dc71 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:31:17 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-1c3b11af-a598-4f68-8ced-03736a68dc71 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:31:17 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-1c3b11af-a598-4f68-8ced-03736a68dc71 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:31:17 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-1c3b11af-a598-4f68-8ced-03736a68dc71 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:31:17 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-1c3b11af-a598-4f68-8ced-03736a68dc71 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:31:17 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-1c3b11af-a598-4f68-8ced-03736a68dc71 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:31:17 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-1c3b11af-a598-4f68-8ced-03736a68dc71 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:31:17 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-1c3b11af-a598-4f68-8ced-03736a68dc71 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:31:17 user devstack@n-api.service[62055]: DEBUG nova.policy [None req-1c3b11af-a598-4f68-8ced-03736a68dc71 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b3df1c5c5d441819bcef89ed6966815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980559734a504574a83224deb7423c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62055) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:31:17 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-1c3b11af-a598-4f68-8ced-03736a68dc71 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] 10.0.0.210 "GET /compute/v2.1/servers/acbcaee0-a47b-4fee-8765-9b1c9597d515" status: 200 len: 1677 microversion: 2.1 time: 0.164747 Apr 13 16:31:17 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 190/573] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:31:17 2023] GET /compute/v2.1/servers/acbcaee0-a47b-4fee-8765-9b1c9597d515 => generated 1677 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:31:29 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-9db294a7-6fa1-400b-8010-4557ed78b617 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:31:29 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-9db294a7-6fa1-400b-8010-4557ed78b617 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:31:29 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:31:29 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:31:29 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-9db294a7-6fa1-400b-8010-4557ed78b617 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:31:29 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-9db294a7-6fa1-400b-8010-4557ed78b617 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:31:29 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-9db294a7-6fa1-400b-8010-4557ed78b617 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:31:29 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-9db294a7-6fa1-400b-8010-4557ed78b617 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:31:29 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-9db294a7-6fa1-400b-8010-4557ed78b617 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:31:29 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-9db294a7-6fa1-400b-8010-4557ed78b617 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:31:29 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-9db294a7-6fa1-400b-8010-4557ed78b617 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bf98c3a2-dbeb-4ae4-8423-ce55964c4258/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056423 Apr 13 16:31:29 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 192/574] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 16:31:29 2023] GET /compute/v2.1/servers/bf98c3a2-dbeb-4ae4-8423-ce55964c4258/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 16:31:32 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-067eaca3-baf6-4dbc-a381-07a5d6009e5b tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6bdf834e-4cc1-4a8e-850c-84ce4564c544"}} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:31:32 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-067eaca3-baf6-4dbc-a381-07a5d6009e5b tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:31:32 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_api:SELECT=6 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:31:32 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_cell1:SELECT=14 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:31:32 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-067eaca3-baf6-4dbc-a381-07a5d6009e5b tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:31:32 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-067eaca3-baf6-4dbc-a381-07a5d6009e5b tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:31:32 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-067eaca3-baf6-4dbc-a381-07a5d6009e5b tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:31:32 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-067eaca3-baf6-4dbc-a381-07a5d6009e5b tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:31:32 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-067eaca3-baf6-4dbc-a381-07a5d6009e5b tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:31:32 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-067eaca3-baf6-4dbc-a381-07a5d6009e5b tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:31:32 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-6c399dc4-4fea-47cb-9b50-622a838baf68 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:31:32 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-6c399dc4-4fea-47cb-9b50-622a838baf68 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] [instance: 5d50f597-3a29-4335-8166-6ab8e8149376] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:31:32 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_api:SELECT=6 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:31:32 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_cell1:SELECT=14 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:31:32 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-6c399dc4-4fea-47cb-9b50-622a838baf68 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:31:32 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-6c399dc4-4fea-47cb-9b50-622a838baf68 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:31:32 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-6c399dc4-4fea-47cb-9b50-622a838baf68 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:31:32 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-6c399dc4-4fea-47cb-9b50-622a838baf68 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:31:32 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-6c399dc4-4fea-47cb-9b50-622a838baf68 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:31:32 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-6c399dc4-4fea-47cb-9b50-622a838baf68 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:31:32 user devstack@n-api.service[62055]: INFO nova.api.openstack.wsgi [None req-6c399dc4-4fea-47cb-9b50-622a838baf68 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] HTTP exception thrown: Instance 5d50f597-3a29-4335-8166-6ab8e8149376 could not be found. Apr 13 16:31:32 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-6c399dc4-4fea-47cb-9b50-622a838baf68 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Request method failure captured: Apr 13 16:31:32 user devstack@n-api.service[62055]: request: GET /compute/v2.1/servers/5d50f597-3a29-4335-8166-6ab8e8149376 HTTP/1.1 Apr 13 16:31:32 user devstack@n-api.service[62055]: Accept: application/json Apr 13 16:31:32 user devstack@n-api.service[62055]: Accept-Encoding: identity Apr 13 16:31:32 user devstack@n-api.service[62055]: Connection: close Apr 13 16:31:32 user devstack@n-api.service[62055]: Content-Length: 0 Apr 13 16:31:32 user devstack@n-api.service[62055]: Content-Type: application/json Apr 13 16:31:32 user devstack@n-api.service[62055]: Host: 10.0.0.210 Apr 13 16:31:32 user devstack@n-api.service[62055]: Openstack-System-Scope: None Apr 13 16:31:32 user devstack@n-api.service[62055]: User-Agent: python-urllib3/1.26.15 Apr 13 16:31:32 user devstack@n-api.service[62055]: X-Auth-Token: gAAAAABkOC1xmImKKnywvJFKdTNWLkM3QcxBfGrUFrO-6V8cHueTdsaXZx9ChljH-8fFsG5gPnHUVdgFdswSckb6snrOwA752e7yIpCQySqUHkAwZpwU49d481aCsPstizPviu4__j-szJb7Lypd66v0-Dfbu4teuJfG_MHLR7IXn7tgzZpdbls Apr 13 16:31:32 user devstack@n-api.service[62055]: X-Domain-Id: None Apr 13 16:31:32 user devstack@n-api.service[62055]: X-Domain-Name: None Apr 13 16:31:32 user devstack@n-api.service[62055]: X-Identity-Status: Confirmed Apr 13 16:31:32 user devstack@n-api.service[62055]: X-Is-Admin-Project: True Apr 13 16:31:32 user devstack@n-api.service[62055]: X-Openstack-Nova-Api-Version: 2.49 Apr 13 16:31:32 user devstack@n-api.service[62055]: X-Project-Domain-Id: default Apr 13 16:31:32 user devstack@n-api.service[62055]: X-Project-Domain-Name: Default Apr 13 16:31:32 user devstack@n-api.service[62055]: X-Project-Id: 3c33fd5889ce4d0b983f529767005267 Apr 13 16:31:32 user devstack@n-api.service[62055]: X-Project-Name: tempest-TaggedAttachmentsTest-1979050233 Apr 13 16:31:32 user devstack@n-api.service[62055]: X-Role: reader,member Apr 13 16:31:32 user devstack@n-api.service[62055]: X-Roles: reader,member Apr 13 16:31:32 user devstack@n-api.service[62055]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3c33fd5889ce4d0b983f529767005267"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3c33fd5889ce4d0b983f529767005267"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3c33fd5889ce4d0b983f529767005267"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 13 16:31:32 user devstack@n-api.service[62055]: X-Tenant: tempest-TaggedAttachmentsTest-1979050233 Apr 13 16:31:32 user devstack@n-api.service[62055]: X-Tenant-Id: 3c33fd5889ce4d0b983f529767005267 Apr 13 16:31:32 user devstack@n-api.service[62055]: X-Tenant-Name: tempest-TaggedAttachmentsTest-1979050233 Apr 13 16:31:32 user devstack@n-api.service[62055]: X-User: tempest-TaggedAttachmentsTest-1979050233-project-member Apr 13 16:31:32 user devstack@n-api.service[62055]: X-User-Domain-Id: default Apr 13 16:31:32 user devstack@n-api.service[62055]: X-User-Domain-Name: Default Apr 13 16:31:32 user devstack@n-api.service[62055]: X-User-Id: fa66202e2e5547d1b6e792557b335d0f Apr 13 16:31:32 user devstack@n-api.service[62055]: X-User-Name: tempest-TaggedAttachmentsTest-1979050233-project-member Apr 13 16:31:32 user devstack@n-api.service[62055]: method: > Apr 13 16:31:32 user devstack@n-api.service[62055]: exception: Instance 5d50f597-3a29-4335-8166-6ab8e8149376 could not be found. Apr 13 16:31:32 user devstack@n-api.service[62055]: action_args: {'id': '5d50f597-3a29-4335-8166-6ab8e8149376'} Apr 13 16:31:32 user devstack@n-api.service[62055]: {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 16:31:32 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:31:32 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 16:31:32 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 16:31:32 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 16:31:32 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 16:31:32 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 16:31:32 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 16:31:32 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 16:31:32 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 16:31:32 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d50f597-3a29-4335-8166-6ab8e8149376 could not be found. Apr 13 16:31:32 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:31:32 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:31:32 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:31:32 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:31:32 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 16:31:32 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 16:31:32 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 16:31:32 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 16:31:32 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 16:31:32 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 16:31:32 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 16:31:32 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 16:31:32 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 16:31:32 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 16:31:32 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 16:31:32 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 16:31:32 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d50f597-3a29-4335-8166-6ab8e8149376 could not be found. Apr 13 16:31:32 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:31:32 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:31:32 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:31:32 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:31:32 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 16:31:32 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 16:31:32 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 16:31:32 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 16:31:32 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d50f597-3a29-4335-8166-6ab8e8149376 could not be found. Apr 13 16:31:32 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:31:32 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-6c399dc4-4fea-47cb-9b50-622a838baf68 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Returning 404 to user: Instance 5d50f597-3a29-4335-8166-6ab8e8149376 could not be found. {{(pid=62055) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 16:31:32 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-6c399dc4-4fea-47cb-9b50-622a838baf68 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5d50f597-3a29-4335-8166-6ab8e8149376" status: 404 len: 111 microversion: 2.49 time: 0.036004 Apr 13 16:31:32 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 191/575] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 16:31:32 2023] GET /compute/v2.1/servers/5d50f597-3a29-4335-8166-6ab8e8149376 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 13 16:31:32 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-d844220c-104d-41f4-bac7-1b8e5ecea2a2 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Calling method '.version_select at 0x7f96e48b57e0>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:31:32 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-d844220c-104d-41f4-bac7-1b8e5ecea2a2 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1469740557" status: 204 len: 0 microversion: 2.49 time: 0.024562 Apr 13 16:31:32 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 193/576] 10.0.0.210 () {64 vars in 1339 bytes} [Thu Apr 13 16:31:32 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1469740557 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 13 16:31:32 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-4bae3dfb-58a7-4072-8008-3ce462ef2fa3 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:31:32 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-4bae3dfb-58a7-4072-8008-3ce462ef2fa3 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 03200054-c651-4333-acce-3bea3defe22a] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:31:32 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-4bae3dfb-58a7-4072-8008-3ce462ef2fa3 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:31:32 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-4bae3dfb-58a7-4072-8008-3ce462ef2fa3 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:31:32 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-4bae3dfb-58a7-4072-8008-3ce462ef2fa3 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:31:32 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-4bae3dfb-58a7-4072-8008-3ce462ef2fa3 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:31:32 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-4bae3dfb-58a7-4072-8008-3ce462ef2fa3 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:31:32 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-4bae3dfb-58a7-4072-8008-3ce462ef2fa3 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:31:33 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-067eaca3-baf6-4dbc-a381-07a5d6009e5b tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] 10.0.0.210 "POST /compute/v2.1/servers/bf98c3a2-dbeb-4ae4-8423-ce55964c4258/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.286952 Apr 13 16:31:33 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 193/577] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 16:31:32 2023] POST /compute/v2.1/servers/bf98c3a2-dbeb-4ae4-8423-ce55964c4258/os-volume_attachments => generated 194 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:31:33 user devstack@n-api.service[62055]: DEBUG nova.policy [None req-4bae3dfb-58a7-4072-8008-3ce462ef2fa3 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e10f63cdd49a9a1ebe1fe4c9de0a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d451e0e239f486aa2b3abe9e273eab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62055) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:31:33 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-4bae3dfb-58a7-4072-8008-3ce462ef2fa3 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] 10.0.0.210 "GET /compute/v2.1/servers/03200054-c651-4333-acce-3bea3defe22a" status: 200 len: 1443 microversion: 2.1 time: 0.180252 Apr 13 16:31:33 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 192/578] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:31:32 2023] GET /compute/v2.1/servers/03200054-c651-4333-acce-3bea3defe22a => generated 1443 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:31:34 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-56b9fb65-89b6-4799-af31-6e112c70e6ef tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:31:34 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-56b9fb65-89b6-4799-af31-6e112c70e6ef tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] [instance: 5d50f597-3a29-4335-8166-6ab8e8149376] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:31:34 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-56b9fb65-89b6-4799-af31-6e112c70e6ef tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:31:34 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-56b9fb65-89b6-4799-af31-6e112c70e6ef tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:31:34 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-56b9fb65-89b6-4799-af31-6e112c70e6ef tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:31:34 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-56b9fb65-89b6-4799-af31-6e112c70e6ef tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:31:34 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-56b9fb65-89b6-4799-af31-6e112c70e6ef tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:31:34 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-56b9fb65-89b6-4799-af31-6e112c70e6ef tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:31:34 user devstack@n-api.service[62053]: INFO nova.api.openstack.wsgi [None req-56b9fb65-89b6-4799-af31-6e112c70e6ef tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] HTTP exception thrown: Instance 5d50f597-3a29-4335-8166-6ab8e8149376 could not be found. Apr 13 16:31:34 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-56b9fb65-89b6-4799-af31-6e112c70e6ef tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Request method failure captured: Apr 13 16:31:34 user devstack@n-api.service[62053]: request: DELETE /compute/v2.1/servers/5d50f597-3a29-4335-8166-6ab8e8149376 HTTP/1.1 Apr 13 16:31:34 user devstack@n-api.service[62053]: Accept: application/json Apr 13 16:31:34 user devstack@n-api.service[62053]: Accept-Encoding: identity Apr 13 16:31:34 user devstack@n-api.service[62053]: Connection: close Apr 13 16:31:34 user devstack@n-api.service[62053]: Content-Length: 0 Apr 13 16:31:34 user devstack@n-api.service[62053]: Content-Type: application/json Apr 13 16:31:34 user devstack@n-api.service[62053]: Host: 10.0.0.210 Apr 13 16:31:34 user devstack@n-api.service[62053]: Openstack-System-Scope: None Apr 13 16:31:34 user devstack@n-api.service[62053]: User-Agent: python-urllib3/1.26.15 Apr 13 16:31:34 user devstack@n-api.service[62053]: X-Auth-Token: gAAAAABkOC1xmImKKnywvJFKdTNWLkM3QcxBfGrUFrO-6V8cHueTdsaXZx9ChljH-8fFsG5gPnHUVdgFdswSckb6snrOwA752e7yIpCQySqUHkAwZpwU49d481aCsPstizPviu4__j-szJb7Lypd66v0-Dfbu4teuJfG_MHLR7IXn7tgzZpdbls Apr 13 16:31:34 user devstack@n-api.service[62053]: X-Domain-Id: None Apr 13 16:31:34 user devstack@n-api.service[62053]: X-Domain-Name: None Apr 13 16:31:34 user devstack@n-api.service[62053]: X-Identity-Status: Confirmed Apr 13 16:31:34 user devstack@n-api.service[62053]: X-Is-Admin-Project: True Apr 13 16:31:34 user devstack@n-api.service[62053]: X-Openstack-Nova-Api-Version: 2.49 Apr 13 16:31:34 user devstack@n-api.service[62053]: X-Project-Domain-Id: default Apr 13 16:31:34 user devstack@n-api.service[62053]: X-Project-Domain-Name: Default Apr 13 16:31:34 user devstack@n-api.service[62053]: X-Project-Id: 3c33fd5889ce4d0b983f529767005267 Apr 13 16:31:34 user devstack@n-api.service[62053]: X-Project-Name: tempest-TaggedAttachmentsTest-1979050233 Apr 13 16:31:34 user devstack@n-api.service[62053]: X-Role: reader,member Apr 13 16:31:34 user devstack@n-api.service[62053]: X-Roles: reader,member Apr 13 16:31:34 user devstack@n-api.service[62053]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3c33fd5889ce4d0b983f529767005267"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3c33fd5889ce4d0b983f529767005267"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3c33fd5889ce4d0b983f529767005267"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 13 16:31:34 user devstack@n-api.service[62053]: X-Tenant: tempest-TaggedAttachmentsTest-1979050233 Apr 13 16:31:34 user devstack@n-api.service[62053]: X-Tenant-Id: 3c33fd5889ce4d0b983f529767005267 Apr 13 16:31:34 user devstack@n-api.service[62053]: X-Tenant-Name: tempest-TaggedAttachmentsTest-1979050233 Apr 13 16:31:34 user devstack@n-api.service[62053]: X-User: tempest-TaggedAttachmentsTest-1979050233-project-member Apr 13 16:31:34 user devstack@n-api.service[62053]: X-User-Domain-Id: default Apr 13 16:31:34 user devstack@n-api.service[62053]: X-User-Domain-Name: Default Apr 13 16:31:34 user devstack@n-api.service[62053]: X-User-Id: fa66202e2e5547d1b6e792557b335d0f Apr 13 16:31:34 user devstack@n-api.service[62053]: X-User-Name: tempest-TaggedAttachmentsTest-1979050233-project-member Apr 13 16:31:34 user devstack@n-api.service[62053]: method: > Apr 13 16:31:34 user devstack@n-api.service[62053]: exception: Instance 5d50f597-3a29-4335-8166-6ab8e8149376 could not be found. Apr 13 16:31:34 user devstack@n-api.service[62053]: action_args: {'id': '5d50f597-3a29-4335-8166-6ab8e8149376'} Apr 13 16:31:34 user devstack@n-api.service[62053]: {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 16:31:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:31:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 16:31:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 16:31:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 16:31:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 16:31:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 16:31:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 16:31:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 16:31:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 16:31:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d50f597-3a29-4335-8166-6ab8e8149376 could not be found. Apr 13 16:31:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:31:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:31:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:31:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:31:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 16:31:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 16:31:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 16:31:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 16:31:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 16:31:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 16:31:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 16:31:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 16:31:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 16:31:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 16:31:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 16:31:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 16:31:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 16:31:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 16:31:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d50f597-3a29-4335-8166-6ab8e8149376 could not be found. Apr 13 16:31:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:31:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:31:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:31:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:31:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 16:31:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 16:31:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 16:31:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 16:31:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d50f597-3a29-4335-8166-6ab8e8149376 could not be found. Apr 13 16:31:34 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:31:34 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-56b9fb65-89b6-4799-af31-6e112c70e6ef tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Returning 404 to user: Instance 5d50f597-3a29-4335-8166-6ab8e8149376 could not be found. {{(pid=62053) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 16:31:34 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-56b9fb65-89b6-4799-af31-6e112c70e6ef tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5d50f597-3a29-4335-8166-6ab8e8149376" status: 404 len: 111 microversion: 2.49 time: 0.035216 Apr 13 16:31:34 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 194/579] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 13 16:31:34 2023] DELETE /compute/v2.1/servers/5d50f597-3a29-4335-8166-6ab8e8149376 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 13 16:31:34 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-eacbfce2-d5f9-4845-8820-649edd033b62 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:31:34 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-eacbfce2-d5f9-4845-8820-649edd033b62 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] [instance: 5d50f597-3a29-4335-8166-6ab8e8149376] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:31:34 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-eacbfce2-d5f9-4845-8820-649edd033b62 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:31:34 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-eacbfce2-d5f9-4845-8820-649edd033b62 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:31:34 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-eacbfce2-d5f9-4845-8820-649edd033b62 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:31:34 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-eacbfce2-d5f9-4845-8820-649edd033b62 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:31:34 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-eacbfce2-d5f9-4845-8820-649edd033b62 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:31:34 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-eacbfce2-d5f9-4845-8820-649edd033b62 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:31:34 user devstack@n-api.service[62054]: INFO nova.api.openstack.wsgi [None req-eacbfce2-d5f9-4845-8820-649edd033b62 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] HTTP exception thrown: Instance 5d50f597-3a29-4335-8166-6ab8e8149376 could not be found. Apr 13 16:31:34 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-eacbfce2-d5f9-4845-8820-649edd033b62 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Request method failure captured: Apr 13 16:31:34 user devstack@n-api.service[62054]: request: GET /compute/v2.1/servers/5d50f597-3a29-4335-8166-6ab8e8149376 HTTP/1.1 Apr 13 16:31:34 user devstack@n-api.service[62054]: Accept: application/json Apr 13 16:31:34 user devstack@n-api.service[62054]: Accept-Encoding: identity Apr 13 16:31:34 user devstack@n-api.service[62054]: Connection: close Apr 13 16:31:34 user devstack@n-api.service[62054]: Content-Length: 0 Apr 13 16:31:34 user devstack@n-api.service[62054]: Content-Type: application/json Apr 13 16:31:34 user devstack@n-api.service[62054]: Host: 10.0.0.210 Apr 13 16:31:34 user devstack@n-api.service[62054]: Openstack-System-Scope: None Apr 13 16:31:34 user devstack@n-api.service[62054]: User-Agent: python-urllib3/1.26.15 Apr 13 16:31:34 user devstack@n-api.service[62054]: X-Auth-Token: gAAAAABkOC1xmImKKnywvJFKdTNWLkM3QcxBfGrUFrO-6V8cHueTdsaXZx9ChljH-8fFsG5gPnHUVdgFdswSckb6snrOwA752e7yIpCQySqUHkAwZpwU49d481aCsPstizPviu4__j-szJb7Lypd66v0-Dfbu4teuJfG_MHLR7IXn7tgzZpdbls Apr 13 16:31:34 user devstack@n-api.service[62054]: X-Domain-Id: None Apr 13 16:31:34 user devstack@n-api.service[62054]: X-Domain-Name: None Apr 13 16:31:34 user devstack@n-api.service[62054]: X-Identity-Status: Confirmed Apr 13 16:31:34 user devstack@n-api.service[62054]: X-Is-Admin-Project: True Apr 13 16:31:34 user devstack@n-api.service[62054]: X-Openstack-Nova-Api-Version: 2.49 Apr 13 16:31:34 user devstack@n-api.service[62054]: X-Project-Domain-Id: default Apr 13 16:31:34 user devstack@n-api.service[62054]: X-Project-Domain-Name: Default Apr 13 16:31:34 user devstack@n-api.service[62054]: X-Project-Id: 3c33fd5889ce4d0b983f529767005267 Apr 13 16:31:34 user devstack@n-api.service[62054]: X-Project-Name: tempest-TaggedAttachmentsTest-1979050233 Apr 13 16:31:34 user devstack@n-api.service[62054]: X-Role: reader,member Apr 13 16:31:34 user devstack@n-api.service[62054]: X-Roles: reader,member Apr 13 16:31:34 user devstack@n-api.service[62054]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3c33fd5889ce4d0b983f529767005267"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3c33fd5889ce4d0b983f529767005267"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3c33fd5889ce4d0b983f529767005267"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 13 16:31:34 user devstack@n-api.service[62054]: X-Tenant: tempest-TaggedAttachmentsTest-1979050233 Apr 13 16:31:34 user devstack@n-api.service[62054]: X-Tenant-Id: 3c33fd5889ce4d0b983f529767005267 Apr 13 16:31:34 user devstack@n-api.service[62054]: X-Tenant-Name: tempest-TaggedAttachmentsTest-1979050233 Apr 13 16:31:34 user devstack@n-api.service[62054]: X-User: tempest-TaggedAttachmentsTest-1979050233-project-member Apr 13 16:31:34 user devstack@n-api.service[62054]: X-User-Domain-Id: default Apr 13 16:31:34 user devstack@n-api.service[62054]: X-User-Domain-Name: Default Apr 13 16:31:34 user devstack@n-api.service[62054]: X-User-Id: fa66202e2e5547d1b6e792557b335d0f Apr 13 16:31:34 user devstack@n-api.service[62054]: X-User-Name: tempest-TaggedAttachmentsTest-1979050233-project-member Apr 13 16:31:34 user devstack@n-api.service[62054]: method: > Apr 13 16:31:34 user devstack@n-api.service[62054]: exception: Instance 5d50f597-3a29-4335-8166-6ab8e8149376 could not be found. Apr 13 16:31:34 user devstack@n-api.service[62054]: action_args: {'id': '5d50f597-3a29-4335-8166-6ab8e8149376'} Apr 13 16:31:34 user devstack@n-api.service[62054]: {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 16:31:34 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:31:34 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 16:31:34 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 16:31:34 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 16:31:34 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 16:31:34 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 16:31:34 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 16:31:34 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 16:31:34 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 16:31:34 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d50f597-3a29-4335-8166-6ab8e8149376 could not be found. Apr 13 16:31:34 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:31:34 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:31:34 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:31:34 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:31:34 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 16:31:34 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 16:31:34 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 16:31:34 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 16:31:34 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 16:31:34 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 16:31:34 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 16:31:34 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 16:31:34 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 16:31:34 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 16:31:34 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 16:31:34 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 16:31:34 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d50f597-3a29-4335-8166-6ab8e8149376 could not be found. Apr 13 16:31:34 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:31:34 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:31:34 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:31:34 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:31:34 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 16:31:34 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 16:31:34 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 16:31:34 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 16:31:34 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d50f597-3a29-4335-8166-6ab8e8149376 could not be found. Apr 13 16:31:34 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:31:34 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-eacbfce2-d5f9-4845-8820-649edd033b62 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Returning 404 to user: Instance 5d50f597-3a29-4335-8166-6ab8e8149376 could not be found. {{(pid=62054) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 16:31:34 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-eacbfce2-d5f9-4845-8820-649edd033b62 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5d50f597-3a29-4335-8166-6ab8e8149376" status: 404 len: 111 microversion: 2.49 time: 0.036038 Apr 13 16:31:34 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 194/580] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 16:31:34 2023] GET /compute/v2.1/servers/5d50f597-3a29-4335-8166-6ab8e8149376 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 13 16:31:36 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-a4e33fb1-c6c4-4126-843f-072e0c617dfe tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:31:36 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-a4e33fb1-c6c4-4126-843f-072e0c617dfe tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] [instance: 32b18558-8bf2-4def-bc70-81c4e38fcc6f] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:31:36 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-a4e33fb1-c6c4-4126-843f-072e0c617dfe tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:31:36 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-a4e33fb1-c6c4-4126-843f-072e0c617dfe tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:31:36 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-a4e33fb1-c6c4-4126-843f-072e0c617dfe tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:31:36 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-a4e33fb1-c6c4-4126-843f-072e0c617dfe tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:31:36 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-a4e33fb1-c6c4-4126-843f-072e0c617dfe tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:31:36 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-a4e33fb1-c6c4-4126-843f-072e0c617dfe tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:31:36 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-a4e33fb1-c6c4-4126-843f-072e0c617dfe tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] 10.0.0.210 "GET /compute/v2.1/servers/32b18558-8bf2-4def-bc70-81c4e38fcc6f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044997 Apr 13 16:31:36 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 193/581] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 16:31:36 2023] GET /compute/v2.1/servers/32b18558-8bf2-4def-bc70-81c4e38fcc6f/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 16:31:38 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-1aaac619-001d-41d1-80b4-7ac1d50241bf tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestStampPatternsnapshot-1791398459"}} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:31:38 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-1aaac619-001d-41d1-80b4-7ac1d50241bf tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] [instance: 32b18558-8bf2-4def-bc70-81c4e38fcc6f] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:31:38 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-1aaac619-001d-41d1-80b4-7ac1d50241bf tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:31:38 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-1aaac619-001d-41d1-80b4-7ac1d50241bf tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:31:38 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-1aaac619-001d-41d1-80b4-7ac1d50241bf tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:31:38 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-1aaac619-001d-41d1-80b4-7ac1d50241bf tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:31:38 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-1aaac619-001d-41d1-80b4-7ac1d50241bf tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:31:38 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-1aaac619-001d-41d1-80b4-7ac1d50241bf tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:31:39 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-1aaac619-001d-41d1-80b4-7ac1d50241bf tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] 10.0.0.210 "POST /compute/v2.1/servers/32b18558-8bf2-4def-bc70-81c4e38fcc6f/action" status: 202 len: 0 microversion: 2.1 time: 0.858233 Apr 13 16:31:39 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 195/582] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 16:31:38 2023] POST /compute/v2.1/servers/32b18558-8bf2-4def-bc70-81c4e38fcc6f/action => generated 0 bytes in 860 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Apr 13 16:31:41 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-96c96180-99f7-4ff1-a9af-0f15b58b86c3 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:31:41 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-96c96180-99f7-4ff1-a9af-0f15b58b86c3 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:31:41 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-96c96180-99f7-4ff1-a9af-0f15b58b86c3 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:31:41 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-96c96180-99f7-4ff1-a9af-0f15b58b86c3 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:31:41 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-96c96180-99f7-4ff1-a9af-0f15b58b86c3 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:31:41 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-96c96180-99f7-4ff1-a9af-0f15b58b86c3 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:31:41 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-96c96180-99f7-4ff1-a9af-0f15b58b86c3 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:31:41 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-96c96180-99f7-4ff1-a9af-0f15b58b86c3 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:31:41 user devstack@n-api.service[62054]: DEBUG nova.objects.instance [None req-96c96180-99f7-4ff1-a9af-0f15b58b86c3 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lazy-loading 'services' on Instance uuid bf98c3a2-dbeb-4ae4-8423-ce55964c4258 {{(pid=62054) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 16:31:41 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-96c96180-99f7-4ff1-a9af-0f15b58b86c3 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/bf98c3a2-dbeb-4ae4-8423-ce55964c4258/os-volume_attachments/6bdf834e-4cc1-4a8e-850c-84ce4564c544" status: 202 len: 0 microversion: 2.1 time: 0.257259 Apr 13 16:31:41 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 195/583] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 16:31:41 2023] DELETE /compute/v2.1/servers/bf98c3a2-dbeb-4ae4-8423-ce55964c4258/os-volume_attachments/6bdf834e-4cc1-4a8e-850c-84ce4564c544 => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 16:31:41 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-7f3d2a48-5ea5-4adc-b2ce-1f9c2c4af384 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:31:41 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-7f3d2a48-5ea5-4adc-b2ce-1f9c2c4af384 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:31:41 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-7f3d2a48-5ea5-4adc-b2ce-1f9c2c4af384 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:31:41 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-7f3d2a48-5ea5-4adc-b2ce-1f9c2c4af384 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:31:41 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-7f3d2a48-5ea5-4adc-b2ce-1f9c2c4af384 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:31:41 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-7f3d2a48-5ea5-4adc-b2ce-1f9c2c4af384 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:31:41 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-7f3d2a48-5ea5-4adc-b2ce-1f9c2c4af384 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:31:41 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-7f3d2a48-5ea5-4adc-b2ce-1f9c2c4af384 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:31:41 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-7f3d2a48-5ea5-4adc-b2ce-1f9c2c4af384 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bf98c3a2-dbeb-4ae4-8423-ce55964c4258/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046343 Apr 13 16:31:41 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 194/584] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 16:31:41 2023] GET /compute/v2.1/servers/bf98c3a2-dbeb-4ae4-8423-ce55964c4258/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:31:45 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-b347c3f9-ba96-4152-b346-ddd7bd69468d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-1531186020", "imageRef": "708622a9-7465-4492-ade8-b827198f7e30", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "image", "volume_size": 1, "uuid": "708622a9-7465-4492-ade8-b827198f7e30", "destination_type": "volume"}], "networks": [{"uuid": "5a7877ff-8230-470b-90b5-e5dcfc8f0cee"}]}} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:31:45 user devstack@n-api.service[62053]: DEBUG nova.network.neutron [None req-b347c3f9-ba96-4152-b346-ddd7bd69468d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] validate_networks() for [('5a7877ff-8230-470b-90b5-e5dcfc8f0cee', None, None, None, None, None)] {{(pid=62053) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 16:31:46 user devstack@n-api.service[62053]: DEBUG nova.virt.hardware [None req-b347c3f9-ba96-4152-b346-ddd7bd69468d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Flavor limits 0:0:0 {{(pid=62053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 16:31:46 user devstack@n-api.service[62053]: DEBUG nova.virt.hardware [None req-b347c3f9-ba96-4152-b346-ddd7bd69468d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Image limits 0:0:0 {{(pid=62053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 16:31:46 user devstack@n-api.service[62053]: DEBUG nova.virt.hardware [None req-b347c3f9-ba96-4152-b346-ddd7bd69468d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Flavor pref 0:0:0 {{(pid=62053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 16:31:46 user devstack@n-api.service[62053]: DEBUG nova.virt.hardware [None req-b347c3f9-ba96-4152-b346-ddd7bd69468d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Image pref 0:0:0 {{(pid=62053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 16:31:46 user devstack@n-api.service[62053]: DEBUG nova.virt.hardware [None req-b347c3f9-ba96-4152-b346-ddd7bd69468d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 16:31:46 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-b347c3f9-ba96-4152-b346-ddd7bd69468d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:31:46 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-b347c3f9-ba96-4152-b346-ddd7bd69468d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:31:46 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-b347c3f9-ba96-4152-b346-ddd7bd69468d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:31:46 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-b347c3f9-ba96-4152-b346-ddd7bd69468d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:31:46 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-b347c3f9-ba96-4152-b346-ddd7bd69468d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:31:46 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-b347c3f9-ba96-4152-b346-ddd7bd69468d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:31:46 user devstack@n-api.service[62053]: DEBUG nova.quota [None req-b347c3f9-ba96-4152-b346-ddd7bd69468d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Getting quotas for project b2d09a74bf684a9fb1dd1e95d6c23f3c. Resources: {'instances', 'cores', 'ram'} {{(pid=62053) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 16:31:46 user devstack@n-api.service[62053]: DEBUG nova.quota [None req-b347c3f9-ba96-4152-b346-ddd7bd69468d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Getting quotas for user e45a882dbafb4ea4976e4f45289eb2b8 and project b2d09a74bf684a9fb1dd1e95d6c23f3c. Resources: {'instances', 'cores', 'ram'} {{(pid=62053) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 16:31:46 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-b347c3f9-ba96-4152-b346-ddd7bd69468d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Going to run 1 instances... {{(pid=62053) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 16:31:46 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-b347c3f9-ba96-4152-b346-ddd7bd69468d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='708622a9-7465-4492-ade8-b827198f7e30',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=62053) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 16:31:46 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-b347c3f9-ba96-4152-b346-ddd7bd69468d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.777588 Apr 13 16:31:46 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 196/585] 10.0.0.210 () {66 vars in 1265 bytes} [Thu Apr 13 16:31:45 2023] POST /compute/v2.1/servers => generated 378 bytes in 779 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 13 16:31:46 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-8f772d2a-e8a9-4ebe-892b-be662985dea3 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:31:46 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-8f772d2a-e8a9-4ebe-892b-be662985dea3 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:31:46 user devstack@n-api.service[62054]: DEBUG nova.policy [None req-8f772d2a-e8a9-4ebe-892b-be662985dea3 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45a882dbafb4ea4976e4f45289eb2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d09a74bf684a9fb1dd1e95d6c23f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62054) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:31:46 user devstack@n-api.service[62054]: DEBUG nova.policy [None req-8f772d2a-e8a9-4ebe-892b-be662985dea3 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e45a882dbafb4ea4976e4f45289eb2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d09a74bf684a9fb1dd1e95d6c23f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62054) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:31:46 user devstack@n-api.service[62054]: DEBUG nova.policy [None req-8f772d2a-e8a9-4ebe-892b-be662985dea3 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e45a882dbafb4ea4976e4f45289eb2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d09a74bf684a9fb1dd1e95d6c23f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62054) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:31:46 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-8f772d2a-e8a9-4ebe-892b-be662985dea3 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2956ab05-28ff-4c9e-b646-dbb83b3db278" status: 200 len: 1395 microversion: 2.87 time: 0.128546 Apr 13 16:31:46 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 196/586] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 16:31:46 2023] GET /compute/v2.1/servers/2956ab05-28ff-4c9e-b646-dbb83b3db278 => generated 1395 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 16:31:48 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-8ab9bd8c-c7e5-4030-8d9c-10bc5b800524 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:31:48 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-8ab9bd8c-c7e5-4030-8d9c-10bc5b800524 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:31:48 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-8ab9bd8c-c7e5-4030-8d9c-10bc5b800524 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:31:48 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-8ab9bd8c-c7e5-4030-8d9c-10bc5b800524 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:31:48 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-8ab9bd8c-c7e5-4030-8d9c-10bc5b800524 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Going to try to start instance {{(pid=62055) start /opt/stack/nova/nova/compute/api.py:2787}} Apr 13 16:31:48 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-8ab9bd8c-c7e5-4030-8d9c-10bc5b800524 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] 10.0.0.210 "POST /compute/v2.1/servers/eaae47b9-a059-49f6-9ae6-d7147003e2f2/action" status: 202 len: 0 microversion: 2.1 time: 0.128836 Apr 13 16:31:48 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 195/587] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 16:31:48 2023] POST /compute/v2.1/servers/eaae47b9-a059-49f6-9ae6-d7147003e2f2/action => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 16:31:48 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-a8615ea2-5a25-4814-9650-6de20973e6b1 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:31:48 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-a8615ea2-5a25-4814-9650-6de20973e6b1 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:31:48 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-a8615ea2-5a25-4814-9650-6de20973e6b1 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:31:48 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-a8615ea2-5a25-4814-9650-6de20973e6b1 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:31:48 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-a8615ea2-5a25-4814-9650-6de20973e6b1 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:31:48 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-a8615ea2-5a25-4814-9650-6de20973e6b1 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:31:48 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-a8615ea2-5a25-4814-9650-6de20973e6b1 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:31:48 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-a8615ea2-5a25-4814-9650-6de20973e6b1 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:31:48 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-1cbd883c-06ac-47dd-acfa-2f5baa8ec9ba tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestStampPattern-server-228552911", "imageRef": "2d22499e-4681-4f01-8d24-292a6af73d70", "flavorRef": "42", "key_name": "tempest-TestStampPattern-792944514", "security_groups": [{"name": "tempest-secgroup-smoke-1923082772"}], "networks": [{"uuid": "11386312-9ac6-4252-ab98-b3298a08599c"}]}} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:31:48 user devstack@n-api.service[62054]: DEBUG nova.network.neutron [None req-1cbd883c-06ac-47dd-acfa-2f5baa8ec9ba tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] validate_networks() for [('11386312-9ac6-4252-ab98-b3298a08599c', None, None, None, None, None)] {{(pid=62054) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 16:31:48 user devstack@n-api.service[62053]: DEBUG nova.policy [None req-a8615ea2-5a25-4814-9650-6de20973e6b1 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fab402fb794a5a9281cfb7fe188813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24904988cf334657b084fd726c7ecf8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62053) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:31:48 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-a8615ea2-5a25-4814-9650-6de20973e6b1 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eaae47b9-a059-49f6-9ae6-d7147003e2f2" status: 200 len: 1652 microversion: 2.1 time: 0.342140 Apr 13 16:31:48 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 197/588] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:31:48 2023] GET /compute/v2.1/servers/eaae47b9-a059-49f6-9ae6-d7147003e2f2 => generated 1652 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:31:49 user devstack@n-api.service[62054]: DEBUG nova.virt.hardware [None req-1cbd883c-06ac-47dd-acfa-2f5baa8ec9ba tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Flavor limits 0:0:0 {{(pid=62054) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 16:31:49 user devstack@n-api.service[62054]: DEBUG nova.virt.hardware [None req-1cbd883c-06ac-47dd-acfa-2f5baa8ec9ba tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Image limits 0:0:0 {{(pid=62054) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 16:31:49 user devstack@n-api.service[62054]: DEBUG nova.virt.hardware [None req-1cbd883c-06ac-47dd-acfa-2f5baa8ec9ba tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Flavor pref 0:0:0 {{(pid=62054) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 16:31:49 user devstack@n-api.service[62054]: DEBUG nova.virt.hardware [None req-1cbd883c-06ac-47dd-acfa-2f5baa8ec9ba tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Image pref 0:0:0 {{(pid=62054) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 16:31:49 user devstack@n-api.service[62054]: DEBUG nova.virt.hardware [None req-1cbd883c-06ac-47dd-acfa-2f5baa8ec9ba tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62054) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 16:31:49 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-1cbd883c-06ac-47dd-acfa-2f5baa8ec9ba tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:31:49 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-1cbd883c-06ac-47dd-acfa-2f5baa8ec9ba tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:31:49 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-1cbd883c-06ac-47dd-acfa-2f5baa8ec9ba tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:31:49 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-1cbd883c-06ac-47dd-acfa-2f5baa8ec9ba tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:31:49 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-1cbd883c-06ac-47dd-acfa-2f5baa8ec9ba tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:31:49 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-1cbd883c-06ac-47dd-acfa-2f5baa8ec9ba tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:31:49 user devstack@n-api.service[62054]: DEBUG nova.quota [None req-1cbd883c-06ac-47dd-acfa-2f5baa8ec9ba tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Getting quotas for project bb7100b359f341759cb6f6753e1539a8. Resources: {'instances', 'cores', 'ram'} {{(pid=62054) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 16:31:49 user devstack@n-api.service[62054]: DEBUG nova.quota [None req-1cbd883c-06ac-47dd-acfa-2f5baa8ec9ba tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Getting quotas for user f523740272844b6eb236477d0b116ddb and project bb7100b359f341759cb6f6753e1539a8. Resources: {'instances', 'cores', 'ram'} {{(pid=62054) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 16:31:49 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-1cbd883c-06ac-47dd-acfa-2f5baa8ec9ba tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Going to run 1 instances... {{(pid=62054) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 16:31:49 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-1cbd883c-06ac-47dd-acfa-2f5baa8ec9ba tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] [instance: 64a9c052-89a9-48ba-80c9-13fb5ef22f0e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d22499e-4681-4f01-8d24-292a6af73d70',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=62054) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 16:31:49 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-1cbd883c-06ac-47dd-acfa-2f5baa8ec9ba tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.204754 Apr 13 16:31:49 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 197/589] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 16:31:48 2023] POST /compute/v2.1/servers => generated 404 bytes in 1207 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 16:31:49 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-6764cc6a-107e-4cd7-9be0-a946c6d7db59 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:31:49 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-6764cc6a-107e-4cd7-9be0-a946c6d7db59 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] [instance: 64a9c052-89a9-48ba-80c9-13fb5ef22f0e] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:31:49 user devstack@n-api.service[62055]: DEBUG nova.policy [None req-6764cc6a-107e-4cd7-9be0-a946c6d7db59 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f523740272844b6eb236477d0b116ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7100b359f341759cb6f6753e1539a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62055) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:31:49 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-6764cc6a-107e-4cd7-9be0-a946c6d7db59 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] 10.0.0.210 "GET /compute/v2.1/servers/64a9c052-89a9-48ba-80c9-13fb5ef22f0e" status: 200 len: 1235 microversion: 2.1 time: 0.088132 Apr 13 16:31:49 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 196/590] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:31:49 2023] GET /compute/v2.1/servers/64a9c052-89a9-48ba-80c9-13fb5ef22f0e => generated 1235 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:31:50 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-cccc1a35-d4ce-44c5-b279-3a97749c6ef0 req-780951a5-ac0f-4c64-ada0-560da721f61f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2956ab05-28ff-4c9e-b646-dbb83b3db278", "tag": "84df62e9-af7c-4e62-83da-b43b511be2a0"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:31:50 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-cccc1a35-d4ce-44c5-b279-3a97749c6ef0 req-780951a5-ac0f-4c64-ada0-560da721f61f service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:31:50 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-cccc1a35-d4ce-44c5-b279-3a97749c6ef0 req-780951a5-ac0f-4c64-ada0-560da721f61f service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:31:50 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-cccc1a35-d4ce-44c5-b279-3a97749c6ef0 req-780951a5-ac0f-4c64-ada0-560da721f61f service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:31:50 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-cccc1a35-d4ce-44c5-b279-3a97749c6ef0 req-780951a5-ac0f-4c64-ada0-560da721f61f service nova] Creating event network-changed:84df62e9-af7c-4e62-83da-b43b511be2a0 for instance 2956ab05-28ff-4c9e-b646-dbb83b3db278 on user Apr 13 16:31:50 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [req-cccc1a35-d4ce-44c5-b279-3a97749c6ef0 req-780951a5-ac0f-4c64-ada0-560da721f61f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033165 Apr 13 16:31:50 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 198/591] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:31:50 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:31:51 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-55a1fdb1-a594-44a0-8856-712bd6a18ca9 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Action: 'create', calling method: .version_select at 0x7f96e4a629e0>, body: {"keypair": {"name": "tempest-keypair-179744772", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLQeZ76om971CHhTZu4ReSq6QPGcHpR5nWHWtfdjAVD10KpB0WFrcOFE78MwJOBYC8dClsRGNG38ZB3wd8nDfZlZongElXTKw6yUyFEOVvzfdaLLX/bmjmfAtuiMX+ECkA=="}} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:31:51 user devstack@n-api.service[62054]: DEBUG nova.quota [None req-55a1fdb1-a594-44a0-8856-712bd6a18ca9 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Getting quotas for project 0653ab16660b46cea9c5af58ea0b1931. Resources: {'key_pairs'} {{(pid=62054) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 16:31:51 user devstack@n-api.service[62054]: DEBUG nova.quota [None req-55a1fdb1-a594-44a0-8856-712bd6a18ca9 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Getting quotas for user 48b4e972cd1049509fa899449961ab59 and project 0653ab16660b46cea9c5af58ea0b1931. Resources: {'key_pairs'} {{(pid=62054) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 16:31:51 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-55a1fdb1-a594-44a0-8856-712bd6a18ca9 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.171418 Apr 13 16:31:51 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 198/592] 10.0.0.210 () {66 vars in 1277 bytes} [Thu Apr 13 16:31:51 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 173 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 13 16:31:52 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [req-6efeb63d-9450-4a44-b040-be765a604ef6 req-67a790d5-50c6-4d0f-8f20-8ebb8db3c2f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eaae47b9-a059-49f6-9ae6-d7147003e2f2", "name": "network-vif-plugged", "status": "completed", "tag": "e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae"}]} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:31:52 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-6efeb63d-9450-4a44-b040-be765a604ef6 req-67a790d5-50c6-4d0f-8f20-8ebb8db3c2f3 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:31:52 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-6efeb63d-9450-4a44-b040-be765a604ef6 req-67a790d5-50c6-4d0f-8f20-8ebb8db3c2f3 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:31:52 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-6efeb63d-9450-4a44-b040-be765a604ef6 req-67a790d5-50c6-4d0f-8f20-8ebb8db3c2f3 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:31:52 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-6efeb63d-9450-4a44-b040-be765a604ef6 req-67a790d5-50c6-4d0f-8f20-8ebb8db3c2f3 service nova] Creating event network-vif-plugged:e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae for instance eaae47b9-a059-49f6-9ae6-d7147003e2f2 on user Apr 13 16:31:52 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [req-6efeb63d-9450-4a44-b040-be765a604ef6 req-67a790d5-50c6-4d0f-8f20-8ebb8db3c2f3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129936 Apr 13 16:31:52 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 197/593] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:31:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:31:53 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-f5944cc3-0bfe-4afc-80f2-fb850e13932f tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1250036054", "imageRef": "708622a9-7465-4492-ade8-b827198f7e30", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "5acc9a78-1127-46df-bb60-7544cdd2c1ef"}], "security_groups": [{"name": "tempest-securitygroup--1497136280"}], "key_name": "tempest-keypair-179744772", "user_data": "}} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:31:53 user devstack@n-api.service[62053]: DEBUG nova.network.neutron [None req-f5944cc3-0bfe-4afc-80f2-fb850e13932f tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] validate_networks() for [('5acc9a78-1127-46df-bb60-7544cdd2c1ef', None, None, None, None, None)] {{(pid=62053) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 16:31:54 user devstack@n-api.service[62053]: DEBUG nova.virt.hardware [None req-f5944cc3-0bfe-4afc-80f2-fb850e13932f tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Flavor limits 0:0:0 {{(pid=62053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 16:31:54 user devstack@n-api.service[62053]: DEBUG nova.virt.hardware [None req-f5944cc3-0bfe-4afc-80f2-fb850e13932f tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Image limits 0:0:0 {{(pid=62053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 16:31:54 user devstack@n-api.service[62053]: DEBUG nova.virt.hardware [None req-f5944cc3-0bfe-4afc-80f2-fb850e13932f tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Flavor pref 0:0:0 {{(pid=62053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 16:31:54 user devstack@n-api.service[62053]: DEBUG nova.virt.hardware [None req-f5944cc3-0bfe-4afc-80f2-fb850e13932f tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Image pref 0:0:0 {{(pid=62053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 16:31:54 user devstack@n-api.service[62053]: DEBUG nova.virt.hardware [None req-f5944cc3-0bfe-4afc-80f2-fb850e13932f tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 16:31:54 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-f5944cc3-0bfe-4afc-80f2-fb850e13932f tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:31:54 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-f5944cc3-0bfe-4afc-80f2-fb850e13932f tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:31:54 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-f5944cc3-0bfe-4afc-80f2-fb850e13932f tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:31:54 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-f5944cc3-0bfe-4afc-80f2-fb850e13932f tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:31:54 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-f5944cc3-0bfe-4afc-80f2-fb850e13932f tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:31:54 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-f5944cc3-0bfe-4afc-80f2-fb850e13932f tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:31:54 user devstack@n-api.service[62053]: DEBUG nova.quota [None req-f5944cc3-0bfe-4afc-80f2-fb850e13932f tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Getting quotas for project 0653ab16660b46cea9c5af58ea0b1931. Resources: {'instances', 'cores', 'ram'} {{(pid=62053) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 16:31:54 user devstack@n-api.service[62053]: DEBUG nova.quota [None req-f5944cc3-0bfe-4afc-80f2-fb850e13932f tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Getting quotas for user 48b4e972cd1049509fa899449961ab59 and project 0653ab16660b46cea9c5af58ea0b1931. Resources: {'instances', 'cores', 'ram'} {{(pid=62053) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 16:31:54 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-f5944cc3-0bfe-4afc-80f2-fb850e13932f tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Going to run 1 instances... {{(pid=62053) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 16:31:54 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-f5944cc3-0bfe-4afc-80f2-fb850e13932f tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='708622a9-7465-4492-ade8-b827198f7e30',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=62053) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 16:31:54 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-f5944cc3-0bfe-4afc-80f2-fb850e13932f tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 0.924025 Apr 13 16:31:54 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 199/594] 10.0.0.210 () {66 vars in 1265 bytes} [Thu Apr 13 16:31:53 2023] POST /compute/v2.1/servers => generated 400 bytes in 925 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 13 16:31:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-d0cf41be-a11d-4bf2-a24e-376f4bcf2b32 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:31:54 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-d0cf41be-a11d-4bf2-a24e-376f4bcf2b32 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:31:54 user devstack@n-api.service[62054]: DEBUG nova.policy [None req-d0cf41be-a11d-4bf2-a24e-376f4bcf2b32 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b4e972cd1049509fa899449961ab59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0653ab16660b46cea9c5af58ea0b1931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62054) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:31:54 user devstack@n-api.service[62054]: DEBUG nova.policy [None req-d0cf41be-a11d-4bf2-a24e-376f4bcf2b32 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48b4e972cd1049509fa899449961ab59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0653ab16660b46cea9c5af58ea0b1931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62054) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:31:54 user devstack@n-api.service[62054]: DEBUG nova.policy [None req-d0cf41be-a11d-4bf2-a24e-376f4bcf2b32 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48b4e972cd1049509fa899449961ab59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0653ab16660b46cea9c5af58ea0b1931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62054) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:31:54 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-d0cf41be-a11d-4bf2-a24e-376f4bcf2b32 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] 10.0.0.210 "GET /compute/v2.1/servers/35b23303-e373-4f35-b7ee-76e6815073ce" status: 200 len: 1275 microversion: 2.20 time: 0.084440 Apr 13 16:31:54 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 199/595] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 16:31:54 2023] GET /compute/v2.1/servers/35b23303-e373-4f35-b7ee-76e6815073ce => generated 1275 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 16:31:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [req-80e5ba1f-6707-4c10-b3bf-3652864e2146 req-db190321-7eb0-4cf9-918b-d12ab7dc39dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eaae47b9-a059-49f6-9ae6-d7147003e2f2", "name": "network-vif-plugged", "status": "completed", "tag": "e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae"}]} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:31:54 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-80e5ba1f-6707-4c10-b3bf-3652864e2146 req-db190321-7eb0-4cf9-918b-d12ab7dc39dd service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:31:54 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-80e5ba1f-6707-4c10-b3bf-3652864e2146 req-db190321-7eb0-4cf9-918b-d12ab7dc39dd service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:31:54 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-80e5ba1f-6707-4c10-b3bf-3652864e2146 req-db190321-7eb0-4cf9-918b-d12ab7dc39dd service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:31:54 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-80e5ba1f-6707-4c10-b3bf-3652864e2146 req-db190321-7eb0-4cf9-918b-d12ab7dc39dd service nova] Creating event network-vif-plugged:e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae for instance eaae47b9-a059-49f6-9ae6-d7147003e2f2 on user Apr 13 16:31:54 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [req-80e5ba1f-6707-4c10-b3bf-3652864e2146 req-db190321-7eb0-4cf9-918b-d12ab7dc39dd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097005 Apr 13 16:31:54 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 198/596] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:31:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:31:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-6ca6dac9-ec5d-4652-83b2-2c89f825f1cf req-310e95e7-b9d2-4409-b6ac-94ad8a9f06ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64a9c052-89a9-48ba-80c9-13fb5ef22f0e", "tag": "5128334f-7255-4a56-9e8b-1151027d219b"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:31:55 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-6ca6dac9-ec5d-4652-83b2-2c89f825f1cf req-310e95e7-b9d2-4409-b6ac-94ad8a9f06ee service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:31:55 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-6ca6dac9-ec5d-4652-83b2-2c89f825f1cf req-310e95e7-b9d2-4409-b6ac-94ad8a9f06ee service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:31:55 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-6ca6dac9-ec5d-4652-83b2-2c89f825f1cf req-310e95e7-b9d2-4409-b6ac-94ad8a9f06ee service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:31:55 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-6ca6dac9-ec5d-4652-83b2-2c89f825f1cf req-310e95e7-b9d2-4409-b6ac-94ad8a9f06ee service nova] Creating event network-changed:5128334f-7255-4a56-9e8b-1151027d219b for instance 64a9c052-89a9-48ba-80c9-13fb5ef22f0e on user Apr 13 16:31:55 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [req-6ca6dac9-ec5d-4652-83b2-2c89f825f1cf req-310e95e7-b9d2-4409-b6ac-94ad8a9f06ee service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038987 Apr 13 16:31:55 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 200/597] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:31:55 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:31:57 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-7d9bf468-0ffd-4107-9e3f-65107797b3fc req-45253ddb-f0ec-4711-951d-796b1679c5c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64a9c052-89a9-48ba-80c9-13fb5ef22f0e", "name": "network-vif-plugged", "status": "completed", "tag": "5128334f-7255-4a56-9e8b-1151027d219b"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:31:57 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-7d9bf468-0ffd-4107-9e3f-65107797b3fc req-45253ddb-f0ec-4711-951d-796b1679c5c3 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:31:57 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-7d9bf468-0ffd-4107-9e3f-65107797b3fc req-45253ddb-f0ec-4711-951d-796b1679c5c3 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:31:57 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-7d9bf468-0ffd-4107-9e3f-65107797b3fc req-45253ddb-f0ec-4711-951d-796b1679c5c3 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:31:57 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-a30d0121-5124-49a8-a7fc-90382345bd35 tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:31:57 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-a30d0121-5124-49a8-a7fc-90382345bd35 tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] [instance: 71a2163b-fb6b-4b71-b93f-d682ad141b84] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:31:57 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-7d9bf468-0ffd-4107-9e3f-65107797b3fc req-45253ddb-f0ec-4711-951d-796b1679c5c3 service nova] Creating event network-vif-plugged:5128334f-7255-4a56-9e8b-1151027d219b for instance 64a9c052-89a9-48ba-80c9-13fb5ef22f0e on user Apr 13 16:31:57 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-a30d0121-5124-49a8-a7fc-90382345bd35 tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:31:57 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-a30d0121-5124-49a8-a7fc-90382345bd35 tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:31:57 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [req-7d9bf468-0ffd-4107-9e3f-65107797b3fc req-45253ddb-f0ec-4711-951d-796b1679c5c3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042868 Apr 13 16:31:57 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 200/598] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:31:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:31:57 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-a30d0121-5124-49a8-a7fc-90382345bd35 tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:31:57 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-a30d0121-5124-49a8-a7fc-90382345bd35 tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:31:57 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-a30d0121-5124-49a8-a7fc-90382345bd35 tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:31:57 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-a30d0121-5124-49a8-a7fc-90382345bd35 tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:31:57 user devstack@n-api.service[62055]: INFO nova.api.openstack.wsgi [None req-a30d0121-5124-49a8-a7fc-90382345bd35 tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] HTTP exception thrown: Instance 71a2163b-fb6b-4b71-b93f-d682ad141b84 could not be found. Apr 13 16:31:57 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-a30d0121-5124-49a8-a7fc-90382345bd35 tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] Request method failure captured: Apr 13 16:31:57 user devstack@n-api.service[62055]: request: GET /compute/v2.1/servers/71a2163b-fb6b-4b71-b93f-d682ad141b84 HTTP/1.1 Apr 13 16:31:57 user devstack@n-api.service[62055]: Accept: application/json Apr 13 16:31:57 user devstack@n-api.service[62055]: Accept-Encoding: identity Apr 13 16:31:57 user devstack@n-api.service[62055]: Connection: close Apr 13 16:31:57 user devstack@n-api.service[62055]: Content-Length: 0 Apr 13 16:31:57 user devstack@n-api.service[62055]: Content-Type: application/json Apr 13 16:31:57 user devstack@n-api.service[62055]: Host: 10.0.0.210 Apr 13 16:31:57 user devstack@n-api.service[62055]: Openstack-System-Scope: None Apr 13 16:31:57 user devstack@n-api.service[62055]: User-Agent: python-urllib3/1.26.15 Apr 13 16:31:57 user devstack@n-api.service[62055]: X-Auth-Token: gAAAAABkOC3a4kC9oVRo863tfNNVbOkWZuWhwYfwKMEpYcAoX_AYbZwXCcOVoYpoEs9Dnr39G13UP62i90tJ9N6Xfz9Sbcg8ZcHWkh2cUBHlQz4uYEZlQYz9CaEi8HjL5REoYhc31X0zpnLVwJhS3ChdUZTTsNPzXCb3EDvv35VbLXbzO3OEQuE Apr 13 16:31:57 user devstack@n-api.service[62055]: X-Domain-Id: None Apr 13 16:31:57 user devstack@n-api.service[62055]: X-Domain-Name: None Apr 13 16:31:57 user devstack@n-api.service[62055]: X-Identity-Status: Confirmed Apr 13 16:31:57 user devstack@n-api.service[62055]: X-Is-Admin-Project: True Apr 13 16:31:57 user devstack@n-api.service[62055]: X-Project-Domain-Id: default Apr 13 16:31:57 user devstack@n-api.service[62055]: X-Project-Domain-Name: Default Apr 13 16:31:57 user devstack@n-api.service[62055]: X-Project-Id: c33101d535154c9a88cae865ee7ece46 Apr 13 16:31:57 user devstack@n-api.service[62055]: X-Project-Name: tempest-VolumesNegativeTest-1740638080 Apr 13 16:31:57 user devstack@n-api.service[62055]: X-Role: reader,member Apr 13 16:31:57 user devstack@n-api.service[62055]: X-Roles: reader,member Apr 13 16:31:57 user devstack@n-api.service[62055]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c33101d535154c9a88cae865ee7ece46"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c33101d535154c9a88cae865ee7ece46"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c33101d535154c9a88cae865ee7ece46"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 13 16:31:57 user devstack@n-api.service[62055]: X-Tenant: tempest-VolumesNegativeTest-1740638080 Apr 13 16:31:57 user devstack@n-api.service[62055]: X-Tenant-Id: c33101d535154c9a88cae865ee7ece46 Apr 13 16:31:57 user devstack@n-api.service[62055]: X-Tenant-Name: tempest-VolumesNegativeTest-1740638080 Apr 13 16:31:57 user devstack@n-api.service[62055]: X-User: tempest-VolumesNegativeTest-1740638080-project-member Apr 13 16:31:57 user devstack@n-api.service[62055]: X-User-Domain-Id: default Apr 13 16:31:57 user devstack@n-api.service[62055]: X-User-Domain-Name: Default Apr 13 16:31:57 user devstack@n-api.service[62055]: X-User-Id: d7f9678e69654526b4d5dc9de05ac090 Apr 13 16:31:57 user devstack@n-api.service[62055]: X-User-Name: tempest-VolumesNegativeTest-1740638080-project-member Apr 13 16:31:57 user devstack@n-api.service[62055]: method: > Apr 13 16:31:57 user devstack@n-api.service[62055]: exception: Instance 71a2163b-fb6b-4b71-b93f-d682ad141b84 could not be found. Apr 13 16:31:57 user devstack@n-api.service[62055]: action_args: {'id': '71a2163b-fb6b-4b71-b93f-d682ad141b84'} Apr 13 16:31:57 user devstack@n-api.service[62055]: {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 16:31:57 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:31:57 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 16:31:57 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 16:31:57 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 16:31:57 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 16:31:57 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 16:31:57 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 16:31:57 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 16:31:57 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 16:31:57 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71a2163b-fb6b-4b71-b93f-d682ad141b84 could not be found. Apr 13 16:31:57 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:31:57 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:31:57 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:31:57 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:31:57 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 16:31:57 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 16:31:57 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 16:31:57 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 16:31:57 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 16:31:57 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 16:31:57 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 16:31:57 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 16:31:57 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 16:31:57 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 16:31:57 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 16:31:57 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 16:31:57 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71a2163b-fb6b-4b71-b93f-d682ad141b84 could not be found. Apr 13 16:31:57 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:31:57 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:31:57 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:31:57 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:31:57 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 16:31:57 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 16:31:57 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 16:31:57 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 16:31:57 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71a2163b-fb6b-4b71-b93f-d682ad141b84 could not be found. Apr 13 16:31:57 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:31:57 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-a30d0121-5124-49a8-a7fc-90382345bd35 tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] Returning 404 to user: Instance 71a2163b-fb6b-4b71-b93f-d682ad141b84 could not be found. {{(pid=62055) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 16:31:57 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-a30d0121-5124-49a8-a7fc-90382345bd35 tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] 10.0.0.210 "GET /compute/v2.1/servers/71a2163b-fb6b-4b71-b93f-d682ad141b84" status: 404 len: 111 microversion: 2.1 time: 0.077816 Apr 13 16:31:57 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 199/599] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:31:57 2023] GET /compute/v2.1/servers/71a2163b-fb6b-4b71-b93f-d682ad141b84 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 16:31:59 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-f334f80b-81fb-4b1a-82f2-a483877d78b4 req-3cd4bdd2-a0cc-417a-9751-bb7871583dc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64a9c052-89a9-48ba-80c9-13fb5ef22f0e", "name": "network-vif-plugged", "status": "completed", "tag": "5128334f-7255-4a56-9e8b-1151027d219b"}, {"name": "network-changed", "server_uuid": "35b23303-e373-4f35-b7ee-76e6815073ce", "tag": "d3c66e4e-b15d-4bc9-a838-265ca07a6a66"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:31:59 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-f334f80b-81fb-4b1a-82f2-a483877d78b4 req-3cd4bdd2-a0cc-417a-9751-bb7871583dc2 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:31:59 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-f334f80b-81fb-4b1a-82f2-a483877d78b4 req-3cd4bdd2-a0cc-417a-9751-bb7871583dc2 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:31:59 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-f334f80b-81fb-4b1a-82f2-a483877d78b4 req-3cd4bdd2-a0cc-417a-9751-bb7871583dc2 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:31:59 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-f334f80b-81fb-4b1a-82f2-a483877d78b4 req-3cd4bdd2-a0cc-417a-9751-bb7871583dc2 service nova] Creating event network-vif-plugged:5128334f-7255-4a56-9e8b-1151027d219b for instance 64a9c052-89a9-48ba-80c9-13fb5ef22f0e on user Apr 13 16:31:59 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-f334f80b-81fb-4b1a-82f2-a483877d78b4 req-3cd4bdd2-a0cc-417a-9751-bb7871583dc2 service nova] Creating event network-changed:d3c66e4e-b15d-4bc9-a838-265ca07a6a66 for instance 35b23303-e373-4f35-b7ee-76e6815073ce on user Apr 13 16:31:59 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [req-f334f80b-81fb-4b1a-82f2-a483877d78b4 req-3cd4bdd2-a0cc-417a-9751-bb7871583dc2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.054124 Apr 13 16:31:59 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 201/600] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:31:59 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:32:00 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_cell0:SELECT=2 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:32:00 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-d1642f9c-92a0-47c6-a8d0-b328afd76268 req-26a1c975-0e22-4b31-9b44-8806f0727422 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35b23303-e373-4f35-b7ee-76e6815073ce", "name": "network-vif-plugged", "status": "completed", "tag": "d3c66e4e-b15d-4bc9-a838-265ca07a6a66"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:32:00 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-d1642f9c-92a0-47c6-a8d0-b328afd76268 req-26a1c975-0e22-4b31-9b44-8806f0727422 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:32:00 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-d1642f9c-92a0-47c6-a8d0-b328afd76268 req-26a1c975-0e22-4b31-9b44-8806f0727422 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:32:00 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-d1642f9c-92a0-47c6-a8d0-b328afd76268 req-26a1c975-0e22-4b31-9b44-8806f0727422 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:32:00 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-d1642f9c-92a0-47c6-a8d0-b328afd76268 req-26a1c975-0e22-4b31-9b44-8806f0727422 service nova] Creating event network-vif-plugged:d3c66e4e-b15d-4bc9-a838-265ca07a6a66 for instance 35b23303-e373-4f35-b7ee-76e6815073ce on user Apr 13 16:32:00 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [req-d1642f9c-92a0-47c6-a8d0-b328afd76268 req-26a1c975-0e22-4b31-9b44-8806f0727422 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040480 Apr 13 16:32:00 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 201/601] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:32:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:32:02 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [req-a6f43fe8-f097-40fe-8db1-78a5dac0c995 req-e27d058f-c046-4318-b850-3d6dbbdc1ee2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2956ab05-28ff-4c9e-b646-dbb83b3db278", "name": "network-vif-plugged", "status": "completed", "tag": "84df62e9-af7c-4e62-83da-b43b511be2a0"}]} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:32:02 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_cell0:SELECT=2 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:32:02 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-a6f43fe8-f097-40fe-8db1-78a5dac0c995 req-e27d058f-c046-4318-b850-3d6dbbdc1ee2 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:32:02 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-a6f43fe8-f097-40fe-8db1-78a5dac0c995 req-e27d058f-c046-4318-b850-3d6dbbdc1ee2 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:32:02 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-a6f43fe8-f097-40fe-8db1-78a5dac0c995 req-e27d058f-c046-4318-b850-3d6dbbdc1ee2 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:32:02 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-a6f43fe8-f097-40fe-8db1-78a5dac0c995 req-e27d058f-c046-4318-b850-3d6dbbdc1ee2 service nova] Creating event network-vif-plugged:84df62e9-af7c-4e62-83da-b43b511be2a0 for instance 2956ab05-28ff-4c9e-b646-dbb83b3db278 on user Apr 13 16:32:02 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-14e2fff3-5d02-4dbe-934f-d5e68d64f627 req-02333e31-a140-437c-99ec-a04bb8977f13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35b23303-e373-4f35-b7ee-76e6815073ce", "name": "network-vif-plugged", "status": "completed", "tag": "d3c66e4e-b15d-4bc9-a838-265ca07a6a66"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:32:02 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [req-a6f43fe8-f097-40fe-8db1-78a5dac0c995 req-e27d058f-c046-4318-b850-3d6dbbdc1ee2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046079 Apr 13 16:32:02 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 200/602] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:32:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:32:02 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_api:SELECT=46,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:32:02 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-14e2fff3-5d02-4dbe-934f-d5e68d64f627 req-02333e31-a140-437c-99ec-a04bb8977f13 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:32:02 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-14e2fff3-5d02-4dbe-934f-d5e68d64f627 req-02333e31-a140-437c-99ec-a04bb8977f13 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:32:02 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-14e2fff3-5d02-4dbe-934f-d5e68d64f627 req-02333e31-a140-437c-99ec-a04bb8977f13 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:32:02 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:32:02 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-14e2fff3-5d02-4dbe-934f-d5e68d64f627 req-02333e31-a140-437c-99ec-a04bb8977f13 service nova] Creating event network-vif-plugged:d3c66e4e-b15d-4bc9-a838-265ca07a6a66 for instance 35b23303-e373-4f35-b7ee-76e6815073ce on user Apr 13 16:32:02 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [req-14e2fff3-5d02-4dbe-934f-d5e68d64f627 req-02333e31-a140-437c-99ec-a04bb8977f13 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059531 Apr 13 16:32:02 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 202/603] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:32:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 16:32:04 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-8b8335ff-aed3-4906-8daa-1bcda6e6f4e4 req-6d87c5e2-2cd8-40d1-a301-691f9321fb00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2956ab05-28ff-4c9e-b646-dbb83b3db278", "name": "network-vif-plugged", "status": "completed", "tag": "84df62e9-af7c-4e62-83da-b43b511be2a0"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:32:04 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_cell0:SELECT=14 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:32:04 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=4 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:32:04 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-8b8335ff-aed3-4906-8daa-1bcda6e6f4e4 req-6d87c5e2-2cd8-40d1-a301-691f9321fb00 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:32:04 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-8b8335ff-aed3-4906-8daa-1bcda6e6f4e4 req-6d87c5e2-2cd8-40d1-a301-691f9321fb00 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:32:04 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-8b8335ff-aed3-4906-8daa-1bcda6e6f4e4 req-6d87c5e2-2cd8-40d1-a301-691f9321fb00 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:32:04 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:32:04 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-8b8335ff-aed3-4906-8daa-1bcda6e6f4e4 req-6d87c5e2-2cd8-40d1-a301-691f9321fb00 service nova] Creating event network-vif-plugged:84df62e9-af7c-4e62-83da-b43b511be2a0 for instance 2956ab05-28ff-4c9e-b646-dbb83b3db278 on user Apr 13 16:32:04 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [req-8b8335ff-aed3-4906-8daa-1bcda6e6f4e4 req-6d87c5e2-2cd8-40d1-a301-691f9321fb00 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083466 Apr 13 16:32:04 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 202/604] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:32:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:32:19 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_api:SELECT=22 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:32:19 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:32:19 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-0ae8f18a-8780-49dd-a7c5-42dd25fd9378 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:32:19 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-0ae8f18a-8780-49dd-a7c5-42dd25fd9378 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:32:19 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-0ae8f18a-8780-49dd-a7c5-42dd25fd9378 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:32:19 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-0ae8f18a-8780-49dd-a7c5-42dd25fd9378 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:32:19 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-0ae8f18a-8780-49dd-a7c5-42dd25fd9378 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:32:19 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-0ae8f18a-8780-49dd-a7c5-42dd25fd9378 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:32:19 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-0ae8f18a-8780-49dd-a7c5-42dd25fd9378 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:32:19 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-0ae8f18a-8780-49dd-a7c5-42dd25fd9378 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:32:19 user devstack@n-api.service[62055]: DEBUG nova.policy [None req-0ae8f18a-8780-49dd-a7c5-42dd25fd9378 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b3df1c5c5d441819bcef89ed6966815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980559734a504574a83224deb7423c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62055) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:32:19 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-0ae8f18a-8780-49dd-a7c5-42dd25fd9378 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] 10.0.0.210 "GET /compute/v2.1/servers/acbcaee0-a47b-4fee-8765-9b1c9597d515" status: 200 len: 1677 microversion: 2.1 time: 0.201890 Apr 13 16:32:19 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 201/605] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:32:19 2023] GET /compute/v2.1/servers/acbcaee0-a47b-4fee-8765-9b1c9597d515 => generated 1677 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:32:19 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_cell0:SELECT=4 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:32:19 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_cell0:SELECT=12 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:32:19 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_api:SELECT=1 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:32:19 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-a6339626-7d39-47bc-b91a-1f64ac6bf7f3 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "651ea766-ffda-42a1-9b3c-7be05a92c85f"}} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:32:19 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-a6339626-7d39-47bc-b91a-1f64ac6bf7f3 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:32:19 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-a6339626-7d39-47bc-b91a-1f64ac6bf7f3 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:32:19 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-a6339626-7d39-47bc-b91a-1f64ac6bf7f3 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:32:19 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-a6339626-7d39-47bc-b91a-1f64ac6bf7f3 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:32:19 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-a6339626-7d39-47bc-b91a-1f64ac6bf7f3 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:32:19 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-a6339626-7d39-47bc-b91a-1f64ac6bf7f3 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:32:19 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-a6339626-7d39-47bc-b91a-1f64ac6bf7f3 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:32:19 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-a6339626-7d39-47bc-b91a-1f64ac6bf7f3 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] 10.0.0.210 "POST /compute/v2.1/servers/acbcaee0-a47b-4fee-8765-9b1c9597d515/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.333975 Apr 13 16:32:19 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 203/606] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 16:32:19 2023] POST /compute/v2.1/servers/acbcaee0-a47b-4fee-8765-9b1c9597d515/os-volume_attachments => generated 194 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:32:27 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "84"}} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:32:27 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:32:27 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_api:SELECT=1 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:32:27 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_cell1:SELECT=1 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:32:27 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:32:27 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:32:27 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:32:27 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:32:27 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:32:27 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:32:27 user devstack@n-api.service[62054]: DEBUG nova.policy [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '1b3df1c5c5d441819bcef89ed6966815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980559734a504574a83224deb7423c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62054) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:32:27 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Old instance type m1.nano, new instance type m1.micro {{(pid=62054) resize /opt/stack/nova/nova/compute/api.py:4223}} Apr 13 16:32:27 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:32:27 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:32:27 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:32:27 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:32:27 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:32:27 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:32:27 user devstack@n-api.service[62054]: DEBUG nova.quota [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Getting quotas for project 980559734a504574a83224deb7423c77. Resources: {'cores', 'ram'} {{(pid=62054) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 16:32:27 user devstack@n-api.service[62054]: DEBUG nova.quota [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Getting quotas for user 1b3df1c5c5d441819bcef89ed6966815 and project 980559734a504574a83224deb7423c77. Resources: {'cores', 'ram'} {{(pid=62054) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 16:32:27 user devstack@n-api.service[62054]: DEBUG nova.virt.hardware [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Flavor limits 0:0:0 {{(pid=62054) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 16:32:27 user devstack@n-api.service[62054]: DEBUG nova.virt.hardware [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Image limits 0:0:0 {{(pid=62054) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 16:32:27 user devstack@n-api.service[62054]: DEBUG nova.virt.hardware [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Flavor pref 0:0:0 {{(pid=62054) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 16:32:27 user devstack@n-api.service[62054]: DEBUG nova.virt.hardware [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Image pref 0:0:0 {{(pid=62054) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 16:32:27 user devstack@n-api.service[62054]: DEBUG nova.virt.hardware [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62054) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 16:32:27 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] 10.0.0.210 "POST /compute/v2.1/servers/acbcaee0-a47b-4fee-8765-9b1c9597d515/action" status: 202 len: 0 microversion: 2.1 time: 0.310600 Apr 13 16:32:27 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 203/607] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 16:32:27 2023] POST /compute/v2.1/servers/acbcaee0-a47b-4fee-8765-9b1c9597d515/action => generated 0 bytes in 313 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 16:32:27 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-f8000ef5-b550-4664-8439-efd960eba19c tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:32:27 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-f8000ef5-b550-4664-8439-efd960eba19c tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:32:27 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-f8000ef5-b550-4664-8439-efd960eba19c tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:32:27 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-f8000ef5-b550-4664-8439-efd960eba19c tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:32:27 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-f8000ef5-b550-4664-8439-efd960eba19c tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:32:27 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-f8000ef5-b550-4664-8439-efd960eba19c tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:32:27 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-f8000ef5-b550-4664-8439-efd960eba19c tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:32:27 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-f8000ef5-b550-4664-8439-efd960eba19c tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:32:27 user devstack@n-api.service[62055]: DEBUG nova.policy [None req-f8000ef5-b550-4664-8439-efd960eba19c tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b3df1c5c5d441819bcef89ed6966815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980559734a504574a83224deb7423c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62055) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:32:27 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-f8000ef5-b550-4664-8439-efd960eba19c tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] 10.0.0.210 "GET /compute/v2.1/servers/acbcaee0-a47b-4fee-8765-9b1c9597d515" status: 200 len: 1732 microversion: 2.1 time: 0.164307 Apr 13 16:32:27 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 202/608] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:32:27 2023] GET /compute/v2.1/servers/acbcaee0-a47b-4fee-8765-9b1c9597d515 => generated 1732 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:32:30 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_api:SELECT=2 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:32:30 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:32:30 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-3e32545d-c30c-4719-9ff1-6886344135f5 req-84972a66-9f46-4517-8aa8-9931353885d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acbcaee0-a47b-4fee-8765-9b1c9597d515", "name": "network-vif-unplugged", "status": "completed", "tag": "13471516-9514-4b85-938f-69657c2990e5"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:32:30 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-3e32545d-c30c-4719-9ff1-6886344135f5 req-84972a66-9f46-4517-8aa8-9931353885d1 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:32:30 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-3e32545d-c30c-4719-9ff1-6886344135f5 req-84972a66-9f46-4517-8aa8-9931353885d1 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:32:30 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-3e32545d-c30c-4719-9ff1-6886344135f5 req-84972a66-9f46-4517-8aa8-9931353885d1 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:32:30 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-3e32545d-c30c-4719-9ff1-6886344135f5 req-84972a66-9f46-4517-8aa8-9931353885d1 service nova] Creating event network-vif-unplugged:13471516-9514-4b85-938f-69657c2990e5 for instance acbcaee0-a47b-4fee-8765-9b1c9597d515 on user Apr 13 16:32:30 user devstack@n-api.service[62053]: DEBUG nova.compute.api [req-3e32545d-c30c-4719-9ff1-6886344135f5 req-84972a66-9f46-4517-8aa8-9931353885d1 service nova] Instance acbcaee0-a47b-4fee-8765-9b1c9597d515 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=62053) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 13 16:32:30 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [req-3e32545d-c30c-4719-9ff1-6886344135f5 req-84972a66-9f46-4517-8aa8-9931353885d1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060936 Apr 13 16:32:30 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 204/609] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:32:30 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:32:31 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-df175aea-8c21-42dc-a626-2cf52afefe71 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:32:31 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-df175aea-8c21-42dc-a626-2cf52afefe71 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:32:31 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-df175aea-8c21-42dc-a626-2cf52afefe71 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:32:31 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-df175aea-8c21-42dc-a626-2cf52afefe71 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:32:31 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-df175aea-8c21-42dc-a626-2cf52afefe71 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:32:31 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-df175aea-8c21-42dc-a626-2cf52afefe71 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:32:31 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-df175aea-8c21-42dc-a626-2cf52afefe71 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:32:31 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-df175aea-8c21-42dc-a626-2cf52afefe71 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:32:31 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-df175aea-8c21-42dc-a626-2cf52afefe71 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bf98c3a2-dbeb-4ae4-8423-ce55964c4258/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.069918 Apr 13 16:32:31 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 204/610] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 16:32:31 2023] GET /compute/v2.1/servers/bf98c3a2-dbeb-4ae4-8423-ce55964c4258/os-volume_attachments => generated 25 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 16:32:32 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [req-d82dc912-fd75-4ecc-bd81-46a405c00ccb req-b46e6613-c7c0-47f0-bd8c-58990e163cf6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acbcaee0-a47b-4fee-8765-9b1c9597d515", "name": "network-vif-plugged", "status": "completed", "tag": "13471516-9514-4b85-938f-69657c2990e5"}]} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:32:32 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-d82dc912-fd75-4ecc-bd81-46a405c00ccb req-b46e6613-c7c0-47f0-bd8c-58990e163cf6 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:32:32 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-d82dc912-fd75-4ecc-bd81-46a405c00ccb req-b46e6613-c7c0-47f0-bd8c-58990e163cf6 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:32:32 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-d82dc912-fd75-4ecc-bd81-46a405c00ccb req-b46e6613-c7c0-47f0-bd8c-58990e163cf6 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:32:32 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-d82dc912-fd75-4ecc-bd81-46a405c00ccb req-b46e6613-c7c0-47f0-bd8c-58990e163cf6 service nova] Creating event network-vif-plugged:13471516-9514-4b85-938f-69657c2990e5 for instance acbcaee0-a47b-4fee-8765-9b1c9597d515 on user Apr 13 16:32:32 user devstack@n-api.service[62055]: DEBUG nova.compute.api [req-d82dc912-fd75-4ecc-bd81-46a405c00ccb req-b46e6613-c7c0-47f0-bd8c-58990e163cf6 service nova] Instance acbcaee0-a47b-4fee-8765-9b1c9597d515 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=62055) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 13 16:32:32 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [req-d82dc912-fd75-4ecc-bd81-46a405c00ccb req-b46e6613-c7c0-47f0-bd8c-58990e163cf6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072416 Apr 13 16:32:32 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 203/611] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:32:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:32:33 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-2f11c51f-64dd-4c99-b4e2-016e9fe0a6d2 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:32:33 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-2f11c51f-64dd-4c99-b4e2-016e9fe0a6d2 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 03200054-c651-4333-acce-3bea3defe22a] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:32:33 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-2f11c51f-64dd-4c99-b4e2-016e9fe0a6d2 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:32:33 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-2f11c51f-64dd-4c99-b4e2-016e9fe0a6d2 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:32:33 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-2f11c51f-64dd-4c99-b4e2-016e9fe0a6d2 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:32:33 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-2f11c51f-64dd-4c99-b4e2-016e9fe0a6d2 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:32:33 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-2f11c51f-64dd-4c99-b4e2-016e9fe0a6d2 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:32:33 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-2f11c51f-64dd-4c99-b4e2-016e9fe0a6d2 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:32:33 user devstack@n-api.service[62053]: DEBUG nova.policy [None req-2f11c51f-64dd-4c99-b4e2-016e9fe0a6d2 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e10f63cdd49a9a1ebe1fe4c9de0a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d451e0e239f486aa2b3abe9e273eab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62053) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:32:33 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-2f11c51f-64dd-4c99-b4e2-016e9fe0a6d2 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] 10.0.0.210 "GET /compute/v2.1/servers/03200054-c651-4333-acce-3bea3defe22a" status: 200 len: 1443 microversion: 2.1 time: 0.456113 Apr 13 16:32:33 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 205/612] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:32:33 2023] GET /compute/v2.1/servers/03200054-c651-4333-acce-3bea3defe22a => generated 1443 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:32:34 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-8769a397-3c19-4176-96a9-4eade9a1e9da tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "30806b19-961b-4edd-941a-2ee293795bb1"}} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:32:34 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-8769a397-3c19-4176-96a9-4eade9a1e9da tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:32:34 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-8769a397-3c19-4176-96a9-4eade9a1e9da tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:32:34 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-8769a397-3c19-4176-96a9-4eade9a1e9da tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:32:34 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-8769a397-3c19-4176-96a9-4eade9a1e9da tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:32:34 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-8769a397-3c19-4176-96a9-4eade9a1e9da tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:32:34 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-8769a397-3c19-4176-96a9-4eade9a1e9da tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:32:34 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-8769a397-3c19-4176-96a9-4eade9a1e9da tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:32:34 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-8769a397-3c19-4176-96a9-4eade9a1e9da tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] 10.0.0.210 "POST /compute/v2.1/servers/bf98c3a2-dbeb-4ae4-8423-ce55964c4258/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.324003 Apr 13 16:32:34 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 205/613] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 16:32:34 2023] POST /compute/v2.1/servers/bf98c3a2-dbeb-4ae4-8423-ce55964c4258/os-volume_attachments => generated 194 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:32:35 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [req-0f195529-333b-4576-b0a9-f9406cbd7495 req-6c27cee0-a39c-4a83-b1de-5c442d6eb85e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03200054-c651-4333-acce-3bea3defe22a", "tag": "b40a4a40-0a9a-42f8-8d44-41bf4042454b"}]} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:32:35 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-0f195529-333b-4576-b0a9-f9406cbd7495 req-6c27cee0-a39c-4a83-b1de-5c442d6eb85e service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:32:35 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-0f195529-333b-4576-b0a9-f9406cbd7495 req-6c27cee0-a39c-4a83-b1de-5c442d6eb85e service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:32:35 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-0f195529-333b-4576-b0a9-f9406cbd7495 req-6c27cee0-a39c-4a83-b1de-5c442d6eb85e service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:32:35 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-0f195529-333b-4576-b0a9-f9406cbd7495 req-6c27cee0-a39c-4a83-b1de-5c442d6eb85e service nova] Creating event network-changed:b40a4a40-0a9a-42f8-8d44-41bf4042454b for instance 03200054-c651-4333-acce-3bea3defe22a on user Apr 13 16:32:35 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [req-0f195529-333b-4576-b0a9-f9406cbd7495 req-6c27cee0-a39c-4a83-b1de-5c442d6eb85e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034204 Apr 13 16:32:35 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 204/614] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:32:35 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:32:36 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-0acb4206-7298-416b-9ee6-450d89f90520 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:32:36 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-0acb4206-7298-416b-9ee6-450d89f90520 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:32:36 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-0acb4206-7298-416b-9ee6-450d89f90520 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:32:36 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-0acb4206-7298-416b-9ee6-450d89f90520 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:32:36 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-0acb4206-7298-416b-9ee6-450d89f90520 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:32:36 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-0acb4206-7298-416b-9ee6-450d89f90520 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:32:36 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-0acb4206-7298-416b-9ee6-450d89f90520 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:32:36 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-0acb4206-7298-416b-9ee6-450d89f90520 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:32:36 user devstack@n-api.service[62053]: DEBUG nova.policy [None req-0acb4206-7298-416b-9ee6-450d89f90520 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45a882dbafb4ea4976e4f45289eb2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d09a74bf684a9fb1dd1e95d6c23f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62053) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:32:36 user devstack@n-api.service[62053]: DEBUG nova.policy [None req-0acb4206-7298-416b-9ee6-450d89f90520 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e45a882dbafb4ea4976e4f45289eb2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d09a74bf684a9fb1dd1e95d6c23f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62053) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:32:36 user devstack@n-api.service[62053]: DEBUG nova.policy [None req-0acb4206-7298-416b-9ee6-450d89f90520 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e45a882dbafb4ea4976e4f45289eb2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d09a74bf684a9fb1dd1e95d6c23f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62053) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:32:36 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-0acb4206-7298-416b-9ee6-450d89f90520 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2956ab05-28ff-4c9e-b646-dbb83b3db278" status: 200 len: 1768 microversion: 2.87 time: 0.295859 Apr 13 16:32:36 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 206/615] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 16:32:36 2023] GET /compute/v2.1/servers/2956ab05-28ff-4c9e-b646-dbb83b3db278 => generated 1768 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 16:32:36 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-0c723d89-c9c4-47ed-8ab6-829de7a08fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:32:36 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-0c723d89-c9c4-47ed-8ab6-829de7a08fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 03200054-c651-4333-acce-3bea3defe22a] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:32:36 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-0c723d89-c9c4-47ed-8ab6-829de7a08fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:32:36 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-0c723d89-c9c4-47ed-8ab6-829de7a08fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:32:36 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-0c723d89-c9c4-47ed-8ab6-829de7a08fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:32:36 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-0c723d89-c9c4-47ed-8ab6-829de7a08fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:32:36 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-0c723d89-c9c4-47ed-8ab6-829de7a08fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:32:36 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-0c723d89-c9c4-47ed-8ab6-829de7a08fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:32:37 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-0c723d89-c9c4-47ed-8ab6-829de7a08fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 03200054-c651-4333-acce-3bea3defe22a] Going to try to terminate instance {{(pid=62054) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 16:32:37 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-0c723d89-c9c4-47ed-8ab6-829de7a08fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/03200054-c651-4333-acce-3bea3defe22a" status: 204 len: 0 microversion: 2.1 time: 0.149666 Apr 13 16:32:37 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 206/616] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 16:32:36 2023] DELETE /compute/v2.1/servers/03200054-c651-4333-acce-3bea3defe22a => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 16:32:37 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-d21f110e-ee3c-424b-a007-f32abfc5a140 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:32:37 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-d21f110e-ee3c-424b-a007-f32abfc5a140 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 03200054-c651-4333-acce-3bea3defe22a] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:32:37 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-d21f110e-ee3c-424b-a007-f32abfc5a140 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:32:37 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-d21f110e-ee3c-424b-a007-f32abfc5a140 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:32:37 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-d21f110e-ee3c-424b-a007-f32abfc5a140 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:32:37 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-d21f110e-ee3c-424b-a007-f32abfc5a140 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:32:37 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-d21f110e-ee3c-424b-a007-f32abfc5a140 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:32:37 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-d21f110e-ee3c-424b-a007-f32abfc5a140 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:32:37 user devstack@n-api.service[62055]: DEBUG nova.policy [None req-d21f110e-ee3c-424b-a007-f32abfc5a140 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e10f63cdd49a9a1ebe1fe4c9de0a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d451e0e239f486aa2b3abe9e273eab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62055) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:32:37 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-d21f110e-ee3c-424b-a007-f32abfc5a140 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] 10.0.0.210 "GET /compute/v2.1/servers/03200054-c651-4333-acce-3bea3defe22a" status: 200 len: 1568 microversion: 2.1 time: 0.194844 Apr 13 16:32:37 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 205/617] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:32:37 2023] GET /compute/v2.1/servers/03200054-c651-4333-acce-3bea3defe22a => generated 1568 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:32:37 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-777800c3-37c6-4584-a922-8bae30939ea1 req-69e8cec9-da93-4eca-b9e5-1ecf69efa56d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03200054-c651-4333-acce-3bea3defe22a", "name": "network-vif-unplugged", "status": "completed", "tag": "b40a4a40-0a9a-42f8-8d44-41bf4042454b"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:32:37 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-777800c3-37c6-4584-a922-8bae30939ea1 req-69e8cec9-da93-4eca-b9e5-1ecf69efa56d service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:32:37 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-777800c3-37c6-4584-a922-8bae30939ea1 req-69e8cec9-da93-4eca-b9e5-1ecf69efa56d service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:32:37 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-777800c3-37c6-4584-a922-8bae30939ea1 req-69e8cec9-da93-4eca-b9e5-1ecf69efa56d service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:32:37 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-777800c3-37c6-4584-a922-8bae30939ea1 req-69e8cec9-da93-4eca-b9e5-1ecf69efa56d service nova] Creating event network-vif-unplugged:b40a4a40-0a9a-42f8-8d44-41bf4042454b for instance 03200054-c651-4333-acce-3bea3defe22a on user Apr 13 16:32:37 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [req-777800c3-37c6-4584-a922-8bae30939ea1 req-69e8cec9-da93-4eca-b9e5-1ecf69efa56d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033825 Apr 13 16:32:37 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 207/618] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:32:37 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:32:38 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_cell0:SELECT=3 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:32:38 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-2624907c-ef20-4fa8-8a42-5f8e06551136 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:32:38 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-2624907c-ef20-4fa8-8a42-5f8e06551136 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:32:38 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-2624907c-ef20-4fa8-8a42-5f8e06551136 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:32:38 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-2624907c-ef20-4fa8-8a42-5f8e06551136 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:32:38 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-2624907c-ef20-4fa8-8a42-5f8e06551136 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:32:38 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-2624907c-ef20-4fa8-8a42-5f8e06551136 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:32:38 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-2624907c-ef20-4fa8-8a42-5f8e06551136 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:32:38 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-2624907c-ef20-4fa8-8a42-5f8e06551136 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:32:39 user devstack@n-api.service[62054]: DEBUG nova.policy [None req-2624907c-ef20-4fa8-8a42-5f8e06551136 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fab402fb794a5a9281cfb7fe188813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24904988cf334657b084fd726c7ecf8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62054) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:32:39 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-2624907c-ef20-4fa8-8a42-5f8e06551136 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eaae47b9-a059-49f6-9ae6-d7147003e2f2" status: 200 len: 1656 microversion: 2.1 time: 0.208847 Apr 13 16:32:39 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 207/619] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:32:38 2023] GET /compute/v2.1/servers/eaae47b9-a059-49f6-9ae6-d7147003e2f2 => generated 1656 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:32:39 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [req-fcc96bba-eb36-4f25-a86b-e048d0e9912f req-b34dd6e9-f673-46b2-9023-f635f1d08c31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03200054-c651-4333-acce-3bea3defe22a", "name": "network-vif-deleted", "tag": "b40a4a40-0a9a-42f8-8d44-41bf4042454b"}]} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:32:39 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-fcc96bba-eb36-4f25-a86b-e048d0e9912f req-b34dd6e9-f673-46b2-9023-f635f1d08c31 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:32:39 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-fcc96bba-eb36-4f25-a86b-e048d0e9912f req-b34dd6e9-f673-46b2-9023-f635f1d08c31 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:32:39 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-fcc96bba-eb36-4f25-a86b-e048d0e9912f req-b34dd6e9-f673-46b2-9023-f635f1d08c31 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:32:39 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-fcc96bba-eb36-4f25-a86b-e048d0e9912f req-b34dd6e9-f673-46b2-9023-f635f1d08c31 service nova] Creating event network-vif-deleted:b40a4a40-0a9a-42f8-8d44-41bf4042454b for instance 03200054-c651-4333-acce-3bea3defe22a on user Apr 13 16:32:39 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [req-fcc96bba-eb36-4f25-a86b-e048d0e9912f req-b34dd6e9-f673-46b2-9023-f635f1d08c31 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028944 Apr 13 16:32:39 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 206/620] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:32:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 16:32:39 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-93e06399-162e-44df-92b5-a8b67eac9d10 req-380e22e2-502f-4441-a42e-239cbb167031 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03200054-c651-4333-acce-3bea3defe22a", "name": "network-vif-plugged", "status": "completed", "tag": "b40a4a40-0a9a-42f8-8d44-41bf4042454b"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:32:39 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-93e06399-162e-44df-92b5-a8b67eac9d10 req-380e22e2-502f-4441-a42e-239cbb167031 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:32:39 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-93e06399-162e-44df-92b5-a8b67eac9d10 req-380e22e2-502f-4441-a42e-239cbb167031 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:32:39 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-93e06399-162e-44df-92b5-a8b67eac9d10 req-380e22e2-502f-4441-a42e-239cbb167031 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:32:39 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-93e06399-162e-44df-92b5-a8b67eac9d10 req-380e22e2-502f-4441-a42e-239cbb167031 service nova] Creating event network-vif-plugged:b40a4a40-0a9a-42f8-8d44-41bf4042454b for instance 03200054-c651-4333-acce-3bea3defe22a on user Apr 13 16:32:39 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [req-93e06399-162e-44df-92b5-a8b67eac9d10 req-380e22e2-502f-4441-a42e-239cbb167031 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043894 Apr 13 16:32:39 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 208/621] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:32:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:32:39 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-1030d14e-2460-42ae-82ae-64672f95c54d tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:32:39 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-1030d14e-2460-42ae-82ae-64672f95c54d tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] [instance: 64a9c052-89a9-48ba-80c9-13fb5ef22f0e] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:32:39 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-1030d14e-2460-42ae-82ae-64672f95c54d tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:32:39 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-1030d14e-2460-42ae-82ae-64672f95c54d tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:32:39 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-1030d14e-2460-42ae-82ae-64672f95c54d tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:32:39 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-1030d14e-2460-42ae-82ae-64672f95c54d tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:32:39 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-1030d14e-2460-42ae-82ae-64672f95c54d tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:32:39 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-1030d14e-2460-42ae-82ae-64672f95c54d tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:32:40 user devstack@n-api.service[62054]: DEBUG nova.policy [None req-1030d14e-2460-42ae-82ae-64672f95c54d tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f523740272844b6eb236477d0b116ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7100b359f341759cb6f6753e1539a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62054) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:32:40 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-1030d14e-2460-42ae-82ae-64672f95c54d tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] 10.0.0.210 "GET /compute/v2.1/servers/64a9c052-89a9-48ba-80c9-13fb5ef22f0e" status: 200 len: 1537 microversion: 2.1 time: 0.171485 Apr 13 16:32:40 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 208/622] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:32:39 2023] GET /compute/v2.1/servers/64a9c052-89a9-48ba-80c9-13fb5ef22f0e => generated 1537 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:32:42 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-74626626-d59d-432e-b32a-a449dcbf0ec0 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:32:42 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-74626626-d59d-432e-b32a-a449dcbf0ec0 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:32:42 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-74626626-d59d-432e-b32a-a449dcbf0ec0 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:32:42 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-74626626-d59d-432e-b32a-a449dcbf0ec0 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:32:42 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-74626626-d59d-432e-b32a-a449dcbf0ec0 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:32:42 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-74626626-d59d-432e-b32a-a449dcbf0ec0 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:32:42 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-74626626-d59d-432e-b32a-a449dcbf0ec0 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:32:42 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-74626626-d59d-432e-b32a-a449dcbf0ec0 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:32:42 user devstack@n-api.service[62055]: DEBUG nova.objects.instance [None req-74626626-d59d-432e-b32a-a449dcbf0ec0 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lazy-loading 'services' on Instance uuid bf98c3a2-dbeb-4ae4-8423-ce55964c4258 {{(pid=62055) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 16:32:42 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-74626626-d59d-432e-b32a-a449dcbf0ec0 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/bf98c3a2-dbeb-4ae4-8423-ce55964c4258/os-volume_attachments/30806b19-961b-4edd-941a-2ee293795bb1" status: 202 len: 0 microversion: 2.1 time: 0.167709 Apr 13 16:32:42 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 207/623] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 16:32:42 2023] DELETE /compute/v2.1/servers/bf98c3a2-dbeb-4ae4-8423-ce55964c4258/os-volume_attachments/30806b19-961b-4edd-941a-2ee293795bb1 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 16:32:42 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-f64f55ba-d500-4e90-90c4-d33ca9907829 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:32:42 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-f64f55ba-d500-4e90-90c4-d33ca9907829 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:32:42 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-f64f55ba-d500-4e90-90c4-d33ca9907829 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:32:42 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-f64f55ba-d500-4e90-90c4-d33ca9907829 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:32:42 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-f64f55ba-d500-4e90-90c4-d33ca9907829 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:32:42 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-f64f55ba-d500-4e90-90c4-d33ca9907829 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:32:42 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-f64f55ba-d500-4e90-90c4-d33ca9907829 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:32:42 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-f64f55ba-d500-4e90-90c4-d33ca9907829 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:32:43 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-f64f55ba-d500-4e90-90c4-d33ca9907829 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bf98c3a2-dbeb-4ae4-8423-ce55964c4258/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050871 Apr 13 16:32:43 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 209/624] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 16:32:42 2023] GET /compute/v2.1/servers/bf98c3a2-dbeb-4ae4-8423-ce55964c4258/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:32:44 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-2b8f9e47-b224-452b-adc0-641b351a7afe req-fa89aafa-acd6-46c7-81ff-c937be8a4e21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acbcaee0-a47b-4fee-8765-9b1c9597d515", "name": "network-vif-plugged", "status": "completed", "tag": "13471516-9514-4b85-938f-69657c2990e5"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:32:44 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-2b8f9e47-b224-452b-adc0-641b351a7afe req-fa89aafa-acd6-46c7-81ff-c937be8a4e21 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:32:44 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-2b8f9e47-b224-452b-adc0-641b351a7afe req-fa89aafa-acd6-46c7-81ff-c937be8a4e21 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:32:44 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-2b8f9e47-b224-452b-adc0-641b351a7afe req-fa89aafa-acd6-46c7-81ff-c937be8a4e21 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:32:44 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-2b8f9e47-b224-452b-adc0-641b351a7afe req-fa89aafa-acd6-46c7-81ff-c937be8a4e21 service nova] Creating event network-vif-plugged:13471516-9514-4b85-938f-69657c2990e5 for instance acbcaee0-a47b-4fee-8765-9b1c9597d515 on user Apr 13 16:32:44 user devstack@n-api.service[62054]: DEBUG nova.compute.api [req-2b8f9e47-b224-452b-adc0-641b351a7afe req-fa89aafa-acd6-46c7-81ff-c937be8a4e21 service nova] Instance acbcaee0-a47b-4fee-8765-9b1c9597d515 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=62054) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 13 16:32:44 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [req-2b8f9e47-b224-452b-adc0-641b351a7afe req-fa89aafa-acd6-46c7-81ff-c937be8a4e21 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077927 Apr 13 16:32:44 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 209/625] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:32:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:32:44 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-d6c1ff16-172e-4acd-bdf0-078572cace40 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:32:44 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-d6c1ff16-172e-4acd-bdf0-078572cace40 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:32:44 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-d6c1ff16-172e-4acd-bdf0-078572cace40 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:32:44 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-d6c1ff16-172e-4acd-bdf0-078572cace40 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:32:44 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-d6c1ff16-172e-4acd-bdf0-078572cace40 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:32:44 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-d6c1ff16-172e-4acd-bdf0-078572cace40 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:32:44 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-d6c1ff16-172e-4acd-bdf0-078572cace40 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:32:44 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-d6c1ff16-172e-4acd-bdf0-078572cace40 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:32:44 user devstack@n-api.service[62055]: DEBUG nova.policy [None req-d6c1ff16-172e-4acd-bdf0-078572cace40 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b4e972cd1049509fa899449961ab59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0653ab16660b46cea9c5af58ea0b1931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62055) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:32:44 user devstack@n-api.service[62055]: DEBUG nova.policy [None req-d6c1ff16-172e-4acd-bdf0-078572cace40 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48b4e972cd1049509fa899449961ab59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0653ab16660b46cea9c5af58ea0b1931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62055) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:32:44 user devstack@n-api.service[62055]: DEBUG nova.policy [None req-d6c1ff16-172e-4acd-bdf0-078572cace40 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48b4e972cd1049509fa899449961ab59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0653ab16660b46cea9c5af58ea0b1931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62055) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:32:44 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-d6c1ff16-172e-4acd-bdf0-078572cace40 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] 10.0.0.210 "GET /compute/v2.1/servers/35b23303-e373-4f35-b7ee-76e6815073ce" status: 200 len: 1588 microversion: 2.20 time: 0.174496 Apr 13 16:32:44 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 208/626] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 16:32:44 2023] GET /compute/v2.1/servers/35b23303-e373-4f35-b7ee-76e6815073ce => generated 1588 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 16:32:46 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-47d19ea1-4195-4ce9-905d-bcfa0000ff8d req-dd618d33-75d8-400f-8def-7b6115918385 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acbcaee0-a47b-4fee-8765-9b1c9597d515", "name": "network-vif-plugged", "status": "completed", "tag": "13471516-9514-4b85-938f-69657c2990e5"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:32:46 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-47d19ea1-4195-4ce9-905d-bcfa0000ff8d req-dd618d33-75d8-400f-8def-7b6115918385 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:32:46 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-47d19ea1-4195-4ce9-905d-bcfa0000ff8d req-dd618d33-75d8-400f-8def-7b6115918385 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:32:46 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-47d19ea1-4195-4ce9-905d-bcfa0000ff8d req-dd618d33-75d8-400f-8def-7b6115918385 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:32:46 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-47d19ea1-4195-4ce9-905d-bcfa0000ff8d req-dd618d33-75d8-400f-8def-7b6115918385 service nova] Creating event network-vif-plugged:13471516-9514-4b85-938f-69657c2990e5 for instance acbcaee0-a47b-4fee-8765-9b1c9597d515 on user Apr 13 16:32:46 user devstack@n-api.service[62053]: DEBUG nova.compute.api [req-47d19ea1-4195-4ce9-905d-bcfa0000ff8d req-dd618d33-75d8-400f-8def-7b6115918385 service nova] Instance acbcaee0-a47b-4fee-8765-9b1c9597d515 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=62053) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 13 16:32:46 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [req-47d19ea1-4195-4ce9-905d-bcfa0000ff8d req-dd618d33-75d8-400f-8def-7b6115918385 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042946 Apr 13 16:32:46 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 210/627] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:32:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:33:17 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:33:17 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:33:17 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-aa4175b8-c5da-48f7-9ed9-60604843b9a6 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:33:17 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-aa4175b8-c5da-48f7-9ed9-60604843b9a6 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:33:17 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-aa4175b8-c5da-48f7-9ed9-60604843b9a6 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:33:17 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-aa4175b8-c5da-48f7-9ed9-60604843b9a6 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:33:17 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-aa4175b8-c5da-48f7-9ed9-60604843b9a6 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:33:17 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-aa4175b8-c5da-48f7-9ed9-60604843b9a6 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:33:17 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-aa4175b8-c5da-48f7-9ed9-60604843b9a6 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:33:17 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-aa4175b8-c5da-48f7-9ed9-60604843b9a6 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:33:17 user devstack@n-api.service[62054]: DEBUG nova.policy [None req-aa4175b8-c5da-48f7-9ed9-60604843b9a6 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b3df1c5c5d441819bcef89ed6966815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980559734a504574a83224deb7423c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62054) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:33:17 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-aa4175b8-c5da-48f7-9ed9-60604843b9a6 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] 10.0.0.210 "GET /compute/v2.1/servers/acbcaee0-a47b-4fee-8765-9b1c9597d515" status: 200 len: 1731 microversion: 2.1 time: 0.156666 Apr 13 16:33:17 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 210/628] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:33:17 2023] GET /compute/v2.1/servers/acbcaee0-a47b-4fee-8765-9b1c9597d515 => generated 1731 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:33:27 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-af6bf297-36a9-4752-83b5-eef245d967c4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:33:27 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-af6bf297-36a9-4752-83b5-eef245d967c4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 03200054-c651-4333-acce-3bea3defe22a] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:33:27 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_api:SELECT=16 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:33:27 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_cell1:SELECT=41,nova_cell1:INSERT=1 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:33:27 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-af6bf297-36a9-4752-83b5-eef245d967c4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:33:27 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-af6bf297-36a9-4752-83b5-eef245d967c4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:33:27 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-af6bf297-36a9-4752-83b5-eef245d967c4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:33:27 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-af6bf297-36a9-4752-83b5-eef245d967c4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:33:27 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-af6bf297-36a9-4752-83b5-eef245d967c4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:33:27 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-af6bf297-36a9-4752-83b5-eef245d967c4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:33:27 user devstack@n-api.service[62055]: INFO nova.api.openstack.wsgi [None req-af6bf297-36a9-4752-83b5-eef245d967c4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] HTTP exception thrown: Instance 03200054-c651-4333-acce-3bea3defe22a could not be found. Apr 13 16:33:27 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-af6bf297-36a9-4752-83b5-eef245d967c4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Request method failure captured: Apr 13 16:33:27 user devstack@n-api.service[62055]: request: GET /compute/v2.1/servers/03200054-c651-4333-acce-3bea3defe22a HTTP/1.1 Apr 13 16:33:27 user devstack@n-api.service[62055]: Accept: application/json Apr 13 16:33:27 user devstack@n-api.service[62055]: Accept-Encoding: identity Apr 13 16:33:27 user devstack@n-api.service[62055]: Connection: close Apr 13 16:33:27 user devstack@n-api.service[62055]: Content-Length: 0 Apr 13 16:33:27 user devstack@n-api.service[62055]: Content-Type: application/json Apr 13 16:33:27 user devstack@n-api.service[62055]: Host: 10.0.0.210 Apr 13 16:33:27 user devstack@n-api.service[62055]: Openstack-System-Scope: None Apr 13 16:33:27 user devstack@n-api.service[62055]: User-Agent: python-urllib3/1.26.15 Apr 13 16:33:27 user devstack@n-api.service[62055]: X-Auth-Token: gAAAAABkOCwkI2hCVv3q2RMbn5sWNaNksO2jlEae5ib0A_n2-4Ip_Pl-WyakKOiBGyr1g-8idBZHWfWrP88wr7DW2Z-7RXK4r2oTVrS71NZCSisAoUDBhj4KwKB40I0svywhzMPIjrB1h0EwajlcYKhM2GYo5FTaZ-MnJbSWEwEZAY8gyi1eSaE Apr 13 16:33:27 user devstack@n-api.service[62055]: X-Domain-Id: None Apr 13 16:33:27 user devstack@n-api.service[62055]: X-Domain-Name: None Apr 13 16:33:27 user devstack@n-api.service[62055]: X-Identity-Status: Confirmed Apr 13 16:33:27 user devstack@n-api.service[62055]: X-Is-Admin-Project: True Apr 13 16:33:27 user devstack@n-api.service[62055]: X-Project-Domain-Id: default Apr 13 16:33:27 user devstack@n-api.service[62055]: X-Project-Domain-Name: Default Apr 13 16:33:27 user devstack@n-api.service[62055]: X-Project-Id: 8d451e0e239f486aa2b3abe9e273eab3 Apr 13 16:33:27 user devstack@n-api.service[62055]: X-Project-Name: tempest-TestVolumeBootPattern-438786227 Apr 13 16:33:27 user devstack@n-api.service[62055]: X-Role: reader,member Apr 13 16:33:27 user devstack@n-api.service[62055]: X-Roles: reader,member Apr 13 16:33:27 user devstack@n-api.service[62055]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8d451e0e239f486aa2b3abe9e273eab3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8d451e0e239f486aa2b3abe9e273eab3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8d451e0e239f486aa2b3abe9e273eab3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 13 16:33:27 user devstack@n-api.service[62055]: X-Tenant: tempest-TestVolumeBootPattern-438786227 Apr 13 16:33:27 user devstack@n-api.service[62055]: X-Tenant-Id: 8d451e0e239f486aa2b3abe9e273eab3 Apr 13 16:33:27 user devstack@n-api.service[62055]: X-Tenant-Name: tempest-TestVolumeBootPattern-438786227 Apr 13 16:33:27 user devstack@n-api.service[62055]: X-User: tempest-TestVolumeBootPattern-438786227-project-member Apr 13 16:33:27 user devstack@n-api.service[62055]: X-User-Domain-Id: default Apr 13 16:33:27 user devstack@n-api.service[62055]: X-User-Domain-Name: Default Apr 13 16:33:27 user devstack@n-api.service[62055]: X-User-Id: d70e10f63cdd49a9a1ebe1fe4c9de0a2 Apr 13 16:33:27 user devstack@n-api.service[62055]: X-User-Name: tempest-TestVolumeBootPattern-438786227-project-member Apr 13 16:33:27 user devstack@n-api.service[62055]: method: > Apr 13 16:33:27 user devstack@n-api.service[62055]: exception: Instance 03200054-c651-4333-acce-3bea3defe22a could not be found. Apr 13 16:33:27 user devstack@n-api.service[62055]: action_args: {'id': '03200054-c651-4333-acce-3bea3defe22a'} Apr 13 16:33:27 user devstack@n-api.service[62055]: {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 16:33:27 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:33:27 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 16:33:27 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 16:33:27 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 16:33:27 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 16:33:27 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 16:33:27 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 16:33:27 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 16:33:27 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 16:33:27 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03200054-c651-4333-acce-3bea3defe22a could not be found. Apr 13 16:33:27 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:33:27 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:33:27 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:33:27 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:33:27 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 16:33:27 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 16:33:27 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 16:33:27 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 16:33:27 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 16:33:27 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 16:33:27 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 16:33:27 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 16:33:27 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 16:33:27 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 16:33:27 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 16:33:27 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 16:33:27 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03200054-c651-4333-acce-3bea3defe22a could not be found. Apr 13 16:33:27 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:33:27 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:33:27 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:33:27 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:33:27 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 16:33:27 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 16:33:27 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 16:33:27 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 16:33:27 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03200054-c651-4333-acce-3bea3defe22a could not be found. Apr 13 16:33:27 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:33:27 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-af6bf297-36a9-4752-83b5-eef245d967c4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Returning 404 to user: Instance 03200054-c651-4333-acce-3bea3defe22a could not be found. {{(pid=62055) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 16:33:27 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-af6bf297-36a9-4752-83b5-eef245d967c4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] 10.0.0.210 "GET /compute/v2.1/servers/03200054-c651-4333-acce-3bea3defe22a" status: 404 len: 111 microversion: 2.1 time: 0.034475 Apr 13 16:33:27 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 209/629] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:33:27 2023] GET /compute/v2.1/servers/03200054-c651-4333-acce-3bea3defe22a => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 16:33:27 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-c59af704-0b42-4249-a4ee-aacbbd4b64ce tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-811215132", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestVolumeBootPattern-1747083001", "security_groups": [{"name": "tempest-secgroup-smoke-1493908618"}], "block_device_mapping_v2": [{"uuid": "c2088266-1d33-4bb1-ac5b-1de832ff7985", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d36bc206-f629-4d6e-8a3f-458061d7b525"}]}} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:33:27 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_api:SELECT=16 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:33:27 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_cell1:SELECT=30 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:33:27 user devstack@n-api.service[62053]: DEBUG nova.network.neutron [None req-c59af704-0b42-4249-a4ee-aacbbd4b64ce tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] validate_networks() for [('d36bc206-f629-4d6e-8a3f-458061d7b525', None, None, None, None, None)] {{(pid=62053) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 16:33:28 user devstack@n-api.service[62053]: DEBUG nova.virt.hardware [None req-c59af704-0b42-4249-a4ee-aacbbd4b64ce tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Flavor limits 0:0:0 {{(pid=62053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 16:33:28 user devstack@n-api.service[62053]: DEBUG nova.virt.hardware [None req-c59af704-0b42-4249-a4ee-aacbbd4b64ce tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Image limits 0:0:0 {{(pid=62053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 16:33:28 user devstack@n-api.service[62053]: DEBUG nova.virt.hardware [None req-c59af704-0b42-4249-a4ee-aacbbd4b64ce tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Flavor pref 0:0:0 {{(pid=62053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 16:33:28 user devstack@n-api.service[62053]: DEBUG nova.virt.hardware [None req-c59af704-0b42-4249-a4ee-aacbbd4b64ce tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Image pref 0:0:0 {{(pid=62053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 16:33:28 user devstack@n-api.service[62053]: DEBUG nova.virt.hardware [None req-c59af704-0b42-4249-a4ee-aacbbd4b64ce tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 16:33:28 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-c59af704-0b42-4249-a4ee-aacbbd4b64ce tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:33:28 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-c59af704-0b42-4249-a4ee-aacbbd4b64ce tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:33:28 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-c59af704-0b42-4249-a4ee-aacbbd4b64ce tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:33:28 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-c59af704-0b42-4249-a4ee-aacbbd4b64ce tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:33:28 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-c59af704-0b42-4249-a4ee-aacbbd4b64ce tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:33:28 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-c59af704-0b42-4249-a4ee-aacbbd4b64ce tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:33:28 user devstack@n-api.service[62053]: DEBUG nova.quota [None req-c59af704-0b42-4249-a4ee-aacbbd4b64ce tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Getting quotas for project 8d451e0e239f486aa2b3abe9e273eab3. Resources: {'instances', 'cores', 'ram'} {{(pid=62053) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 16:33:28 user devstack@n-api.service[62053]: DEBUG nova.quota [None req-c59af704-0b42-4249-a4ee-aacbbd4b64ce tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Getting quotas for user d70e10f63cdd49a9a1ebe1fe4c9de0a2 and project 8d451e0e239f486aa2b3abe9e273eab3. Resources: {'instances', 'cores', 'ram'} {{(pid=62053) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 16:33:28 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-c59af704-0b42-4249-a4ee-aacbbd4b64ce tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Going to run 1 instances... {{(pid=62053) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 16:33:28 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-c59af704-0b42-4249-a4ee-aacbbd4b64ce tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 220e1c3e-1378-46fc-acc1-ee1bafac7722] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c2088266-1d33-4bb1-ac5b-1de832ff7985',volume_size=None,volume_type=None)] {{(pid=62053) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 16:33:28 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-c59af704-0b42-4249-a4ee-aacbbd4b64ce tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.802240 Apr 13 16:33:28 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 211/630] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 16:33:27 2023] POST /compute/v2.1/servers => generated 404 bytes in 804 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 16:33:28 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-b1009d38-5259-4a5b-879b-f2f907679305 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:33:28 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-b1009d38-5259-4a5b-879b-f2f907679305 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 220e1c3e-1378-46fc-acc1-ee1bafac7722] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:33:28 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_api:SELECT=2 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:33:28 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_cell1:SELECT=6 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:33:28 user devstack@n-api.service[62054]: DEBUG nova.policy [None req-b1009d38-5259-4a5b-879b-f2f907679305 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e10f63cdd49a9a1ebe1fe4c9de0a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d451e0e239f486aa2b3abe9e273eab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62054) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:33:28 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-b1009d38-5259-4a5b-879b-f2f907679305 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] 10.0.0.210 "GET /compute/v2.1/servers/220e1c3e-1378-46fc-acc1-ee1bafac7722" status: 200 len: 1089 microversion: 2.1 time: 0.074144 Apr 13 16:33:28 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 211/631] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:33:28 2023] GET /compute/v2.1/servers/220e1c3e-1378-46fc-acc1-ee1bafac7722 => generated 1089 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:33:30 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [req-5269aa61-bd51-4e85-a281-ff5243f6d7af req-5cca74f5-dd25-4224-b3d1-fa2f6129c6ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "220e1c3e-1378-46fc-acc1-ee1bafac7722", "tag": "96415b19-4e1b-41c6-a070-cff24e7b20ab"}]} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:33:30 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-5269aa61-bd51-4e85-a281-ff5243f6d7af req-5cca74f5-dd25-4224-b3d1-fa2f6129c6ba service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:33:30 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-5269aa61-bd51-4e85-a281-ff5243f6d7af req-5cca74f5-dd25-4224-b3d1-fa2f6129c6ba service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:33:30 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-5269aa61-bd51-4e85-a281-ff5243f6d7af req-5cca74f5-dd25-4224-b3d1-fa2f6129c6ba service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:33:30 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-5269aa61-bd51-4e85-a281-ff5243f6d7af req-5cca74f5-dd25-4224-b3d1-fa2f6129c6ba service nova] Creating event network-changed:96415b19-4e1b-41c6-a070-cff24e7b20ab for instance 220e1c3e-1378-46fc-acc1-ee1bafac7722 on user Apr 13 16:33:30 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [req-5269aa61-bd51-4e85-a281-ff5243f6d7af req-5cca74f5-dd25-4224-b3d1-fa2f6129c6ba service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053745 Apr 13 16:33:30 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 210/632] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:33:30 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:33:33 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-02ab8df4-1967-42aa-bfa5-ff9ffc24bd64 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:33:33 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-02ab8df4-1967-42aa-bfa5-ff9ffc24bd64 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:33:33 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-02ab8df4-1967-42aa-bfa5-ff9ffc24bd64 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:33:33 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-02ab8df4-1967-42aa-bfa5-ff9ffc24bd64 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:33:33 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-02ab8df4-1967-42aa-bfa5-ff9ffc24bd64 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:33:33 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-02ab8df4-1967-42aa-bfa5-ff9ffc24bd64 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:33:33 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-02ab8df4-1967-42aa-bfa5-ff9ffc24bd64 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:33:33 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-02ab8df4-1967-42aa-bfa5-ff9ffc24bd64 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:33:33 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-02ab8df4-1967-42aa-bfa5-ff9ffc24bd64 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bf98c3a2-dbeb-4ae4-8423-ce55964c4258/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.212557 Apr 13 16:33:33 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 212/633] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 16:33:33 2023] GET /compute/v2.1/servers/bf98c3a2-dbeb-4ae4-8423-ce55964c4258/os-volume_attachments => generated 25 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 16:33:36 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-bfd24b75-e454-49de-89a1-812ee7937e6e tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "83d71596-07bc-438e-a163-92acd11239d8"}} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:33:36 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-bfd24b75-e454-49de-89a1-812ee7937e6e tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:33:36 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-bfd24b75-e454-49de-89a1-812ee7937e6e tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:33:36 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-bfd24b75-e454-49de-89a1-812ee7937e6e tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:33:36 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-bfd24b75-e454-49de-89a1-812ee7937e6e tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:33:36 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-bfd24b75-e454-49de-89a1-812ee7937e6e tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:33:36 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-bfd24b75-e454-49de-89a1-812ee7937e6e tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:33:36 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-bfd24b75-e454-49de-89a1-812ee7937e6e tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:33:36 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-bfd24b75-e454-49de-89a1-812ee7937e6e tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] 10.0.0.210 "POST /compute/v2.1/servers/bf98c3a2-dbeb-4ae4-8423-ce55964c4258/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.291588 Apr 13 16:33:36 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 212/634] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 16:33:36 2023] POST /compute/v2.1/servers/bf98c3a2-dbeb-4ae4-8423-ce55964c4258/os-volume_attachments => generated 194 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:33:37 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-783f65e2-4244-4675-8e98-3254f212235f tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Action: 'action', calling method: >, body: {"rescue": {"rescue_image_ref": "ce43bf2e-c302-4d95-b406-8685800afdec"}} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:33:37 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-783f65e2-4244-4675-8e98-3254f212235f tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:33:37 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-783f65e2-4244-4675-8e98-3254f212235f tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:33:37 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-783f65e2-4244-4675-8e98-3254f212235f tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:33:37 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-783f65e2-4244-4675-8e98-3254f212235f tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:33:37 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-783f65e2-4244-4675-8e98-3254f212235f tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:33:37 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-783f65e2-4244-4675-8e98-3254f212235f tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:33:37 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-783f65e2-4244-4675-8e98-3254f212235f tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:33:37 user devstack@n-api.service[62055]: DEBUG nova.objects.instance [None req-783f65e2-4244-4675-8e98-3254f212235f tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lazy-loading 'flavor' on Instance uuid 2956ab05-28ff-4c9e-b646-dbb83b3db278 {{(pid=62055) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 16:33:37 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-e45a2263-2980-49d1-8bcc-6745818f592b req-b2d9ab13-6bf2-429d-95b5-d6d606e1f01f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "220e1c3e-1378-46fc-acc1-ee1bafac7722", "name": "network-vif-plugged", "status": "completed", "tag": "96415b19-4e1b-41c6-a070-cff24e7b20ab"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:33:37 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-e45a2263-2980-49d1-8bcc-6745818f592b req-b2d9ab13-6bf2-429d-95b5-d6d606e1f01f service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:33:37 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-e45a2263-2980-49d1-8bcc-6745818f592b req-b2d9ab13-6bf2-429d-95b5-d6d606e1f01f service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:33:37 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-e45a2263-2980-49d1-8bcc-6745818f592b req-b2d9ab13-6bf2-429d-95b5-d6d606e1f01f service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:33:37 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-e45a2263-2980-49d1-8bcc-6745818f592b req-b2d9ab13-6bf2-429d-95b5-d6d606e1f01f service nova] Creating event network-vif-plugged:96415b19-4e1b-41c6-a070-cff24e7b20ab for instance 220e1c3e-1378-46fc-acc1-ee1bafac7722 on user Apr 13 16:33:37 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [req-e45a2263-2980-49d1-8bcc-6745818f592b req-b2d9ab13-6bf2-429d-95b5-d6d606e1f01f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042082 Apr 13 16:33:37 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 213/635] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:33:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:33:37 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-783f65e2-4244-4675-8e98-3254f212235f tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] 10.0.0.210 "POST /compute/v2.1/servers/2956ab05-28ff-4c9e-b646-dbb83b3db278/action" status: 200 len: 29 microversion: 2.87 time: 0.604631 Apr 13 16:33:37 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 211/636] 10.0.0.210 () {66 vars in 1396 bytes} [Thu Apr 13 16:33:37 2023] POST /compute/v2.1/servers/2956ab05-28ff-4c9e-b646-dbb83b3db278/action => generated 29 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 13 16:33:37 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-17ad1409-3a99-4d33-8670-19ace973040c tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:33:37 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-17ad1409-3a99-4d33-8670-19ace973040c tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:33:37 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-17ad1409-3a99-4d33-8670-19ace973040c tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:33:37 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-17ad1409-3a99-4d33-8670-19ace973040c tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:33:37 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-17ad1409-3a99-4d33-8670-19ace973040c tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:33:37 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-17ad1409-3a99-4d33-8670-19ace973040c tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:33:37 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-17ad1409-3a99-4d33-8670-19ace973040c tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:33:37 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-17ad1409-3a99-4d33-8670-19ace973040c tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:33:38 user devstack@n-api.service[62054]: DEBUG nova.policy [None req-17ad1409-3a99-4d33-8670-19ace973040c tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45a882dbafb4ea4976e4f45289eb2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d09a74bf684a9fb1dd1e95d6c23f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62054) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:33:38 user devstack@n-api.service[62054]: DEBUG nova.policy [None req-17ad1409-3a99-4d33-8670-19ace973040c tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e45a882dbafb4ea4976e4f45289eb2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d09a74bf684a9fb1dd1e95d6c23f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62054) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:33:38 user devstack@n-api.service[62054]: DEBUG nova.policy [None req-17ad1409-3a99-4d33-8670-19ace973040c tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e45a882dbafb4ea4976e4f45289eb2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d09a74bf684a9fb1dd1e95d6c23f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62054) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:33:38 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-17ad1409-3a99-4d33-8670-19ace973040c tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2956ab05-28ff-4c9e-b646-dbb83b3db278" status: 200 len: 1774 microversion: 2.87 time: 0.186692 Apr 13 16:33:38 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 213/637] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 16:33:37 2023] GET /compute/v2.1/servers/2956ab05-28ff-4c9e-b646-dbb83b3db278 => generated 1774 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 16:33:38 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_cell0:SELECT=2 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:33:38 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_cell0:SELECT=6 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:33:38 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-da2de663-5baa-4ad3-af21-cf67cb8b5666 req-3e9e6050-8f27-404d-aead-82232b75f4db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2956ab05-28ff-4c9e-b646-dbb83b3db278", "name": "network-vif-unplugged", "status": "completed", "tag": "84df62e9-af7c-4e62-83da-b43b511be2a0"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:33:38 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-da2de663-5baa-4ad3-af21-cf67cb8b5666 req-3e9e6050-8f27-404d-aead-82232b75f4db service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:33:38 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-da2de663-5baa-4ad3-af21-cf67cb8b5666 req-3e9e6050-8f27-404d-aead-82232b75f4db service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:33:38 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-da2de663-5baa-4ad3-af21-cf67cb8b5666 req-3e9e6050-8f27-404d-aead-82232b75f4db service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:33:38 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-da2de663-5baa-4ad3-af21-cf67cb8b5666 req-3e9e6050-8f27-404d-aead-82232b75f4db service nova] Creating event network-vif-unplugged:84df62e9-af7c-4e62-83da-b43b511be2a0 for instance 2956ab05-28ff-4c9e-b646-dbb83b3db278 on user Apr 13 16:33:38 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [req-da2de663-5baa-4ad3-af21-cf67cb8b5666 req-3e9e6050-8f27-404d-aead-82232b75f4db service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051375 Apr 13 16:33:38 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 214/638] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:33:38 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:33:39 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-e5de09b5-7b76-4de6-80ec-811275242620 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:33:39 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-e5de09b5-7b76-4de6-80ec-811275242620 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:33:39 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-e5de09b5-7b76-4de6-80ec-811275242620 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:33:39 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-e5de09b5-7b76-4de6-80ec-811275242620 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:33:39 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-e5de09b5-7b76-4de6-80ec-811275242620 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:33:39 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-e5de09b5-7b76-4de6-80ec-811275242620 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:33:39 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-e5de09b5-7b76-4de6-80ec-811275242620 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:33:39 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-e5de09b5-7b76-4de6-80ec-811275242620 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:33:39 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-e5de09b5-7b76-4de6-80ec-811275242620 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eaae47b9-a059-49f6-9ae6-d7147003e2f2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045722 Apr 13 16:33:39 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 212/639] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 16:33:39 2023] GET /compute/v2.1/servers/eaae47b9-a059-49f6-9ae6-d7147003e2f2/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 16:33:39 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-718d595e-b7dc-41e9-bd0f-369b92692f39 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:33:39 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-718d595e-b7dc-41e9-bd0f-369b92692f39 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:33:39 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_cell0:SELECT=2 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:33:39 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-718d595e-b7dc-41e9-bd0f-369b92692f39 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:33:39 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-718d595e-b7dc-41e9-bd0f-369b92692f39 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:33:39 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-718d595e-b7dc-41e9-bd0f-369b92692f39 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:33:39 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-718d595e-b7dc-41e9-bd0f-369b92692f39 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:33:39 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-718d595e-b7dc-41e9-bd0f-369b92692f39 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:33:39 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-718d595e-b7dc-41e9-bd0f-369b92692f39 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:33:39 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-718d595e-b7dc-41e9-bd0f-369b92692f39 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Going to try to terminate instance {{(pid=62054) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 16:33:39 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-9a9a585e-5037-4fbc-bfea-5abba6557a84 req-f995a7b3-e117-40c4-b471-6c3173d877f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "220e1c3e-1378-46fc-acc1-ee1bafac7722", "name": "network-vif-plugged", "status": "completed", "tag": "96415b19-4e1b-41c6-a070-cff24e7b20ab"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:33:39 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-718d595e-b7dc-41e9-bd0f-369b92692f39 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/eaae47b9-a059-49f6-9ae6-d7147003e2f2" status: 204 len: 0 microversion: 2.1 time: 0.129079 Apr 13 16:33:39 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 214/640] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 16:33:39 2023] DELETE /compute/v2.1/servers/eaae47b9-a059-49f6-9ae6-d7147003e2f2 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 16:33:39 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-f754ffd5-8508-4d37-b702-fe7d1098a874 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:33:39 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-f754ffd5-8508-4d37-b702-fe7d1098a874 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:33:39 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-f754ffd5-8508-4d37-b702-fe7d1098a874 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:33:39 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-9a9a585e-5037-4fbc-bfea-5abba6557a84 req-f995a7b3-e117-40c4-b471-6c3173d877f6 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:33:39 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-f754ffd5-8508-4d37-b702-fe7d1098a874 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:33:39 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-f754ffd5-8508-4d37-b702-fe7d1098a874 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:33:39 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-9a9a585e-5037-4fbc-bfea-5abba6557a84 req-f995a7b3-e117-40c4-b471-6c3173d877f6 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:33:39 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-9a9a585e-5037-4fbc-bfea-5abba6557a84 req-f995a7b3-e117-40c4-b471-6c3173d877f6 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:33:39 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-f754ffd5-8508-4d37-b702-fe7d1098a874 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:33:39 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-f754ffd5-8508-4d37-b702-fe7d1098a874 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:33:39 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-f754ffd5-8508-4d37-b702-fe7d1098a874 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:33:39 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-9a9a585e-5037-4fbc-bfea-5abba6557a84 req-f995a7b3-e117-40c4-b471-6c3173d877f6 service nova] Creating event network-vif-plugged:96415b19-4e1b-41c6-a070-cff24e7b20ab for instance 220e1c3e-1378-46fc-acc1-ee1bafac7722 on user Apr 13 16:33:39 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [req-9a9a585e-5037-4fbc-bfea-5abba6557a84 req-f995a7b3-e117-40c4-b471-6c3173d877f6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065287 Apr 13 16:33:39 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 215/641] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:33:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:33:39 user devstack@n-api.service[62055]: DEBUG nova.policy [None req-f754ffd5-8508-4d37-b702-fe7d1098a874 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fab402fb794a5a9281cfb7fe188813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24904988cf334657b084fd726c7ecf8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62055) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:33:39 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-f754ffd5-8508-4d37-b702-fe7d1098a874 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eaae47b9-a059-49f6-9ae6-d7147003e2f2" status: 200 len: 1662 microversion: 2.1 time: 0.215821 Apr 13 16:33:39 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 213/642] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:33:39 2023] GET /compute/v2.1/servers/eaae47b9-a059-49f6-9ae6-d7147003e2f2 => generated 1662 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:33:40 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-ad42e251-56cf-44b0-8530-4c54d9e47835 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:33:40 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-ad42e251-56cf-44b0-8530-4c54d9e47835 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] [instance: 64a9c052-89a9-48ba-80c9-13fb5ef22f0e] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:33:40 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-ad42e251-56cf-44b0-8530-4c54d9e47835 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:33:40 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-ad42e251-56cf-44b0-8530-4c54d9e47835 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:33:40 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-ad42e251-56cf-44b0-8530-4c54d9e47835 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:33:40 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-ad42e251-56cf-44b0-8530-4c54d9e47835 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:33:40 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-ad42e251-56cf-44b0-8530-4c54d9e47835 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:33:40 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-ad42e251-56cf-44b0-8530-4c54d9e47835 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:33:40 user devstack@n-api.service[62054]: DEBUG nova.policy [None req-ad42e251-56cf-44b0-8530-4c54d9e47835 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f523740272844b6eb236477d0b116ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7100b359f341759cb6f6753e1539a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62054) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:33:40 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-ad42e251-56cf-44b0-8530-4c54d9e47835 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] 10.0.0.210 "GET /compute/v2.1/servers/64a9c052-89a9-48ba-80c9-13fb5ef22f0e" status: 200 len: 1537 microversion: 2.1 time: 0.401779 Apr 13 16:33:40 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 215/643] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:33:40 2023] GET /compute/v2.1/servers/64a9c052-89a9-48ba-80c9-13fb5ef22f0e => generated 1537 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:33:40 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-ab69fec4-9f34-4768-87e5-737ded0288f4 req-592dd3c5-8926-42c8-9df8-4cf8d3c8c8ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2956ab05-28ff-4c9e-b646-dbb83b3db278", "name": "network-vif-plugged", "status": "completed", "tag": "84df62e9-af7c-4e62-83da-b43b511be2a0"}, {"server_uuid": "eaae47b9-a059-49f6-9ae6-d7147003e2f2", "name": "network-vif-unplugged", "status": "completed", "tag": "e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:33:40 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-ab69fec4-9f34-4768-87e5-737ded0288f4 req-592dd3c5-8926-42c8-9df8-4cf8d3c8c8ec service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:33:40 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-ab69fec4-9f34-4768-87e5-737ded0288f4 req-592dd3c5-8926-42c8-9df8-4cf8d3c8c8ec service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:33:40 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-ab69fec4-9f34-4768-87e5-737ded0288f4 req-592dd3c5-8926-42c8-9df8-4cf8d3c8c8ec service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:33:40 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-ab69fec4-9f34-4768-87e5-737ded0288f4 req-592dd3c5-8926-42c8-9df8-4cf8d3c8c8ec service nova] Creating event network-vif-plugged:84df62e9-af7c-4e62-83da-b43b511be2a0 for instance 2956ab05-28ff-4c9e-b646-dbb83b3db278 on user Apr 13 16:33:40 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-ab69fec4-9f34-4768-87e5-737ded0288f4 req-592dd3c5-8926-42c8-9df8-4cf8d3c8c8ec service nova] Creating event network-vif-unplugged:e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae for instance eaae47b9-a059-49f6-9ae6-d7147003e2f2 on user Apr 13 16:33:40 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [req-ab69fec4-9f34-4768-87e5-737ded0288f4 req-592dd3c5-8926-42c8-9df8-4cf8d3c8c8ec service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.082394 Apr 13 16:33:40 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 216/644] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:33:40 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:33:43 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [req-b0fe32ba-c72e-4947-9389-dbdca0f60432 req-1447865c-30be-4bc2-80c9-3da089d31705 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eaae47b9-a059-49f6-9ae6-d7147003e2f2", "name": "network-vif-plugged", "status": "completed", "tag": "e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae"}]} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:33:43 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-b0fe32ba-c72e-4947-9389-dbdca0f60432 req-1447865c-30be-4bc2-80c9-3da089d31705 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:33:43 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-b0fe32ba-c72e-4947-9389-dbdca0f60432 req-1447865c-30be-4bc2-80c9-3da089d31705 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:33:43 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-b0fe32ba-c72e-4947-9389-dbdca0f60432 req-1447865c-30be-4bc2-80c9-3da089d31705 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:33:43 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-b0fe32ba-c72e-4947-9389-dbdca0f60432 req-1447865c-30be-4bc2-80c9-3da089d31705 service nova] Creating event network-vif-plugged:e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae for instance eaae47b9-a059-49f6-9ae6-d7147003e2f2 on user Apr 13 16:33:43 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [req-b0fe32ba-c72e-4947-9389-dbdca0f60432 req-1447865c-30be-4bc2-80c9-3da089d31705 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059530 Apr 13 16:33:43 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 214/645] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:33:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:33:43 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-219757be-0d8d-4b96-b107-3bbe16b33509 req-6ef5c367-88de-4631-876f-8ea487826925 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eaae47b9-a059-49f6-9ae6-d7147003e2f2", "name": "network-vif-deleted", "tag": "e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:33:43 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-219757be-0d8d-4b96-b107-3bbe16b33509 req-6ef5c367-88de-4631-876f-8ea487826925 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:33:43 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-219757be-0d8d-4b96-b107-3bbe16b33509 req-6ef5c367-88de-4631-876f-8ea487826925 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:33:43 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-219757be-0d8d-4b96-b107-3bbe16b33509 req-6ef5c367-88de-4631-876f-8ea487826925 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:33:43 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-219757be-0d8d-4b96-b107-3bbe16b33509 req-6ef5c367-88de-4631-876f-8ea487826925 service nova] Creating event network-vif-deleted:e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae for instance eaae47b9-a059-49f6-9ae6-d7147003e2f2 on user Apr 13 16:33:43 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [req-219757be-0d8d-4b96-b107-3bbe16b33509 req-6ef5c367-88de-4631-876f-8ea487826925 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032859 Apr 13 16:33:43 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 216/646] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:33:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:33:43 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-7a4228be-7d95-4c80-9921-33ea02b45ca4 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f98a26ac-2506-4887-9d1d-277e6593f3ed"}} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:33:43 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-7a4228be-7d95-4c80-9921-33ea02b45ca4 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] [instance: 64a9c052-89a9-48ba-80c9-13fb5ef22f0e] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:33:43 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-7a4228be-7d95-4c80-9921-33ea02b45ca4 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:33:43 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-7a4228be-7d95-4c80-9921-33ea02b45ca4 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:33:43 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-7a4228be-7d95-4c80-9921-33ea02b45ca4 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:33:43 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-7a4228be-7d95-4c80-9921-33ea02b45ca4 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:33:43 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-7a4228be-7d95-4c80-9921-33ea02b45ca4 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:33:43 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-7a4228be-7d95-4c80-9921-33ea02b45ca4 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:33:44 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-7a4228be-7d95-4c80-9921-33ea02b45ca4 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] 10.0.0.210 "POST /compute/v2.1/servers/64a9c052-89a9-48ba-80c9-13fb5ef22f0e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.322298 Apr 13 16:33:44 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 217/647] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 16:33:43 2023] POST /compute/v2.1/servers/64a9c052-89a9-48ba-80c9-13fb5ef22f0e/os-volume_attachments => generated 194 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:33:44 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-b5e2251a-80c2-460d-8d98-ca2efce6b6dd tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:33:44 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-b5e2251a-80c2-460d-8d98-ca2efce6b6dd tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:33:44 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-b5e2251a-80c2-460d-8d98-ca2efce6b6dd tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:33:44 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-b5e2251a-80c2-460d-8d98-ca2efce6b6dd tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:33:44 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-b5e2251a-80c2-460d-8d98-ca2efce6b6dd tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:33:44 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-b5e2251a-80c2-460d-8d98-ca2efce6b6dd tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:33:44 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-b5e2251a-80c2-460d-8d98-ca2efce6b6dd tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:33:44 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-b5e2251a-80c2-460d-8d98-ca2efce6b6dd tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:33:44 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-b5e2251a-80c2-460d-8d98-ca2efce6b6dd tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] 10.0.0.210 "GET /compute/v2.1/servers/35b23303-e373-4f35-b7ee-76e6815073ce/os-interface" status: 200 len: 283 microversion: 2.20 time: 0.117904 Apr 13 16:33:44 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 215/648] 10.0.0.210 () {64 vars in 1393 bytes} [Thu Apr 13 16:33:44 2023] GET /compute/v2.1/servers/35b23303-e373-4f35-b7ee-76e6815073ce/os-interface => generated 283 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 16:33:45 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-e75b9d45-9f78-4134-ae79-a904a979308b req-c5d37fe3-2c91-496d-9d2b-b9e8988442eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64a9c052-89a9-48ba-80c9-13fb5ef22f0e", "tag": "5128334f-7255-4a56-9e8b-1151027d219b"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:33:45 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-e75b9d45-9f78-4134-ae79-a904a979308b req-c5d37fe3-2c91-496d-9d2b-b9e8988442eb service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:33:45 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-e75b9d45-9f78-4134-ae79-a904a979308b req-c5d37fe3-2c91-496d-9d2b-b9e8988442eb service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:33:45 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-e75b9d45-9f78-4134-ae79-a904a979308b req-c5d37fe3-2c91-496d-9d2b-b9e8988442eb service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:33:45 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-e75b9d45-9f78-4134-ae79-a904a979308b req-c5d37fe3-2c91-496d-9d2b-b9e8988442eb service nova] Creating event network-changed:5128334f-7255-4a56-9e8b-1151027d219b for instance 64a9c052-89a9-48ba-80c9-13fb5ef22f0e on user Apr 13 16:33:45 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [req-e75b9d45-9f78-4134-ae79-a904a979308b req-c5d37fe3-2c91-496d-9d2b-b9e8988442eb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034019 Apr 13 16:33:45 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 217/649] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:33:45 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:33:45 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-75e83c33-4e0a-4a39-beb3-6aa3856637b6 req-19b79c11-75e7-45dd-b5da-1695f432fc21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35b23303-e373-4f35-b7ee-76e6815073ce", "tag": "d3c66e4e-b15d-4bc9-a838-265ca07a6a66"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:33:45 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-75e83c33-4e0a-4a39-beb3-6aa3856637b6 req-19b79c11-75e7-45dd-b5da-1695f432fc21 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:33:45 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-75e83c33-4e0a-4a39-beb3-6aa3856637b6 req-19b79c11-75e7-45dd-b5da-1695f432fc21 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:33:45 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-75e83c33-4e0a-4a39-beb3-6aa3856637b6 req-19b79c11-75e7-45dd-b5da-1695f432fc21 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:33:45 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-75e83c33-4e0a-4a39-beb3-6aa3856637b6 req-19b79c11-75e7-45dd-b5da-1695f432fc21 service nova] Creating event network-changed:d3c66e4e-b15d-4bc9-a838-265ca07a6a66 for instance 35b23303-e373-4f35-b7ee-76e6815073ce on user Apr 13 16:33:45 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [req-75e83c33-4e0a-4a39-beb3-6aa3856637b6 req-19b79c11-75e7-45dd-b5da-1695f432fc21 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051406 Apr 13 16:33:45 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 218/650] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:33:45 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:33:45 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-248908cb-6a45-4481-bbc6-df47c6a43ee9 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:33:45 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-248908cb-6a45-4481-bbc6-df47c6a43ee9 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:33:45 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-248908cb-6a45-4481-bbc6-df47c6a43ee9 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:33:45 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-248908cb-6a45-4481-bbc6-df47c6a43ee9 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:33:45 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-248908cb-6a45-4481-bbc6-df47c6a43ee9 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:33:45 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-248908cb-6a45-4481-bbc6-df47c6a43ee9 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:33:45 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-248908cb-6a45-4481-bbc6-df47c6a43ee9 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:33:45 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-248908cb-6a45-4481-bbc6-df47c6a43ee9 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:33:45 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-248908cb-6a45-4481-bbc6-df47c6a43ee9 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] 10.0.0.210 "GET /compute/v2.1/servers/35b23303-e373-4f35-b7ee-76e6815073ce/ips" status: 200 len: 111 microversion: 2.20 time: 0.045235 Apr 13 16:33:45 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 216/651] 10.0.0.210 () {64 vars in 1366 bytes} [Thu Apr 13 16:33:45 2023] GET /compute/v2.1/servers/35b23303-e373-4f35-b7ee-76e6815073ce/ips => generated 111 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 16:33:45 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-40dab86b-81bd-4e34-8302-b3bcd09309bb tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:33:45 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-40dab86b-81bd-4e34-8302-b3bcd09309bb tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:33:45 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-40dab86b-81bd-4e34-8302-b3bcd09309bb tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:33:45 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-40dab86b-81bd-4e34-8302-b3bcd09309bb tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:33:45 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-40dab86b-81bd-4e34-8302-b3bcd09309bb tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:33:45 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-40dab86b-81bd-4e34-8302-b3bcd09309bb tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:33:45 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-40dab86b-81bd-4e34-8302-b3bcd09309bb tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:33:45 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-40dab86b-81bd-4e34-8302-b3bcd09309bb tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:33:45 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-9b8e7169-1dde-4fdd-a9a1-1760fe3eb2c0 req-2cda6bcc-0081-4788-a3e0-903286da08f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2956ab05-28ff-4c9e-b646-dbb83b3db278", "name": "network-vif-plugged", "status": "completed", "tag": "84df62e9-af7c-4e62-83da-b43b511be2a0"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:33:45 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-9b8e7169-1dde-4fdd-a9a1-1760fe3eb2c0 req-2cda6bcc-0081-4788-a3e0-903286da08f1 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:33:45 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-9b8e7169-1dde-4fdd-a9a1-1760fe3eb2c0 req-2cda6bcc-0081-4788-a3e0-903286da08f1 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:33:45 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-9b8e7169-1dde-4fdd-a9a1-1760fe3eb2c0 req-2cda6bcc-0081-4788-a3e0-903286da08f1 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:33:46 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-9b8e7169-1dde-4fdd-a9a1-1760fe3eb2c0 req-2cda6bcc-0081-4788-a3e0-903286da08f1 service nova] Creating event network-vif-plugged:84df62e9-af7c-4e62-83da-b43b511be2a0 for instance 2956ab05-28ff-4c9e-b646-dbb83b3db278 on user Apr 13 16:33:46 user devstack@n-api.service[62054]: DEBUG nova.objects.instance [None req-40dab86b-81bd-4e34-8302-b3bcd09309bb tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lazy-loading 'services' on Instance uuid bf98c3a2-dbeb-4ae4-8423-ce55964c4258 {{(pid=62054) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 16:33:46 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [req-9b8e7169-1dde-4fdd-a9a1-1760fe3eb2c0 req-2cda6bcc-0081-4788-a3e0-903286da08f1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070111 Apr 13 16:33:46 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 219/652] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:33:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:33:46 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-40dab86b-81bd-4e34-8302-b3bcd09309bb tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/bf98c3a2-dbeb-4ae4-8423-ce55964c4258/os-volume_attachments/83d71596-07bc-438e-a163-92acd11239d8" status: 202 len: 0 microversion: 2.1 time: 0.238773 Apr 13 16:33:46 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 218/653] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 16:33:45 2023] DELETE /compute/v2.1/servers/bf98c3a2-dbeb-4ae4-8423-ce55964c4258/os-volume_attachments/83d71596-07bc-438e-a163-92acd11239d8 => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 16:33:46 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-aca9a6ec-d6a3-488c-b38e-46974c244a41 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:33:46 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-aca9a6ec-d6a3-488c-b38e-46974c244a41 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:33:46 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-aca9a6ec-d6a3-488c-b38e-46974c244a41 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:33:46 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-aca9a6ec-d6a3-488c-b38e-46974c244a41 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:33:46 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-aca9a6ec-d6a3-488c-b38e-46974c244a41 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:33:46 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-aca9a6ec-d6a3-488c-b38e-46974c244a41 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:33:46 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-aca9a6ec-d6a3-488c-b38e-46974c244a41 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:33:46 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-aca9a6ec-d6a3-488c-b38e-46974c244a41 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:33:46 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-aca9a6ec-d6a3-488c-b38e-46974c244a41 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bf98c3a2-dbeb-4ae4-8423-ce55964c4258/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065994 Apr 13 16:33:46 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 217/654] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 16:33:46 2023] GET /compute/v2.1/servers/bf98c3a2-dbeb-4ae4-8423-ce55964c4258/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:33:48 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-6e3fefb2-38ba-4428-a5cd-29028fca8089 req-36e7e696-006f-4a68-8414-b3c90ff26557 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2956ab05-28ff-4c9e-b646-dbb83b3db278", "name": "network-vif-plugged", "status": "completed", "tag": "84df62e9-af7c-4e62-83da-b43b511be2a0"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:33:48 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-6e3fefb2-38ba-4428-a5cd-29028fca8089 req-36e7e696-006f-4a68-8414-b3c90ff26557 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:33:48 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-6e3fefb2-38ba-4428-a5cd-29028fca8089 req-36e7e696-006f-4a68-8414-b3c90ff26557 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:33:48 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-6e3fefb2-38ba-4428-a5cd-29028fca8089 req-36e7e696-006f-4a68-8414-b3c90ff26557 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:33:48 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-6e3fefb2-38ba-4428-a5cd-29028fca8089 req-36e7e696-006f-4a68-8414-b3c90ff26557 service nova] Creating event network-vif-plugged:84df62e9-af7c-4e62-83da-b43b511be2a0 for instance 2956ab05-28ff-4c9e-b646-dbb83b3db278 on user Apr 13 16:33:48 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [req-6e3fefb2-38ba-4428-a5cd-29028fca8089 req-36e7e696-006f-4a68-8414-b3c90ff26557 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027710 Apr 13 16:33:48 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 220/655] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:33:48 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:33:49 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-3f82f192-22ab-47df-b0d5-ea124a3c77a4 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:33:49 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-3f82f192-22ab-47df-b0d5-ea124a3c77a4 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:33:49 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-3f82f192-22ab-47df-b0d5-ea124a3c77a4 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:33:49 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-3f82f192-22ab-47df-b0d5-ea124a3c77a4 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:33:49 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-3f82f192-22ab-47df-b0d5-ea124a3c77a4 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:33:49 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-3f82f192-22ab-47df-b0d5-ea124a3c77a4 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:33:49 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-3f82f192-22ab-47df-b0d5-ea124a3c77a4 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:33:49 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-3f82f192-22ab-47df-b0d5-ea124a3c77a4 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:33:49 user devstack@n-api.service[62054]: DEBUG nova.objects.instance [None req-3f82f192-22ab-47df-b0d5-ea124a3c77a4 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lazy-loading 'flavor' on Instance uuid 35b23303-e373-4f35-b7ee-76e6815073ce {{(pid=62054) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 16:33:50 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-3f82f192-22ab-47df-b0d5-ea124a3c77a4 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] 10.0.0.210 "POST /compute/v2.1/servers/35b23303-e373-4f35-b7ee-76e6815073ce/action" status: 202 len: 0 microversion: 2.20 time: 1.159166 Apr 13 16:33:50 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 219/656] 10.0.0.210 () {66 vars in 1396 bytes} [Thu Apr 13 16:33:49 2023] POST /compute/v2.1/servers/35b23303-e373-4f35-b7ee-76e6815073ce/action => generated 0 bytes in 1161 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 13 16:33:50 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-07190346-f7e6-41f0-ba0d-99ce5d3fd605 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:33:50 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-07190346-f7e6-41f0-ba0d-99ce5d3fd605 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:33:50 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-07190346-f7e6-41f0-ba0d-99ce5d3fd605 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:33:50 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-07190346-f7e6-41f0-ba0d-99ce5d3fd605 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:33:50 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-07190346-f7e6-41f0-ba0d-99ce5d3fd605 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:33:50 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-07190346-f7e6-41f0-ba0d-99ce5d3fd605 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:33:50 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-07190346-f7e6-41f0-ba0d-99ce5d3fd605 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:33:50 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-07190346-f7e6-41f0-ba0d-99ce5d3fd605 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:33:51 user devstack@n-api.service[62055]: DEBUG nova.policy [None req-07190346-f7e6-41f0-ba0d-99ce5d3fd605 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b4e972cd1049509fa899449961ab59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0653ab16660b46cea9c5af58ea0b1931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62055) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:33:51 user devstack@n-api.service[62055]: DEBUG nova.policy [None req-07190346-f7e6-41f0-ba0d-99ce5d3fd605 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48b4e972cd1049509fa899449961ab59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0653ab16660b46cea9c5af58ea0b1931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62055) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:33:51 user devstack@n-api.service[62055]: DEBUG nova.policy [None req-07190346-f7e6-41f0-ba0d-99ce5d3fd605 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48b4e972cd1049509fa899449961ab59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0653ab16660b46cea9c5af58ea0b1931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62055) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:33:51 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-07190346-f7e6-41f0-ba0d-99ce5d3fd605 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] 10.0.0.210 "GET /compute/v2.1/servers/35b23303-e373-4f35-b7ee-76e6815073ce" status: 200 len: 1713 microversion: 2.20 time: 0.241210 Apr 13 16:33:51 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 218/657] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 16:33:50 2023] GET /compute/v2.1/servers/35b23303-e373-4f35-b7ee-76e6815073ce => generated 1713 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 16:33:51 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-1ad92e5e-0aee-4645-9b2f-d9ac5795cc3a req-c4f9ed23-da7c-4a78-bf5a-70ea91e07f86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35b23303-e373-4f35-b7ee-76e6815073ce", "name": "network-vif-unplugged", "status": "completed", "tag": "d3c66e4e-b15d-4bc9-a838-265ca07a6a66"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:33:51 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-1ad92e5e-0aee-4645-9b2f-d9ac5795cc3a req-c4f9ed23-da7c-4a78-bf5a-70ea91e07f86 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:33:51 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-1ad92e5e-0aee-4645-9b2f-d9ac5795cc3a req-c4f9ed23-da7c-4a78-bf5a-70ea91e07f86 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:33:51 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-1ad92e5e-0aee-4645-9b2f-d9ac5795cc3a req-c4f9ed23-da7c-4a78-bf5a-70ea91e07f86 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:33:51 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-1ad92e5e-0aee-4645-9b2f-d9ac5795cc3a req-c4f9ed23-da7c-4a78-bf5a-70ea91e07f86 service nova] Creating event network-vif-unplugged:d3c66e4e-b15d-4bc9-a838-265ca07a6a66 for instance 35b23303-e373-4f35-b7ee-76e6815073ce on user Apr 13 16:33:51 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [req-1ad92e5e-0aee-4645-9b2f-d9ac5795cc3a req-c4f9ed23-da7c-4a78-bf5a-70ea91e07f86 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050098 Apr 13 16:33:51 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 221/658] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:33:51 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:33:53 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-87503cd9-8a18-4907-8563-6b1abdea6296 req-42f3c770-3814-457e-9482-90cbb1544e88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35b23303-e373-4f35-b7ee-76e6815073ce", "name": "network-vif-plugged", "status": "completed", "tag": "d3c66e4e-b15d-4bc9-a838-265ca07a6a66"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:33:53 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-0f28435c-af41-41ff-9c5a-84cdcd8ab9b0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:33:53 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-0f28435c-af41-41ff-9c5a-84cdcd8ab9b0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] [instance: 64a9c052-89a9-48ba-80c9-13fb5ef22f0e] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:33:53 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-87503cd9-8a18-4907-8563-6b1abdea6296 req-42f3c770-3814-457e-9482-90cbb1544e88 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:33:53 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-87503cd9-8a18-4907-8563-6b1abdea6296 req-42f3c770-3814-457e-9482-90cbb1544e88 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:33:53 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-87503cd9-8a18-4907-8563-6b1abdea6296 req-42f3c770-3814-457e-9482-90cbb1544e88 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:33:53 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-0f28435c-af41-41ff-9c5a-84cdcd8ab9b0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:33:53 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-0f28435c-af41-41ff-9c5a-84cdcd8ab9b0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:33:53 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-0f28435c-af41-41ff-9c5a-84cdcd8ab9b0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:33:53 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-0f28435c-af41-41ff-9c5a-84cdcd8ab9b0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:33:53 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-0f28435c-af41-41ff-9c5a-84cdcd8ab9b0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:33:53 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-0f28435c-af41-41ff-9c5a-84cdcd8ab9b0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:33:53 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-87503cd9-8a18-4907-8563-6b1abdea6296 req-42f3c770-3814-457e-9482-90cbb1544e88 service nova] Creating event network-vif-plugged:d3c66e4e-b15d-4bc9-a838-265ca07a6a66 for instance 35b23303-e373-4f35-b7ee-76e6815073ce on user Apr 13 16:33:53 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [req-87503cd9-8a18-4907-8563-6b1abdea6296 req-42f3c770-3814-457e-9482-90cbb1544e88 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082037 Apr 13 16:33:53 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 220/659] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:33:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:33:53 user devstack@n-api.service[62055]: DEBUG nova.objects.instance [None req-0f28435c-af41-41ff-9c5a-84cdcd8ab9b0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lazy-loading 'services' on Instance uuid 64a9c052-89a9-48ba-80c9-13fb5ef22f0e {{(pid=62055) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 16:33:53 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-0f28435c-af41-41ff-9c5a-84cdcd8ab9b0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/64a9c052-89a9-48ba-80c9-13fb5ef22f0e/os-volume_attachments/f98a26ac-2506-4887-9d1d-277e6593f3ed" status: 202 len: 0 microversion: 2.1 time: 0.183310 Apr 13 16:33:53 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 219/660] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 16:33:53 2023] DELETE /compute/v2.1/servers/64a9c052-89a9-48ba-80c9-13fb5ef22f0e/os-volume_attachments/f98a26ac-2506-4887-9d1d-277e6593f3ed => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 16:33:53 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-8bf7e48c-e541-4dc3-9b2d-c3db84755086 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:33:53 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-8bf7e48c-e541-4dc3-9b2d-c3db84755086 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] [instance: 64a9c052-89a9-48ba-80c9-13fb5ef22f0e] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:33:53 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-8bf7e48c-e541-4dc3-9b2d-c3db84755086 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:33:53 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-8bf7e48c-e541-4dc3-9b2d-c3db84755086 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:33:53 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-8bf7e48c-e541-4dc3-9b2d-c3db84755086 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:33:53 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-8bf7e48c-e541-4dc3-9b2d-c3db84755086 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:33:53 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-8bf7e48c-e541-4dc3-9b2d-c3db84755086 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:33:53 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-8bf7e48c-e541-4dc3-9b2d-c3db84755086 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:33:53 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-8bf7e48c-e541-4dc3-9b2d-c3db84755086 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] 10.0.0.210 "GET /compute/v2.1/servers/64a9c052-89a9-48ba-80c9-13fb5ef22f0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046973 Apr 13 16:33:53 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 222/661] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 16:33:53 2023] GET /compute/v2.1/servers/64a9c052-89a9-48ba-80c9-13fb5ef22f0e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:33:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-5e6278b4-16a9-4e1f-8cf5-584a46932ede req-6f68860c-7c20-4161-8091-632049709dec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35b23303-e373-4f35-b7ee-76e6815073ce", "tag": "d3c66e4e-b15d-4bc9-a838-265ca07a6a66"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:33:55 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-5e6278b4-16a9-4e1f-8cf5-584a46932ede req-6f68860c-7c20-4161-8091-632049709dec service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:33:55 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-5e6278b4-16a9-4e1f-8cf5-584a46932ede req-6f68860c-7c20-4161-8091-632049709dec service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:33:55 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-5e6278b4-16a9-4e1f-8cf5-584a46932ede req-6f68860c-7c20-4161-8091-632049709dec service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:33:55 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-5e6278b4-16a9-4e1f-8cf5-584a46932ede req-6f68860c-7c20-4161-8091-632049709dec service nova] Creating event network-changed:d3c66e4e-b15d-4bc9-a838-265ca07a6a66 for instance 35b23303-e373-4f35-b7ee-76e6815073ce on user Apr 13 16:33:55 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [req-5e6278b4-16a9-4e1f-8cf5-584a46932ede req-6f68860c-7c20-4161-8091-632049709dec service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041753 Apr 13 16:33:55 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 221/662] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:33:55 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:34:18 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_api:SELECT=22 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:34:18 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:34:18 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-aab9a7b9-9c31-4d45-beaf-7bf0d37c3af9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:34:18 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-aab9a7b9-9c31-4d45-beaf-7bf0d37c3af9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:34:18 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-aab9a7b9-9c31-4d45-beaf-7bf0d37c3af9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:34:18 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-aab9a7b9-9c31-4d45-beaf-7bf0d37c3af9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:34:18 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-aab9a7b9-9c31-4d45-beaf-7bf0d37c3af9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:34:18 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-aab9a7b9-9c31-4d45-beaf-7bf0d37c3af9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:34:18 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-aab9a7b9-9c31-4d45-beaf-7bf0d37c3af9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:34:18 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-aab9a7b9-9c31-4d45-beaf-7bf0d37c3af9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:34:18 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-aab9a7b9-9c31-4d45-beaf-7bf0d37c3af9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] 10.0.0.210 "POST /compute/v2.1/servers/acbcaee0-a47b-4fee-8765-9b1c9597d515/action" status: 202 len: 0 microversion: 2.1 time: 0.175354 Apr 13 16:34:18 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 220/663] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 16:34:18 2023] POST /compute/v2.1/servers/acbcaee0-a47b-4fee-8765-9b1c9597d515/action => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 13 16:34:18 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-700b2aa1-fb0d-4ee0-b9b8-cd2775b3f690 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:34:18 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-700b2aa1-fb0d-4ee0-b9b8-cd2775b3f690 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:34:18 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:34:18 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:34:18 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-700b2aa1-fb0d-4ee0-b9b8-cd2775b3f690 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:34:18 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-700b2aa1-fb0d-4ee0-b9b8-cd2775b3f690 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:34:18 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-700b2aa1-fb0d-4ee0-b9b8-cd2775b3f690 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:34:18 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-700b2aa1-fb0d-4ee0-b9b8-cd2775b3f690 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:34:18 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-700b2aa1-fb0d-4ee0-b9b8-cd2775b3f690 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:34:18 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-700b2aa1-fb0d-4ee0-b9b8-cd2775b3f690 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:34:18 user devstack@n-api.service[62053]: DEBUG nova.policy [None req-700b2aa1-fb0d-4ee0-b9b8-cd2775b3f690 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b3df1c5c5d441819bcef89ed6966815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980559734a504574a83224deb7423c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62053) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:34:18 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-700b2aa1-fb0d-4ee0-b9b8-cd2775b3f690 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] 10.0.0.210 "GET /compute/v2.1/servers/acbcaee0-a47b-4fee-8765-9b1c9597d515" status: 200 len: 1730 microversion: 2.1 time: 0.250871 Apr 13 16:34:18 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 223/664] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:34:18 2023] GET /compute/v2.1/servers/acbcaee0-a47b-4fee-8765-9b1c9597d515 => generated 1730 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:34:18 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:34:18 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:34:18 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-d28d710a-a970-46ad-b713-1837c12c9d6b tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:34:18 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-d28d710a-a970-46ad-b713-1837c12c9d6b tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 220e1c3e-1378-46fc-acc1-ee1bafac7722] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:34:18 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-d28d710a-a970-46ad-b713-1837c12c9d6b tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:34:18 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-d28d710a-a970-46ad-b713-1837c12c9d6b tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:34:18 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-d28d710a-a970-46ad-b713-1837c12c9d6b tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:34:18 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-d28d710a-a970-46ad-b713-1837c12c9d6b tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:34:18 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-d28d710a-a970-46ad-b713-1837c12c9d6b tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:34:18 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-d28d710a-a970-46ad-b713-1837c12c9d6b tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:34:18 user devstack@n-api.service[62054]: DEBUG nova.policy [None req-d28d710a-a970-46ad-b713-1837c12c9d6b tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e10f63cdd49a9a1ebe1fe4c9de0a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d451e0e239f486aa2b3abe9e273eab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62054) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:34:18 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-d28d710a-a970-46ad-b713-1837c12c9d6b tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] 10.0.0.210 "GET /compute/v2.1/servers/220e1c3e-1378-46fc-acc1-ee1bafac7722" status: 200 len: 1441 microversion: 2.1 time: 0.186868 Apr 13 16:34:18 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 222/665] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:34:18 2023] GET /compute/v2.1/servers/220e1c3e-1378-46fc-acc1-ee1bafac7722 => generated 1441 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:34:20 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [req-700403dd-d6c5-43bb-8843-6db09a213c74 req-6709353b-1bcc-41f6-8ef0-a998cc2018da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acbcaee0-a47b-4fee-8765-9b1c9597d515", "name": "network-vif-unplugged", "status": "completed", "tag": "13471516-9514-4b85-938f-69657c2990e5"}]} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:34:20 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-700403dd-d6c5-43bb-8843-6db09a213c74 req-6709353b-1bcc-41f6-8ef0-a998cc2018da service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:34:20 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-700403dd-d6c5-43bb-8843-6db09a213c74 req-6709353b-1bcc-41f6-8ef0-a998cc2018da service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:34:20 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-700403dd-d6c5-43bb-8843-6db09a213c74 req-6709353b-1bcc-41f6-8ef0-a998cc2018da service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:34:20 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-700403dd-d6c5-43bb-8843-6db09a213c74 req-6709353b-1bcc-41f6-8ef0-a998cc2018da service nova] Creating event network-vif-unplugged:13471516-9514-4b85-938f-69657c2990e5 for instance acbcaee0-a47b-4fee-8765-9b1c9597d515 on user Apr 13 16:34:20 user devstack@n-api.service[62055]: DEBUG nova.compute.api [req-700403dd-d6c5-43bb-8843-6db09a213c74 req-6709353b-1bcc-41f6-8ef0-a998cc2018da service nova] Instance acbcaee0-a47b-4fee-8765-9b1c9597d515 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=62055) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 13 16:34:20 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [req-700403dd-d6c5-43bb-8843-6db09a213c74 req-6709353b-1bcc-41f6-8ef0-a998cc2018da service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039018 Apr 13 16:34:20 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 221/666] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:34:20 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:34:22 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-528ade71-9a31-4267-8dd1-0adc1ac16522 req-36314a88-9c7f-4a63-b23d-f1f738af6640 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acbcaee0-a47b-4fee-8765-9b1c9597d515", "name": "network-vif-plugged", "status": "completed", "tag": "13471516-9514-4b85-938f-69657c2990e5"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:34:22 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-528ade71-9a31-4267-8dd1-0adc1ac16522 req-36314a88-9c7f-4a63-b23d-f1f738af6640 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:34:22 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-528ade71-9a31-4267-8dd1-0adc1ac16522 req-36314a88-9c7f-4a63-b23d-f1f738af6640 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:34:22 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-528ade71-9a31-4267-8dd1-0adc1ac16522 req-36314a88-9c7f-4a63-b23d-f1f738af6640 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:34:22 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-528ade71-9a31-4267-8dd1-0adc1ac16522 req-36314a88-9c7f-4a63-b23d-f1f738af6640 service nova] Creating event network-vif-plugged:13471516-9514-4b85-938f-69657c2990e5 for instance acbcaee0-a47b-4fee-8765-9b1c9597d515 on user Apr 13 16:34:22 user devstack@n-api.service[62053]: DEBUG nova.compute.api [req-528ade71-9a31-4267-8dd1-0adc1ac16522 req-36314a88-9c7f-4a63-b23d-f1f738af6640 service nova] Instance acbcaee0-a47b-4fee-8765-9b1c9597d515 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=62053) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 13 16:34:22 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [req-528ade71-9a31-4267-8dd1-0adc1ac16522 req-36314a88-9c7f-4a63-b23d-f1f738af6640 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040557 Apr 13 16:34:22 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 224/667] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:34:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:34:28 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-18790c87-a714-4d6f-a9f4-affad0db418e tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:34:28 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-18790c87-a714-4d6f-a9f4-affad0db418e tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:34:28 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-18790c87-a714-4d6f-a9f4-affad0db418e tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:34:28 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-18790c87-a714-4d6f-a9f4-affad0db418e tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:34:28 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-18790c87-a714-4d6f-a9f4-affad0db418e tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:34:28 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-18790c87-a714-4d6f-a9f4-affad0db418e tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:34:28 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-18790c87-a714-4d6f-a9f4-affad0db418e tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:34:28 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-18790c87-a714-4d6f-a9f4-affad0db418e tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:34:28 user devstack@n-api.service[62054]: DEBUG nova.policy [None req-18790c87-a714-4d6f-a9f4-affad0db418e tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45a882dbafb4ea4976e4f45289eb2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d09a74bf684a9fb1dd1e95d6c23f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62054) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:34:28 user devstack@n-api.service[62054]: DEBUG nova.policy [None req-18790c87-a714-4d6f-a9f4-affad0db418e tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e45a882dbafb4ea4976e4f45289eb2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d09a74bf684a9fb1dd1e95d6c23f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62054) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:34:28 user devstack@n-api.service[62054]: DEBUG nova.policy [None req-18790c87-a714-4d6f-a9f4-affad0db418e tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e45a882dbafb4ea4976e4f45289eb2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d09a74bf684a9fb1dd1e95d6c23f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62054) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:34:28 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-18790c87-a714-4d6f-a9f4-affad0db418e tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2956ab05-28ff-4c9e-b646-dbb83b3db278" status: 200 len: 1754 microversion: 2.87 time: 0.205120 Apr 13 16:34:28 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 223/668] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 16:34:28 2023] GET /compute/v2.1/servers/2956ab05-28ff-4c9e-b646-dbb83b3db278 => generated 1754 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 16:34:29 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-8fcd35dd-1991-4bc6-87d3-2414e862dc99 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:34:29 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-8fcd35dd-1991-4bc6-87d3-2414e862dc99 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:34:29 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-8fcd35dd-1991-4bc6-87d3-2414e862dc99 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:34:29 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-8fcd35dd-1991-4bc6-87d3-2414e862dc99 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:34:29 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-8fcd35dd-1991-4bc6-87d3-2414e862dc99 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:34:29 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-8fcd35dd-1991-4bc6-87d3-2414e862dc99 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:34:29 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-8fcd35dd-1991-4bc6-87d3-2414e862dc99 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:34:29 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-8fcd35dd-1991-4bc6-87d3-2414e862dc99 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:34:29 user devstack@n-api.service[62055]: INFO nova.api.openstack.wsgi [None req-8fcd35dd-1991-4bc6-87d3-2414e862dc99 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] HTTP exception thrown: Instance eaae47b9-a059-49f6-9ae6-d7147003e2f2 could not be found. Apr 13 16:34:29 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-8fcd35dd-1991-4bc6-87d3-2414e862dc99 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Request method failure captured: Apr 13 16:34:29 user devstack@n-api.service[62055]: request: GET /compute/v2.1/servers/eaae47b9-a059-49f6-9ae6-d7147003e2f2 HTTP/1.1 Apr 13 16:34:29 user devstack@n-api.service[62055]: Accept: application/json Apr 13 16:34:29 user devstack@n-api.service[62055]: Accept-Encoding: identity Apr 13 16:34:29 user devstack@n-api.service[62055]: Connection: close Apr 13 16:34:29 user devstack@n-api.service[62055]: Content-Length: 0 Apr 13 16:34:29 user devstack@n-api.service[62055]: Content-Type: application/json Apr 13 16:34:29 user devstack@n-api.service[62055]: Host: 10.0.0.210 Apr 13 16:34:29 user devstack@n-api.service[62055]: Openstack-System-Scope: None Apr 13 16:34:29 user devstack@n-api.service[62055]: User-Agent: python-urllib3/1.26.15 Apr 13 16:34:29 user devstack@n-api.service[62055]: X-Auth-Token: gAAAAABkOCyn1k8Th_ku9lHC1hCBGLG5X6QBQKvIDcZzNt5sKERj2rw2GlACSYp2OIBakRae3fpU--rPCIYAIbAtAtnpoWJedbet6b6JWWLA_35Dam2INgFhdFnEC42xxmqmkjQdJdpgJXxn0SsSbT2iDqDs2YoFzl3KlzgdSkM3FuRqPHPE350 Apr 13 16:34:29 user devstack@n-api.service[62055]: X-Domain-Id: None Apr 13 16:34:29 user devstack@n-api.service[62055]: X-Domain-Name: None Apr 13 16:34:29 user devstack@n-api.service[62055]: X-Identity-Status: Confirmed Apr 13 16:34:29 user devstack@n-api.service[62055]: X-Is-Admin-Project: True Apr 13 16:34:29 user devstack@n-api.service[62055]: X-Project-Domain-Id: default Apr 13 16:34:29 user devstack@n-api.service[62055]: X-Project-Domain-Name: Default Apr 13 16:34:29 user devstack@n-api.service[62055]: X-Project-Id: 24904988cf334657b084fd726c7ecf8f Apr 13 16:34:29 user devstack@n-api.service[62055]: X-Project-Name: tempest-AttachVolumeTestJSON-836650657 Apr 13 16:34:29 user devstack@n-api.service[62055]: X-Role: reader,member Apr 13 16:34:29 user devstack@n-api.service[62055]: X-Roles: reader,member Apr 13 16:34:29 user devstack@n-api.service[62055]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/24904988cf334657b084fd726c7ecf8f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/24904988cf334657b084fd726c7ecf8f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/24904988cf334657b084fd726c7ecf8f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 13 16:34:29 user devstack@n-api.service[62055]: X-Tenant: tempest-AttachVolumeTestJSON-836650657 Apr 13 16:34:29 user devstack@n-api.service[62055]: X-Tenant-Id: 24904988cf334657b084fd726c7ecf8f Apr 13 16:34:29 user devstack@n-api.service[62055]: X-Tenant-Name: tempest-AttachVolumeTestJSON-836650657 Apr 13 16:34:29 user devstack@n-api.service[62055]: X-User: tempest-AttachVolumeTestJSON-836650657-project-member Apr 13 16:34:29 user devstack@n-api.service[62055]: X-User-Domain-Id: default Apr 13 16:34:29 user devstack@n-api.service[62055]: X-User-Domain-Name: Default Apr 13 16:34:29 user devstack@n-api.service[62055]: X-User-Id: 47fab402fb794a5a9281cfb7fe188813 Apr 13 16:34:29 user devstack@n-api.service[62055]: X-User-Name: tempest-AttachVolumeTestJSON-836650657-project-member Apr 13 16:34:29 user devstack@n-api.service[62055]: method: > Apr 13 16:34:29 user devstack@n-api.service[62055]: exception: Instance eaae47b9-a059-49f6-9ae6-d7147003e2f2 could not be found. Apr 13 16:34:29 user devstack@n-api.service[62055]: action_args: {'id': 'eaae47b9-a059-49f6-9ae6-d7147003e2f2'} Apr 13 16:34:29 user devstack@n-api.service[62055]: {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 16:34:29 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:34:29 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 16:34:29 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 16:34:29 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 16:34:29 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 16:34:29 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 16:34:29 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 16:34:29 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 16:34:29 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 16:34:29 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eaae47b9-a059-49f6-9ae6-d7147003e2f2 could not be found. Apr 13 16:34:29 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:34:29 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:34:29 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:34:29 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:34:29 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 16:34:29 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 16:34:29 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 16:34:29 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 16:34:29 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 16:34:29 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 16:34:29 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 16:34:29 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 16:34:29 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 16:34:29 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 16:34:29 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 16:34:29 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 16:34:29 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eaae47b9-a059-49f6-9ae6-d7147003e2f2 could not be found. Apr 13 16:34:29 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:34:29 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:34:29 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:34:29 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:34:29 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 16:34:29 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 16:34:29 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 16:34:29 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 16:34:29 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eaae47b9-a059-49f6-9ae6-d7147003e2f2 could not be found. Apr 13 16:34:29 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:34:29 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-8fcd35dd-1991-4bc6-87d3-2414e862dc99 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Returning 404 to user: Instance eaae47b9-a059-49f6-9ae6-d7147003e2f2 could not be found. {{(pid=62055) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 16:34:29 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-8fcd35dd-1991-4bc6-87d3-2414e862dc99 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eaae47b9-a059-49f6-9ae6-d7147003e2f2" status: 404 len: 111 microversion: 2.1 time: 0.031489 Apr 13 16:34:29 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 222/669] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:34:29 2023] GET /compute/v2.1/servers/eaae47b9-a059-49f6-9ae6-d7147003e2f2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 16:34:29 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-3994aeb5-b79f-44ae-bee7-8f63aa5b2787 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Calling method '.version_select at 0x7f96e4782950>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:34:29 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-3994aeb5-b79f-44ae-bee7-8f63aa5b2787 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1534458766" status: 202 len: 0 microversion: 2.1 time: 0.023013 Apr 13 16:34:29 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 225/670] 10.0.0.210 () {62 vars in 1298 bytes} [Thu Apr 13 16:34:29 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1534458766 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 13 16:34:31 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-0b769ee3-11bd-4c0f-80f3-86c6d376fa66 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Action: 'create', calling method: .version_select at 0x7f96e4759f30>, body: {"keypair": {"name": "tempest-keypair-2008404613", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLg/aZ/97WQm57BWlEGmEo0ZDYs6AZHEJTQdcUXAw6+zT4F/07+PSqHmlqw9dViVyDHhb8Ilq3sNANdJ79ikkzymwHsi3VIfAMe6DINfLbAXFmb5kKQf4wM+nlJI9ERH2Q=="}} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:34:31 user devstack@n-api.service[62054]: DEBUG nova.quota [None req-0b769ee3-11bd-4c0f-80f3-86c6d376fa66 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Getting quotas for project 24904988cf334657b084fd726c7ecf8f. Resources: {'key_pairs'} {{(pid=62054) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 16:34:31 user devstack@n-api.service[62054]: DEBUG nova.quota [None req-0b769ee3-11bd-4c0f-80f3-86c6d376fa66 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Getting quotas for user 47fab402fb794a5a9281cfb7fe188813 and project 24904988cf334657b084fd726c7ecf8f. Resources: {'key_pairs'} {{(pid=62054) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 16:34:31 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [req-92fb30e8-2fbb-4266-91f1-20ffcf3c6906 req-4a538fb8-1106-472f-9b00-659288884249 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acbcaee0-a47b-4fee-8765-9b1c9597d515", "name": "network-vif-plugged", "status": "completed", "tag": "13471516-9514-4b85-938f-69657c2990e5"}]} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:34:31 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-92fb30e8-2fbb-4266-91f1-20ffcf3c6906 req-4a538fb8-1106-472f-9b00-659288884249 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:34:31 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-92fb30e8-2fbb-4266-91f1-20ffcf3c6906 req-4a538fb8-1106-472f-9b00-659288884249 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:34:31 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-92fb30e8-2fbb-4266-91f1-20ffcf3c6906 req-4a538fb8-1106-472f-9b00-659288884249 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:34:31 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-92fb30e8-2fbb-4266-91f1-20ffcf3c6906 req-4a538fb8-1106-472f-9b00-659288884249 service nova] Creating event network-vif-plugged:13471516-9514-4b85-938f-69657c2990e5 for instance acbcaee0-a47b-4fee-8765-9b1c9597d515 on user Apr 13 16:34:31 user devstack@n-api.service[62055]: DEBUG nova.compute.api [req-92fb30e8-2fbb-4266-91f1-20ffcf3c6906 req-4a538fb8-1106-472f-9b00-659288884249 service nova] Instance acbcaee0-a47b-4fee-8765-9b1c9597d515 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=62055) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 13 16:34:31 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-0b769ee3-11bd-4c0f-80f3-86c6d376fa66 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.088614 Apr 13 16:34:31 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 224/671] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 13 16:34:31 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:34:31 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [req-92fb30e8-2fbb-4266-91f1-20ffcf3c6906 req-4a538fb8-1106-472f-9b00-659288884249 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064868 Apr 13 16:34:31 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 223/672] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:34:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:34:33 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_cell1:SELECT=10 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:34:33 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-3cab85d0-2217-48f7-9c24-00a036b66a84 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1992841975", "imageRef": "708622a9-7465-4492-ade8-b827198f7e30", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "79e9ef20-b14d-4850-b298-9d3ed4d10b90"}], "security_groups": [{"name": "tempest-securitygroup--1915937596"}], "key_name": "tempest-keypair-2008404613", "user_data": "}} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:34:33 user devstack@n-api.service[62053]: DEBUG nova.network.neutron [None req-3cab85d0-2217-48f7-9c24-00a036b66a84 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] validate_networks() for [('79e9ef20-b14d-4850-b298-9d3ed4d10b90', None, None, None, None, None)] {{(pid=62053) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 16:34:33 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-e8501dca-8974-43be-b569-1b2566b4ca8e req-740b804e-45b6-4f53-9b0c-9e9195fb07e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acbcaee0-a47b-4fee-8765-9b1c9597d515", "name": "network-vif-plugged", "status": "completed", "tag": "13471516-9514-4b85-938f-69657c2990e5"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:34:33 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-e8501dca-8974-43be-b569-1b2566b4ca8e req-740b804e-45b6-4f53-9b0c-9e9195fb07e6 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:34:33 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-e8501dca-8974-43be-b569-1b2566b4ca8e req-740b804e-45b6-4f53-9b0c-9e9195fb07e6 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:34:33 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-e8501dca-8974-43be-b569-1b2566b4ca8e req-740b804e-45b6-4f53-9b0c-9e9195fb07e6 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:34:33 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-e8501dca-8974-43be-b569-1b2566b4ca8e req-740b804e-45b6-4f53-9b0c-9e9195fb07e6 service nova] Creating event network-vif-plugged:13471516-9514-4b85-938f-69657c2990e5 for instance acbcaee0-a47b-4fee-8765-9b1c9597d515 on user Apr 13 16:34:33 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [req-e8501dca-8974-43be-b569-1b2566b4ca8e req-740b804e-45b6-4f53-9b0c-9e9195fb07e6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033136 Apr 13 16:34:33 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 225/673] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:34:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:34:33 user devstack@n-api.service[62053]: DEBUG nova.virt.hardware [None req-3cab85d0-2217-48f7-9c24-00a036b66a84 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Flavor limits 0:0:0 {{(pid=62053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 16:34:33 user devstack@n-api.service[62053]: DEBUG nova.virt.hardware [None req-3cab85d0-2217-48f7-9c24-00a036b66a84 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Image limits 0:0:0 {{(pid=62053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 16:34:33 user devstack@n-api.service[62053]: DEBUG nova.virt.hardware [None req-3cab85d0-2217-48f7-9c24-00a036b66a84 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Flavor pref 0:0:0 {{(pid=62053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 16:34:33 user devstack@n-api.service[62053]: DEBUG nova.virt.hardware [None req-3cab85d0-2217-48f7-9c24-00a036b66a84 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Image pref 0:0:0 {{(pid=62053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 16:34:33 user devstack@n-api.service[62053]: DEBUG nova.virt.hardware [None req-3cab85d0-2217-48f7-9c24-00a036b66a84 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 16:34:33 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-3cab85d0-2217-48f7-9c24-00a036b66a84 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:34:33 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-3cab85d0-2217-48f7-9c24-00a036b66a84 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:34:33 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-3cab85d0-2217-48f7-9c24-00a036b66a84 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:34:33 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-3cab85d0-2217-48f7-9c24-00a036b66a84 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:34:33 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-3cab85d0-2217-48f7-9c24-00a036b66a84 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:34:33 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-3cab85d0-2217-48f7-9c24-00a036b66a84 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:34:33 user devstack@n-api.service[62053]: DEBUG nova.quota [None req-3cab85d0-2217-48f7-9c24-00a036b66a84 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Getting quotas for project 24904988cf334657b084fd726c7ecf8f. Resources: {'instances', 'cores', 'ram'} {{(pid=62053) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 16:34:33 user devstack@n-api.service[62053]: DEBUG nova.quota [None req-3cab85d0-2217-48f7-9c24-00a036b66a84 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Getting quotas for user 47fab402fb794a5a9281cfb7fe188813 and project 24904988cf334657b084fd726c7ecf8f. Resources: {'instances', 'cores', 'ram'} {{(pid=62053) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 16:34:33 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-3cab85d0-2217-48f7-9c24-00a036b66a84 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Going to run 1 instances... {{(pid=62053) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 16:34:33 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-3cab85d0-2217-48f7-9c24-00a036b66a84 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='708622a9-7465-4492-ade8-b827198f7e30',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=62053) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 16:34:33 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-3cab85d0-2217-48f7-9c24-00a036b66a84 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.691557 Apr 13 16:34:33 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 226/674] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 16:34:33 2023] POST /compute/v2.1/servers => generated 400 bytes in 693 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 16:34:33 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-dd63401f-f458-453a-bf24-dc60b6078381 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:34:33 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-dd63401f-f458-453a-bf24-dc60b6078381 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:34:34 user devstack@n-api.service[62055]: DEBUG nova.policy [None req-dd63401f-f458-453a-bf24-dc60b6078381 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fab402fb794a5a9281cfb7fe188813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24904988cf334657b084fd726c7ecf8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62055) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:34:34 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-dd63401f-f458-453a-bf24-dc60b6078381 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f" status: 200 len: 1232 microversion: 2.1 time: 0.072830 Apr 13 16:34:34 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 224/675] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:34:33 2023] GET /compute/v2.1/servers/bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f => generated 1232 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:34:36 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-3ca1bbf6-6ce5-4f3e-98a3-5405a5d351de tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:34:36 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-3ca1bbf6-6ce5-4f3e-98a3-5405a5d351de tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:34:36 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-3ca1bbf6-6ce5-4f3e-98a3-5405a5d351de tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:34:36 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-3ca1bbf6-6ce5-4f3e-98a3-5405a5d351de tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:34:36 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-3ca1bbf6-6ce5-4f3e-98a3-5405a5d351de tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:34:36 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-3ca1bbf6-6ce5-4f3e-98a3-5405a5d351de tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:34:36 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-3ca1bbf6-6ce5-4f3e-98a3-5405a5d351de tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:34:36 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-3ca1bbf6-6ce5-4f3e-98a3-5405a5d351de tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:34:36 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-3ca1bbf6-6ce5-4f3e-98a3-5405a5d351de tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bf98c3a2-dbeb-4ae4-8423-ce55964c4258/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049735 Apr 13 16:34:36 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 226/676] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 16:34:36 2023] GET /compute/v2.1/servers/bf98c3a2-dbeb-4ae4-8423-ce55964c4258/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 16:34:36 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-d9432d90-3e8d-44e3-a70d-8fc8e83997ce req-bdf29c99-281b-4b1c-a8f0-41d165d2e511 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f", "tag": "adf9438c-79e3-494a-8650-1b7377eb1062"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:34:36 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-d9432d90-3e8d-44e3-a70d-8fc8e83997ce req-bdf29c99-281b-4b1c-a8f0-41d165d2e511 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:34:36 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-d9432d90-3e8d-44e3-a70d-8fc8e83997ce req-bdf29c99-281b-4b1c-a8f0-41d165d2e511 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:34:36 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-d9432d90-3e8d-44e3-a70d-8fc8e83997ce req-bdf29c99-281b-4b1c-a8f0-41d165d2e511 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:34:36 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-d9432d90-3e8d-44e3-a70d-8fc8e83997ce req-bdf29c99-281b-4b1c-a8f0-41d165d2e511 service nova] Creating event network-changed:adf9438c-79e3-494a-8650-1b7377eb1062 for instance bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f on user Apr 13 16:34:36 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [req-d9432d90-3e8d-44e3-a70d-8fc8e83997ce req-bdf29c99-281b-4b1c-a8f0-41d165d2e511 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033193 Apr 13 16:34:36 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 227/677] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:34:36 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:34:38 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [req-18a296b1-08cd-46ec-bb4b-4bf20fa8f76b req-0531d690-7b2e-4488-a5a2-5bbd6b93050f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f", "name": "network-vif-plugged", "status": "completed", "tag": "adf9438c-79e3-494a-8650-1b7377eb1062"}]} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:34:38 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-18a296b1-08cd-46ec-bb4b-4bf20fa8f76b req-0531d690-7b2e-4488-a5a2-5bbd6b93050f service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:34:38 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-18a296b1-08cd-46ec-bb4b-4bf20fa8f76b req-0531d690-7b2e-4488-a5a2-5bbd6b93050f service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:34:38 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-18a296b1-08cd-46ec-bb4b-4bf20fa8f76b req-0531d690-7b2e-4488-a5a2-5bbd6b93050f service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:34:38 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-18a296b1-08cd-46ec-bb4b-4bf20fa8f76b req-0531d690-7b2e-4488-a5a2-5bbd6b93050f service nova] Creating event network-vif-plugged:adf9438c-79e3-494a-8650-1b7377eb1062 for instance bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f on user Apr 13 16:34:38 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [req-18a296b1-08cd-46ec-bb4b-4bf20fa8f76b req-0531d690-7b2e-4488-a5a2-5bbd6b93050f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048038 Apr 13 16:34:38 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 225/678] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:34:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:34:40 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-f1fd69ce-873d-4f6d-93ba-797f0dd579b4 req-6f07f75c-50d6-483f-bfdd-dbed1734a0ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f", "name": "network-vif-plugged", "status": "completed", "tag": "adf9438c-79e3-494a-8650-1b7377eb1062"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:34:40 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-f1fd69ce-873d-4f6d-93ba-797f0dd579b4 req-6f07f75c-50d6-483f-bfdd-dbed1734a0ec service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:34:40 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-f1fd69ce-873d-4f6d-93ba-797f0dd579b4 req-6f07f75c-50d6-483f-bfdd-dbed1734a0ec service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:34:40 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-f1fd69ce-873d-4f6d-93ba-797f0dd579b4 req-6f07f75c-50d6-483f-bfdd-dbed1734a0ec service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:34:40 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-f1fd69ce-873d-4f6d-93ba-797f0dd579b4 req-6f07f75c-50d6-483f-bfdd-dbed1734a0ec service nova] Creating event network-vif-plugged:adf9438c-79e3-494a-8650-1b7377eb1062 for instance bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f on user Apr 13 16:34:40 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [req-f1fd69ce-873d-4f6d-93ba-797f0dd579b4 req-6f07f75c-50d6-483f-bfdd-dbed1734a0ec service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034175 Apr 13 16:34:40 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 227/679] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:34:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:34:41 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-7b7550fa-ef4e-42a2-9250-f37b822066cb tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:34:41 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-7b7550fa-ef4e-42a2-9250-f37b822066cb tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:34:41 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-7b7550fa-ef4e-42a2-9250-f37b822066cb tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:34:41 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-7b7550fa-ef4e-42a2-9250-f37b822066cb tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:34:41 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-7b7550fa-ef4e-42a2-9250-f37b822066cb tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:34:41 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-7b7550fa-ef4e-42a2-9250-f37b822066cb tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:34:41 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-7b7550fa-ef4e-42a2-9250-f37b822066cb tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:34:41 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-7b7550fa-ef4e-42a2-9250-f37b822066cb tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:34:41 user devstack@n-api.service[62053]: DEBUG nova.policy [None req-7b7550fa-ef4e-42a2-9250-f37b822066cb tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b4e972cd1049509fa899449961ab59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0653ab16660b46cea9c5af58ea0b1931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62053) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:34:41 user devstack@n-api.service[62053]: DEBUG nova.policy [None req-7b7550fa-ef4e-42a2-9250-f37b822066cb tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48b4e972cd1049509fa899449961ab59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0653ab16660b46cea9c5af58ea0b1931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62053) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:34:41 user devstack@n-api.service[62053]: DEBUG nova.policy [None req-7b7550fa-ef4e-42a2-9250-f37b822066cb tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48b4e972cd1049509fa899449961ab59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0653ab16660b46cea9c5af58ea0b1931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62053) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:34:41 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-7b7550fa-ef4e-42a2-9250-f37b822066cb tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] 10.0.0.210 "GET /compute/v2.1/servers/35b23303-e373-4f35-b7ee-76e6815073ce" status: 200 len: 1654 microversion: 2.20 time: 0.215595 Apr 13 16:34:41 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 228/680] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 16:34:41 2023] GET /compute/v2.1/servers/35b23303-e373-4f35-b7ee-76e6815073ce => generated 1654 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 16:34:43 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-13d69e6c-c131-48ce-8f03-fb647a537d0c tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:34:43 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-13d69e6c-c131-48ce-8f03-fb647a537d0c tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] [instance: 64a9c052-89a9-48ba-80c9-13fb5ef22f0e] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:34:43 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-13d69e6c-c131-48ce-8f03-fb647a537d0c tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:34:43 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-13d69e6c-c131-48ce-8f03-fb647a537d0c tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:34:43 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-13d69e6c-c131-48ce-8f03-fb647a537d0c tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:34:43 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-13d69e6c-c131-48ce-8f03-fb647a537d0c tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:34:43 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-13d69e6c-c131-48ce-8f03-fb647a537d0c tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:34:43 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-13d69e6c-c131-48ce-8f03-fb647a537d0c tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:34:43 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-13d69e6c-c131-48ce-8f03-fb647a537d0c tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] 10.0.0.210 "GET /compute/v2.1/servers/64a9c052-89a9-48ba-80c9-13fb5ef22f0e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047615 Apr 13 16:34:43 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 226/681] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 16:34:43 2023] GET /compute/v2.1/servers/64a9c052-89a9-48ba-80c9-13fb5ef22f0e/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 16:34:44 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_cell0:SELECT=4 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:34:44 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-3c7c226d-8f7f-4b79-841e-a344af0b8994 req-192a5bb7-8683-4942-944d-e76634a99d73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64a9c052-89a9-48ba-80c9-13fb5ef22f0e", "tag": "5128334f-7255-4a56-9e8b-1151027d219b"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:34:44 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-77e4f4c5-8794-4f04-af1c-9901bc637f9b tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:34:44 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-77e4f4c5-8794-4f04-af1c-9901bc637f9b tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] [instance: 64a9c052-89a9-48ba-80c9-13fb5ef22f0e] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:34:44 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_cell0:SELECT=2 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:34:44 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_cell0:SELECT=6 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:34:44 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-77e4f4c5-8794-4f04-af1c-9901bc637f9b tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:34:44 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-77e4f4c5-8794-4f04-af1c-9901bc637f9b tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:34:44 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-77e4f4c5-8794-4f04-af1c-9901bc637f9b tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:34:44 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-77e4f4c5-8794-4f04-af1c-9901bc637f9b tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:34:44 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-77e4f4c5-8794-4f04-af1c-9901bc637f9b tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:34:44 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-77e4f4c5-8794-4f04-af1c-9901bc637f9b tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:34:44 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-3c7c226d-8f7f-4b79-841e-a344af0b8994 req-192a5bb7-8683-4942-944d-e76634a99d73 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:34:44 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-3c7c226d-8f7f-4b79-841e-a344af0b8994 req-192a5bb7-8683-4942-944d-e76634a99d73 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:34:44 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-3c7c226d-8f7f-4b79-841e-a344af0b8994 req-192a5bb7-8683-4942-944d-e76634a99d73 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:34:44 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-3c7c226d-8f7f-4b79-841e-a344af0b8994 req-192a5bb7-8683-4942-944d-e76634a99d73 service nova] Creating event network-changed:5128334f-7255-4a56-9e8b-1151027d219b for instance 64a9c052-89a9-48ba-80c9-13fb5ef22f0e on user Apr 13 16:34:44 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [req-3c7c226d-8f7f-4b79-841e-a344af0b8994 req-192a5bb7-8683-4942-944d-e76634a99d73 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035992 Apr 13 16:34:44 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 229/682] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:34:44 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:34:44 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-77e4f4c5-8794-4f04-af1c-9901bc637f9b tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] [instance: 64a9c052-89a9-48ba-80c9-13fb5ef22f0e] Going to try to terminate instance {{(pid=62054) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 16:34:44 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-77e4f4c5-8794-4f04-af1c-9901bc637f9b tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/64a9c052-89a9-48ba-80c9-13fb5ef22f0e" status: 204 len: 0 microversion: 2.1 time: 0.158767 Apr 13 16:34:44 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 228/683] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 16:34:44 2023] DELETE /compute/v2.1/servers/64a9c052-89a9-48ba-80c9-13fb5ef22f0e => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 16:34:44 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-db564f32-5b2a-4743-bc7f-8fb3c9a816f1 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:34:44 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-db564f32-5b2a-4743-bc7f-8fb3c9a816f1 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] [instance: 64a9c052-89a9-48ba-80c9-13fb5ef22f0e] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:34:44 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_cell0:SELECT=2 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:34:44 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-db564f32-5b2a-4743-bc7f-8fb3c9a816f1 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:34:44 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-db564f32-5b2a-4743-bc7f-8fb3c9a816f1 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:34:44 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-db564f32-5b2a-4743-bc7f-8fb3c9a816f1 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:34:44 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-db564f32-5b2a-4743-bc7f-8fb3c9a816f1 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:34:44 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-db564f32-5b2a-4743-bc7f-8fb3c9a816f1 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:34:44 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-db564f32-5b2a-4743-bc7f-8fb3c9a816f1 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:34:44 user devstack@n-api.service[62055]: DEBUG nova.policy [None req-db564f32-5b2a-4743-bc7f-8fb3c9a816f1 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f523740272844b6eb236477d0b116ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7100b359f341759cb6f6753e1539a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62055) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:34:44 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-db564f32-5b2a-4743-bc7f-8fb3c9a816f1 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] 10.0.0.210 "GET /compute/v2.1/servers/64a9c052-89a9-48ba-80c9-13fb5ef22f0e" status: 200 len: 1662 microversion: 2.1 time: 0.214569 Apr 13 16:34:44 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 227/684] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:34:44 2023] GET /compute/v2.1/servers/64a9c052-89a9-48ba-80c9-13fb5ef22f0e => generated 1662 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:34:44 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-7b7ab909-85f1-48bc-9b6c-dd1bef58b795 req-64f4a14f-321b-4d2f-9b84-d9e59145c79e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64a9c052-89a9-48ba-80c9-13fb5ef22f0e", "name": "network-vif-unplugged", "status": "completed", "tag": "5128334f-7255-4a56-9e8b-1151027d219b"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:34:44 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-7b7ab909-85f1-48bc-9b6c-dd1bef58b795 req-64f4a14f-321b-4d2f-9b84-d9e59145c79e service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:34:44 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-7b7ab909-85f1-48bc-9b6c-dd1bef58b795 req-64f4a14f-321b-4d2f-9b84-d9e59145c79e service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:34:44 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-7b7ab909-85f1-48bc-9b6c-dd1bef58b795 req-64f4a14f-321b-4d2f-9b84-d9e59145c79e service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:34:44 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-7b7ab909-85f1-48bc-9b6c-dd1bef58b795 req-64f4a14f-321b-4d2f-9b84-d9e59145c79e service nova] Creating event network-vif-unplugged:5128334f-7255-4a56-9e8b-1151027d219b for instance 64a9c052-89a9-48ba-80c9-13fb5ef22f0e on user Apr 13 16:34:44 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [req-7b7ab909-85f1-48bc-9b6c-dd1bef58b795 req-64f4a14f-321b-4d2f-9b84-d9e59145c79e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034927 Apr 13 16:34:44 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 230/685] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:34:44 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:34:46 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-36829aff-60de-49c9-8895-f8ab421d9eb1 req-6d4a5704-e96c-4bb2-9618-b7cbd95a565d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64a9c052-89a9-48ba-80c9-13fb5ef22f0e", "name": "network-vif-plugged", "status": "completed", "tag": "5128334f-7255-4a56-9e8b-1151027d219b"}, {"server_uuid": "64a9c052-89a9-48ba-80c9-13fb5ef22f0e", "name": "network-vif-deleted", "tag": "5128334f-7255-4a56-9e8b-1151027d219b"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:34:46 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-36829aff-60de-49c9-8895-f8ab421d9eb1 req-6d4a5704-e96c-4bb2-9618-b7cbd95a565d service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:34:46 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-36829aff-60de-49c9-8895-f8ab421d9eb1 req-6d4a5704-e96c-4bb2-9618-b7cbd95a565d service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:34:46 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-36829aff-60de-49c9-8895-f8ab421d9eb1 req-6d4a5704-e96c-4bb2-9618-b7cbd95a565d service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:34:46 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-36829aff-60de-49c9-8895-f8ab421d9eb1 req-6d4a5704-e96c-4bb2-9618-b7cbd95a565d service nova] Creating event network-vif-plugged:5128334f-7255-4a56-9e8b-1151027d219b for instance 64a9c052-89a9-48ba-80c9-13fb5ef22f0e on user Apr 13 16:34:46 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-36829aff-60de-49c9-8895-f8ab421d9eb1 req-6d4a5704-e96c-4bb2-9618-b7cbd95a565d service nova] Creating event network-vif-deleted:5128334f-7255-4a56-9e8b-1151027d219b for instance 64a9c052-89a9-48ba-80c9-13fb5ef22f0e on user Apr 13 16:34:46 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [req-36829aff-60de-49c9-8895-f8ab421d9eb1 req-6d4a5704-e96c-4bb2-9618-b7cbd95a565d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.033316 Apr 13 16:34:46 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 229/686] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:34:46 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:34:50 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [req-44fd9452-378a-4056-b14c-6a6f8ad63b4d req-24f513e5-8e71-4473-b862-19bc234ae510 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf98c3a2-dbeb-4ae4-8423-ce55964c4258", "tag": "58361670-0371-4eb7-83b9-ce67bf2a67bb"}]} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:34:50 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:34:50 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-44fd9452-378a-4056-b14c-6a6f8ad63b4d req-24f513e5-8e71-4473-b862-19bc234ae510 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:34:50 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-44fd9452-378a-4056-b14c-6a6f8ad63b4d req-24f513e5-8e71-4473-b862-19bc234ae510 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:34:50 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-44fd9452-378a-4056-b14c-6a6f8ad63b4d req-24f513e5-8e71-4473-b862-19bc234ae510 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:34:50 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:34:50 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-44fd9452-378a-4056-b14c-6a6f8ad63b4d req-24f513e5-8e71-4473-b862-19bc234ae510 service nova] Creating event network-changed:58361670-0371-4eb7-83b9-ce67bf2a67bb for instance bf98c3a2-dbeb-4ae4-8423-ce55964c4258 on user Apr 13 16:34:50 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [req-44fd9452-378a-4056-b14c-6a6f8ad63b4d req-24f513e5-8e71-4473-b862-19bc234ae510 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043333 Apr 13 16:34:50 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 228/687] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:34:50 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 16:34:52 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-e3154b08-c321-4ce5-bfbf-0842a35ded65 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:34:52 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-e3154b08-c321-4ce5-bfbf-0842a35ded65 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:34:52 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_api:SELECT=31,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:34:52 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-e3154b08-c321-4ce5-bfbf-0842a35ded65 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:34:52 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-e3154b08-c321-4ce5-bfbf-0842a35ded65 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:34:52 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-e3154b08-c321-4ce5-bfbf-0842a35ded65 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:34:52 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-e3154b08-c321-4ce5-bfbf-0842a35ded65 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:34:52 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-e3154b08-c321-4ce5-bfbf-0842a35ded65 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:34:52 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-e3154b08-c321-4ce5-bfbf-0842a35ded65 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:34:52 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-e3154b08-c321-4ce5-bfbf-0842a35ded65 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] Going to try to terminate instance {{(pid=62053) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 16:34:52 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-e3154b08-c321-4ce5-bfbf-0842a35ded65 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/bf98c3a2-dbeb-4ae4-8423-ce55964c4258" status: 204 len: 0 microversion: 2.1 time: 0.152405 Apr 13 16:34:52 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 231/688] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 16:34:52 2023] DELETE /compute/v2.1/servers/bf98c3a2-dbeb-4ae4-8423-ce55964c4258 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 16:34:52 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-b0b31683-98a1-4196-809f-a207b1cd9d63 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:34:52 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-b0b31683-98a1-4196-809f-a207b1cd9d63 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:34:52 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:34:52 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-b0b31683-98a1-4196-809f-a207b1cd9d63 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:34:52 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-b0b31683-98a1-4196-809f-a207b1cd9d63 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:34:52 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-b0b31683-98a1-4196-809f-a207b1cd9d63 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:34:52 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-b0b31683-98a1-4196-809f-a207b1cd9d63 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:34:52 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-b0b31683-98a1-4196-809f-a207b1cd9d63 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:34:52 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-b0b31683-98a1-4196-809f-a207b1cd9d63 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:34:52 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:34:53 user devstack@n-api.service[62054]: DEBUG nova.policy [None req-b0b31683-98a1-4196-809f-a207b1cd9d63 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1318d817c48e40988e043fa33e908312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e15bc7bee7466a840fb0d0e85d58bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62054) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:34:53 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-b0b31683-98a1-4196-809f-a207b1cd9d63 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bf98c3a2-dbeb-4ae4-8423-ce55964c4258" status: 200 len: 1573 microversion: 2.1 time: 0.262669 Apr 13 16:34:53 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 230/689] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:34:52 2023] GET /compute/v2.1/servers/bf98c3a2-dbeb-4ae4-8423-ce55964c4258 => generated 1573 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:34:53 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [req-8e2313fa-ee57-4759-8501-978c860c31ed req-9c33a0d4-c790-4692-baf3-4fd601b0a09a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf98c3a2-dbeb-4ae4-8423-ce55964c4258", "name": "network-vif-unplugged", "status": "completed", "tag": "58361670-0371-4eb7-83b9-ce67bf2a67bb"}]} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:34:53 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-8e2313fa-ee57-4759-8501-978c860c31ed req-9c33a0d4-c790-4692-baf3-4fd601b0a09a service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:34:53 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-8e2313fa-ee57-4759-8501-978c860c31ed req-9c33a0d4-c790-4692-baf3-4fd601b0a09a service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:34:53 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-8e2313fa-ee57-4759-8501-978c860c31ed req-9c33a0d4-c790-4692-baf3-4fd601b0a09a service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:34:53 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-8e2313fa-ee57-4759-8501-978c860c31ed req-9c33a0d4-c790-4692-baf3-4fd601b0a09a service nova] Creating event network-vif-unplugged:58361670-0371-4eb7-83b9-ce67bf2a67bb for instance bf98c3a2-dbeb-4ae4-8423-ce55964c4258 on user Apr 13 16:34:53 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [req-8e2313fa-ee57-4759-8501-978c860c31ed req-9c33a0d4-c790-4692-baf3-4fd601b0a09a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034350 Apr 13 16:34:53 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 229/690] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:34:53 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:34:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-82d59b6d-a7a4-4baf-a994-ccc311f124d8 req-5ff77f5e-1d51-4f79-974e-9af6e996b439 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf98c3a2-dbeb-4ae4-8423-ce55964c4258", "name": "network-vif-deleted", "tag": "58361670-0371-4eb7-83b9-ce67bf2a67bb"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:34:54 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-82d59b6d-a7a4-4baf-a994-ccc311f124d8 req-5ff77f5e-1d51-4f79-974e-9af6e996b439 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:34:54 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-82d59b6d-a7a4-4baf-a994-ccc311f124d8 req-5ff77f5e-1d51-4f79-974e-9af6e996b439 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:34:54 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-82d59b6d-a7a4-4baf-a994-ccc311f124d8 req-5ff77f5e-1d51-4f79-974e-9af6e996b439 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:34:54 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-82d59b6d-a7a4-4baf-a994-ccc311f124d8 req-5ff77f5e-1d51-4f79-974e-9af6e996b439 service nova] Creating event network-vif-deleted:58361670-0371-4eb7-83b9-ce67bf2a67bb for instance bf98c3a2-dbeb-4ae4-8423-ce55964c4258 on user Apr 13 16:34:54 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [req-82d59b6d-a7a4-4baf-a994-ccc311f124d8 req-5ff77f5e-1d51-4f79-974e-9af6e996b439 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034194 Apr 13 16:34:54 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 232/691] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:34:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:34:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-ea01cffd-8c6a-4e0a-8c09-ae28d6ac014c req-6118a450-ec52-46a3-9558-78d4e39ac448 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf98c3a2-dbeb-4ae4-8423-ce55964c4258", "name": "network-vif-plugged", "status": "completed", "tag": "58361670-0371-4eb7-83b9-ce67bf2a67bb"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:34:55 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-ea01cffd-8c6a-4e0a-8c09-ae28d6ac014c req-6118a450-ec52-46a3-9558-78d4e39ac448 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:34:55 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-ea01cffd-8c6a-4e0a-8c09-ae28d6ac014c req-6118a450-ec52-46a3-9558-78d4e39ac448 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:34:55 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-ea01cffd-8c6a-4e0a-8c09-ae28d6ac014c req-6118a450-ec52-46a3-9558-78d4e39ac448 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:34:55 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-ea01cffd-8c6a-4e0a-8c09-ae28d6ac014c req-6118a450-ec52-46a3-9558-78d4e39ac448 service nova] Creating event network-vif-plugged:58361670-0371-4eb7-83b9-ce67bf2a67bb for instance bf98c3a2-dbeb-4ae4-8423-ce55964c4258 on user Apr 13 16:34:55 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [req-ea01cffd-8c6a-4e0a-8c09-ae28d6ac014c req-6118a450-ec52-46a3-9558-78d4e39ac448 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035501 Apr 13 16:34:55 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 231/692] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:34:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:35:08 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_api:SELECT=3 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:35:08 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_cell1:SELECT=3 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:35:08 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-bddc38d8-ebd9-4d83-9555-0f56a142a9a5 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:35:08 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-bddc38d8-ebd9-4d83-9555-0f56a142a9a5 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:35:08 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-bddc38d8-ebd9-4d83-9555-0f56a142a9a5 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:35:08 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-bddc38d8-ebd9-4d83-9555-0f56a142a9a5 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:35:08 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-bddc38d8-ebd9-4d83-9555-0f56a142a9a5 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:35:08 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-bddc38d8-ebd9-4d83-9555-0f56a142a9a5 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:35:08 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-bddc38d8-ebd9-4d83-9555-0f56a142a9a5 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:35:08 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-bddc38d8-ebd9-4d83-9555-0f56a142a9a5 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:35:08 user devstack@n-api.service[62055]: DEBUG nova.policy [None req-bddc38d8-ebd9-4d83-9555-0f56a142a9a5 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b3df1c5c5d441819bcef89ed6966815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980559734a504574a83224deb7423c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62055) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:35:08 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-bddc38d8-ebd9-4d83-9555-0f56a142a9a5 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] 10.0.0.210 "GET /compute/v2.1/servers/acbcaee0-a47b-4fee-8765-9b1c9597d515" status: 200 len: 1723 microversion: 2.1 time: 0.330211 Apr 13 16:35:08 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 230/693] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:35:08 2023] GET /compute/v2.1/servers/acbcaee0-a47b-4fee-8765-9b1c9597d515 => generated 1723 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:35:18 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_api:SELECT=8,nova_api:UPDATE=1 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:35:18 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:35:18 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-9cb6e9ce-bb20-4ad3-81c7-943dbd07df56 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:35:18 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-9cb6e9ce-bb20-4ad3-81c7-943dbd07df56 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 220e1c3e-1378-46fc-acc1-ee1bafac7722] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:35:18 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-9cb6e9ce-bb20-4ad3-81c7-943dbd07df56 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:35:18 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-9cb6e9ce-bb20-4ad3-81c7-943dbd07df56 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:35:18 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-9cb6e9ce-bb20-4ad3-81c7-943dbd07df56 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:35:18 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-9cb6e9ce-bb20-4ad3-81c7-943dbd07df56 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:35:18 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-9cb6e9ce-bb20-4ad3-81c7-943dbd07df56 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:35:18 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-9cb6e9ce-bb20-4ad3-81c7-943dbd07df56 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:35:18 user devstack@n-api.service[62053]: DEBUG nova.policy [None req-9cb6e9ce-bb20-4ad3-81c7-943dbd07df56 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e10f63cdd49a9a1ebe1fe4c9de0a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d451e0e239f486aa2b3abe9e273eab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62053) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:35:18 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-9cb6e9ce-bb20-4ad3-81c7-943dbd07df56 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] 10.0.0.210 "GET /compute/v2.1/servers/220e1c3e-1378-46fc-acc1-ee1bafac7722" status: 200 len: 1441 microversion: 2.1 time: 0.159466 Apr 13 16:35:18 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 233/694] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:35:18 2023] GET /compute/v2.1/servers/220e1c3e-1378-46fc-acc1-ee1bafac7722 => generated 1441 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:35:20 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_api:SELECT=3 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:35:20 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_cell1:SELECT=7 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:35:20 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-5b40abc7-df34-4f75-8ee1-5b9b4b2708ee req-a5a4ecc6-c41f-4ed5-9ddb-b439464600ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "220e1c3e-1378-46fc-acc1-ee1bafac7722", "tag": "96415b19-4e1b-41c6-a070-cff24e7b20ab"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:35:20 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-5b40abc7-df34-4f75-8ee1-5b9b4b2708ee req-a5a4ecc6-c41f-4ed5-9ddb-b439464600ac service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:35:20 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-5b40abc7-df34-4f75-8ee1-5b9b4b2708ee req-a5a4ecc6-c41f-4ed5-9ddb-b439464600ac service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:35:20 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-5b40abc7-df34-4f75-8ee1-5b9b4b2708ee req-a5a4ecc6-c41f-4ed5-9ddb-b439464600ac service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:35:20 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-5b40abc7-df34-4f75-8ee1-5b9b4b2708ee req-a5a4ecc6-c41f-4ed5-9ddb-b439464600ac service nova] Creating event network-changed:96415b19-4e1b-41c6-a070-cff24e7b20ab for instance 220e1c3e-1378-46fc-acc1-ee1bafac7722 on user Apr 13 16:35:20 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [req-5b40abc7-df34-4f75-8ee1-5b9b4b2708ee req-a5a4ecc6-c41f-4ed5-9ddb-b439464600ac service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036647 Apr 13 16:35:20 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 232/695] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:35:20 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:35:24 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_api:SELECT=2 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:35:24 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_cell1:SELECT=6 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:35:24 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-92e2ae42-b71b-46cd-a505-f18133968d9e tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:35:24 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-92e2ae42-b71b-46cd-a505-f18133968d9e tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:35:24 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-92e2ae42-b71b-46cd-a505-f18133968d9e tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:35:24 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-92e2ae42-b71b-46cd-a505-f18133968d9e tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:35:24 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-92e2ae42-b71b-46cd-a505-f18133968d9e tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:35:24 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-92e2ae42-b71b-46cd-a505-f18133968d9e tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:35:24 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-92e2ae42-b71b-46cd-a505-f18133968d9e tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:35:24 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-92e2ae42-b71b-46cd-a505-f18133968d9e tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:35:24 user devstack@n-api.service[62055]: DEBUG nova.policy [None req-92e2ae42-b71b-46cd-a505-f18133968d9e tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fab402fb794a5a9281cfb7fe188813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24904988cf334657b084fd726c7ecf8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62055) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:35:24 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-92e2ae42-b71b-46cd-a505-f18133968d9e tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f" status: 200 len: 1539 microversion: 2.1 time: 0.248596 Apr 13 16:35:24 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 231/696] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:35:24 2023] GET /compute/v2.1/servers/bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f => generated 1539 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:35:25 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-f0fee77d-5df3-49a9-b399-186a74b7ece1 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1235436858", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestVolumeBootPattern-1747083001", "security_groups": [{"name": "tempest-secgroup-smoke-1493908618"}], "block_device_mapping_v2": [{"uuid": "b4a5ced3-77ae-4bf5-8154-bd1645e470f2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d36bc206-f629-4d6e-8a3f-458061d7b525"}]}} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:35:25 user devstack@n-api.service[62053]: DEBUG nova.network.neutron [None req-f0fee77d-5df3-49a9-b399-186a74b7ece1 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] validate_networks() for [('d36bc206-f629-4d6e-8a3f-458061d7b525', None, None, None, None, None)] {{(pid=62053) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 16:35:26 user devstack@n-api.service[62053]: DEBUG nova.virt.hardware [None req-f0fee77d-5df3-49a9-b399-186a74b7ece1 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Flavor limits 0:0:0 {{(pid=62053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 16:35:26 user devstack@n-api.service[62053]: DEBUG nova.virt.hardware [None req-f0fee77d-5df3-49a9-b399-186a74b7ece1 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Image limits 0:0:0 {{(pid=62053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 16:35:26 user devstack@n-api.service[62053]: DEBUG nova.virt.hardware [None req-f0fee77d-5df3-49a9-b399-186a74b7ece1 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Flavor pref 0:0:0 {{(pid=62053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 16:35:26 user devstack@n-api.service[62053]: DEBUG nova.virt.hardware [None req-f0fee77d-5df3-49a9-b399-186a74b7ece1 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Image pref 0:0:0 {{(pid=62053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 16:35:26 user devstack@n-api.service[62053]: DEBUG nova.virt.hardware [None req-f0fee77d-5df3-49a9-b399-186a74b7ece1 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 16:35:26 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-f0fee77d-5df3-49a9-b399-186a74b7ece1 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:35:26 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-f0fee77d-5df3-49a9-b399-186a74b7ece1 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:35:26 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-f0fee77d-5df3-49a9-b399-186a74b7ece1 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:35:26 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-f0fee77d-5df3-49a9-b399-186a74b7ece1 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:35:26 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-f0fee77d-5df3-49a9-b399-186a74b7ece1 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:35:26 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-f0fee77d-5df3-49a9-b399-186a74b7ece1 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:35:26 user devstack@n-api.service[62053]: DEBUG nova.quota [None req-f0fee77d-5df3-49a9-b399-186a74b7ece1 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Getting quotas for project 8d451e0e239f486aa2b3abe9e273eab3. Resources: {'instances', 'cores', 'ram'} {{(pid=62053) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 16:35:26 user devstack@n-api.service[62053]: DEBUG nova.quota [None req-f0fee77d-5df3-49a9-b399-186a74b7ece1 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Getting quotas for user d70e10f63cdd49a9a1ebe1fe4c9de0a2 and project 8d451e0e239f486aa2b3abe9e273eab3. Resources: {'instances', 'cores', 'ram'} {{(pid=62053) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 16:35:26 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-f0fee77d-5df3-49a9-b399-186a74b7ece1 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Going to run 1 instances... {{(pid=62053) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 16:35:26 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-f0fee77d-5df3-49a9-b399-186a74b7ece1 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 0a5c9b2c-fe1e-4a21-b213-c63e2c28748a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b4a5ced3-77ae-4bf5-8154-bd1645e470f2',volume_size=None,volume_type=None)] {{(pid=62053) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 16:35:26 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-f0fee77d-5df3-49a9-b399-186a74b7ece1 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.011236 Apr 13 16:35:26 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 234/697] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 16:35:25 2023] POST /compute/v2.1/servers => generated 404 bytes in 1013 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Apr 13 16:35:26 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-80b11834-9440-4df7-b75f-f97f287fce6e tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:35:26 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-80b11834-9440-4df7-b75f-f97f287fce6e tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 0a5c9b2c-fe1e-4a21-b213-c63e2c28748a] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:35:26 user devstack@n-api.service[62054]: DEBUG nova.policy [None req-80b11834-9440-4df7-b75f-f97f287fce6e tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e10f63cdd49a9a1ebe1fe4c9de0a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d451e0e239f486aa2b3abe9e273eab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62054) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:35:26 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-80b11834-9440-4df7-b75f-f97f287fce6e tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0a5c9b2c-fe1e-4a21-b213-c63e2c28748a" status: 200 len: 1090 microversion: 2.1 time: 0.121139 Apr 13 16:35:26 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 233/698] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:35:26 2023] GET /compute/v2.1/servers/0a5c9b2c-fe1e-4a21-b213-c63e2c28748a => generated 1090 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:35:28 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-2fccdc3f-0e9a-4471-9d2d-2ce5b7220492 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:35:28 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-2fccdc3f-0e9a-4471-9d2d-2ce5b7220492 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:35:28 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-2fccdc3f-0e9a-4471-9d2d-2ce5b7220492 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:35:28 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-2fccdc3f-0e9a-4471-9d2d-2ce5b7220492 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:35:28 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-2fccdc3f-0e9a-4471-9d2d-2ce5b7220492 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:35:28 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-2fccdc3f-0e9a-4471-9d2d-2ce5b7220492 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:35:28 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-2fccdc3f-0e9a-4471-9d2d-2ce5b7220492 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:35:28 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-2fccdc3f-0e9a-4471-9d2d-2ce5b7220492 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:35:28 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-2fccdc3f-0e9a-4471-9d2d-2ce5b7220492 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] 10.0.0.210 "POST /compute/v2.1/servers/2956ab05-28ff-4c9e-b646-dbb83b3db278/action" status: 202 len: 0 microversion: 2.87 time: 0.091771 Apr 13 16:35:28 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 232/699] 10.0.0.210 () {66 vars in 1396 bytes} [Thu Apr 13 16:35:28 2023] POST /compute/v2.1/servers/2956ab05-28ff-4c9e-b646-dbb83b3db278/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 13 16:35:28 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-3755fa19-6c18-4a43-b631-d13f8e9565ce tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:35:28 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-3755fa19-6c18-4a43-b631-d13f8e9565ce tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:35:28 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-3755fa19-6c18-4a43-b631-d13f8e9565ce tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:35:28 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-3755fa19-6c18-4a43-b631-d13f8e9565ce tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:35:28 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-3755fa19-6c18-4a43-b631-d13f8e9565ce tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:35:28 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-3755fa19-6c18-4a43-b631-d13f8e9565ce tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:35:28 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-3755fa19-6c18-4a43-b631-d13f8e9565ce tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:35:28 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-3755fa19-6c18-4a43-b631-d13f8e9565ce tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:35:28 user devstack@n-api.service[62053]: DEBUG nova.policy [None req-3755fa19-6c18-4a43-b631-d13f8e9565ce tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45a882dbafb4ea4976e4f45289eb2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d09a74bf684a9fb1dd1e95d6c23f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62053) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:35:28 user devstack@n-api.service[62053]: DEBUG nova.policy [None req-3755fa19-6c18-4a43-b631-d13f8e9565ce tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e45a882dbafb4ea4976e4f45289eb2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d09a74bf684a9fb1dd1e95d6c23f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62053) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:35:28 user devstack@n-api.service[62053]: DEBUG nova.policy [None req-3755fa19-6c18-4a43-b631-d13f8e9565ce tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e45a882dbafb4ea4976e4f45289eb2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d09a74bf684a9fb1dd1e95d6c23f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62053) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:35:28 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-3755fa19-6c18-4a43-b631-d13f8e9565ce tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2956ab05-28ff-4c9e-b646-dbb83b3db278" status: 200 len: 1762 microversion: 2.87 time: 0.324977 Apr 13 16:35:28 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 235/700] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 16:35:28 2023] GET /compute/v2.1/servers/2956ab05-28ff-4c9e-b646-dbb83b3db278 => generated 1762 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 13 16:35:29 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-6fd26fb8-eb27-4700-bd47-3aee0dde1d1b req-e282047e-d934-4ade-8d51-522eaed35211 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a5c9b2c-fe1e-4a21-b213-c63e2c28748a", "tag": "ee0eba83-c6e1-4415-96d1-e5b496ec0afe"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:35:29 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-6fd26fb8-eb27-4700-bd47-3aee0dde1d1b req-e282047e-d934-4ade-8d51-522eaed35211 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:35:29 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-6fd26fb8-eb27-4700-bd47-3aee0dde1d1b req-e282047e-d934-4ade-8d51-522eaed35211 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:35:29 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-6fd26fb8-eb27-4700-bd47-3aee0dde1d1b req-e282047e-d934-4ade-8d51-522eaed35211 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:35:29 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-6fd26fb8-eb27-4700-bd47-3aee0dde1d1b req-e282047e-d934-4ade-8d51-522eaed35211 service nova] Creating event network-changed:ee0eba83-c6e1-4415-96d1-e5b496ec0afe for instance 0a5c9b2c-fe1e-4a21-b213-c63e2c28748a on user Apr 13 16:35:29 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [req-6fd26fb8-eb27-4700-bd47-3aee0dde1d1b req-e282047e-d934-4ade-8d51-522eaed35211 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038319 Apr 13 16:35:29 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 234/701] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:35:29 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:35:29 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [req-992f029e-e728-4137-aad4-a9a073f8c811 req-2643da4b-2acf-4b88-8b54-82bcc0529e28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2956ab05-28ff-4c9e-b646-dbb83b3db278", "name": "network-vif-unplugged", "status": "completed", "tag": "84df62e9-af7c-4e62-83da-b43b511be2a0"}]} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:35:29 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-992f029e-e728-4137-aad4-a9a073f8c811 req-2643da4b-2acf-4b88-8b54-82bcc0529e28 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:35:29 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-992f029e-e728-4137-aad4-a9a073f8c811 req-2643da4b-2acf-4b88-8b54-82bcc0529e28 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:35:29 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-992f029e-e728-4137-aad4-a9a073f8c811 req-2643da4b-2acf-4b88-8b54-82bcc0529e28 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:35:29 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-992f029e-e728-4137-aad4-a9a073f8c811 req-2643da4b-2acf-4b88-8b54-82bcc0529e28 service nova] Creating event network-vif-unplugged:84df62e9-af7c-4e62-83da-b43b511be2a0 for instance 2956ab05-28ff-4c9e-b646-dbb83b3db278 on user Apr 13 16:35:29 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [req-992f029e-e728-4137-aad4-a9a073f8c811 req-2643da4b-2acf-4b88-8b54-82bcc0529e28 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033542 Apr 13 16:35:29 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 233/702] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:35:29 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:35:31 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-4ed0e005-71d2-4054-a957-4de40cffa5ef req-33a80acb-ecda-4218-883a-e5ef2efeec08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2956ab05-28ff-4c9e-b646-dbb83b3db278", "name": "network-vif-plugged", "status": "completed", "tag": "84df62e9-af7c-4e62-83da-b43b511be2a0"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:35:31 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-4ed0e005-71d2-4054-a957-4de40cffa5ef req-33a80acb-ecda-4218-883a-e5ef2efeec08 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:35:31 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-4ed0e005-71d2-4054-a957-4de40cffa5ef req-33a80acb-ecda-4218-883a-e5ef2efeec08 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:35:31 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-4ed0e005-71d2-4054-a957-4de40cffa5ef req-33a80acb-ecda-4218-883a-e5ef2efeec08 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:35:31 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-4ed0e005-71d2-4054-a957-4de40cffa5ef req-33a80acb-ecda-4218-883a-e5ef2efeec08 service nova] Creating event network-vif-plugged:84df62e9-af7c-4e62-83da-b43b511be2a0 for instance 2956ab05-28ff-4c9e-b646-dbb83b3db278 on user Apr 13 16:35:31 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [req-4ed0e005-71d2-4054-a957-4de40cffa5ef req-33a80acb-ecda-4218-883a-e5ef2efeec08 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045781 Apr 13 16:35:31 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 236/703] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:35:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:35:33 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-fd087728-e4d8-4da5-9ad7-7b332b6250d3 req-268309bd-7dfa-405a-b9af-11a21adc0985 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2956ab05-28ff-4c9e-b646-dbb83b3db278", "name": "network-vif-plugged", "status": "completed", "tag": "84df62e9-af7c-4e62-83da-b43b511be2a0"}, {"server_uuid": "2956ab05-28ff-4c9e-b646-dbb83b3db278", "name": "network-vif-plugged", "status": "completed", "tag": "84df62e9-af7c-4e62-83da-b43b511be2a0"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:35:33 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-fd087728-e4d8-4da5-9ad7-7b332b6250d3 req-268309bd-7dfa-405a-b9af-11a21adc0985 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:35:33 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-fd087728-e4d8-4da5-9ad7-7b332b6250d3 req-268309bd-7dfa-405a-b9af-11a21adc0985 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:35:33 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-fd087728-e4d8-4da5-9ad7-7b332b6250d3 req-268309bd-7dfa-405a-b9af-11a21adc0985 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:35:33 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-fd087728-e4d8-4da5-9ad7-7b332b6250d3 req-268309bd-7dfa-405a-b9af-11a21adc0985 service nova] Creating event network-vif-plugged:84df62e9-af7c-4e62-83da-b43b511be2a0 for instance 2956ab05-28ff-4c9e-b646-dbb83b3db278 on user Apr 13 16:35:33 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-fd087728-e4d8-4da5-9ad7-7b332b6250d3 req-268309bd-7dfa-405a-b9af-11a21adc0985 service nova] Creating event network-vif-plugged:84df62e9-af7c-4e62-83da-b43b511be2a0 for instance 2956ab05-28ff-4c9e-b646-dbb83b3db278 on user Apr 13 16:35:33 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [req-fd087728-e4d8-4da5-9ad7-7b332b6250d3 req-268309bd-7dfa-405a-b9af-11a21adc0985 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.042720 Apr 13 16:35:33 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 235/704] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:35:33 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:35:34 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-b309eb84-7975-4cdb-b194-2f537d081c87 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:35:34 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-b309eb84-7975-4cdb-b194-2f537d081c87 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] [instance: 64a9c052-89a9-48ba-80c9-13fb5ef22f0e] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:35:34 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-b309eb84-7975-4cdb-b194-2f537d081c87 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:35:34 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-b309eb84-7975-4cdb-b194-2f537d081c87 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:35:34 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-b309eb84-7975-4cdb-b194-2f537d081c87 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:35:34 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-b309eb84-7975-4cdb-b194-2f537d081c87 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:35:34 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-b309eb84-7975-4cdb-b194-2f537d081c87 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:35:34 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-b309eb84-7975-4cdb-b194-2f537d081c87 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:35:34 user devstack@n-api.service[62055]: INFO nova.api.openstack.wsgi [None req-b309eb84-7975-4cdb-b194-2f537d081c87 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] HTTP exception thrown: Instance 64a9c052-89a9-48ba-80c9-13fb5ef22f0e could not be found. Apr 13 16:35:34 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-b309eb84-7975-4cdb-b194-2f537d081c87 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Request method failure captured: Apr 13 16:35:34 user devstack@n-api.service[62055]: request: GET /compute/v2.1/servers/64a9c052-89a9-48ba-80c9-13fb5ef22f0e HTTP/1.1 Apr 13 16:35:34 user devstack@n-api.service[62055]: Accept: application/json Apr 13 16:35:34 user devstack@n-api.service[62055]: Accept-Encoding: identity Apr 13 16:35:34 user devstack@n-api.service[62055]: Connection: close Apr 13 16:35:34 user devstack@n-api.service[62055]: Content-Length: 0 Apr 13 16:35:34 user devstack@n-api.service[62055]: Content-Type: application/json Apr 13 16:35:34 user devstack@n-api.service[62055]: Host: 10.0.0.210 Apr 13 16:35:34 user devstack@n-api.service[62055]: Openstack-System-Scope: None Apr 13 16:35:34 user devstack@n-api.service[62055]: User-Agent: python-urllib3/1.26.15 Apr 13 16:35:34 user devstack@n-api.service[62055]: X-Auth-Token: gAAAAABkOC2uvBBYPQ4izuFncJS2CLfT2BAqsbJ98SY2Uzhse7Jxbkg1-Im_7k55pLwjlmVYs5wK2v3fTA21ZTWUKT9v4TmImBzACyXGyLcBP0JIgBni1X-5ozqD-kRjbvH3g0yBQXUd4uA3aLF9cSdS-4zuyanMw8QN4F_F6EzuRrlMVHmmimI Apr 13 16:35:34 user devstack@n-api.service[62055]: X-Domain-Id: None Apr 13 16:35:34 user devstack@n-api.service[62055]: X-Domain-Name: None Apr 13 16:35:34 user devstack@n-api.service[62055]: X-Identity-Status: Confirmed Apr 13 16:35:34 user devstack@n-api.service[62055]: X-Is-Admin-Project: True Apr 13 16:35:34 user devstack@n-api.service[62055]: X-Project-Domain-Id: default Apr 13 16:35:34 user devstack@n-api.service[62055]: X-Project-Domain-Name: Default Apr 13 16:35:34 user devstack@n-api.service[62055]: X-Project-Id: bb7100b359f341759cb6f6753e1539a8 Apr 13 16:35:34 user devstack@n-api.service[62055]: X-Project-Name: tempest-TestStampPattern-96878995 Apr 13 16:35:34 user devstack@n-api.service[62055]: X-Role: reader,member Apr 13 16:35:34 user devstack@n-api.service[62055]: X-Roles: reader,member Apr 13 16:35:34 user devstack@n-api.service[62055]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/bb7100b359f341759cb6f6753e1539a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bb7100b359f341759cb6f6753e1539a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bb7100b359f341759cb6f6753e1539a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 13 16:35:34 user devstack@n-api.service[62055]: X-Tenant: tempest-TestStampPattern-96878995 Apr 13 16:35:34 user devstack@n-api.service[62055]: X-Tenant-Id: bb7100b359f341759cb6f6753e1539a8 Apr 13 16:35:34 user devstack@n-api.service[62055]: X-Tenant-Name: tempest-TestStampPattern-96878995 Apr 13 16:35:34 user devstack@n-api.service[62055]: X-User: tempest-TestStampPattern-96878995-project-member Apr 13 16:35:34 user devstack@n-api.service[62055]: X-User-Domain-Id: default Apr 13 16:35:34 user devstack@n-api.service[62055]: X-User-Domain-Name: Default Apr 13 16:35:34 user devstack@n-api.service[62055]: X-User-Id: f523740272844b6eb236477d0b116ddb Apr 13 16:35:34 user devstack@n-api.service[62055]: X-User-Name: tempest-TestStampPattern-96878995-project-member Apr 13 16:35:34 user devstack@n-api.service[62055]: method: > Apr 13 16:35:34 user devstack@n-api.service[62055]: exception: Instance 64a9c052-89a9-48ba-80c9-13fb5ef22f0e could not be found. Apr 13 16:35:34 user devstack@n-api.service[62055]: action_args: {'id': '64a9c052-89a9-48ba-80c9-13fb5ef22f0e'} Apr 13 16:35:34 user devstack@n-api.service[62055]: {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 16:35:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:35:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 16:35:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 16:35:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 16:35:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 16:35:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 16:35:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 16:35:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 16:35:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 16:35:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64a9c052-89a9-48ba-80c9-13fb5ef22f0e could not be found. Apr 13 16:35:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:35:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:35:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:35:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:35:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 16:35:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 16:35:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 16:35:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 16:35:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 16:35:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 16:35:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 16:35:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 16:35:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 16:35:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 16:35:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 16:35:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 16:35:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64a9c052-89a9-48ba-80c9-13fb5ef22f0e could not be found. Apr 13 16:35:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:35:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:35:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:35:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:35:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 16:35:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 16:35:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 16:35:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 16:35:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64a9c052-89a9-48ba-80c9-13fb5ef22f0e could not be found. Apr 13 16:35:34 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:35:34 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-b309eb84-7975-4cdb-b194-2f537d081c87 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Returning 404 to user: Instance 64a9c052-89a9-48ba-80c9-13fb5ef22f0e could not be found. {{(pid=62055) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 16:35:34 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-b309eb84-7975-4cdb-b194-2f537d081c87 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] 10.0.0.210 "GET /compute/v2.1/servers/64a9c052-89a9-48ba-80c9-13fb5ef22f0e" status: 404 len: 111 microversion: 2.1 time: 0.030153 Apr 13 16:35:34 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 234/705] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:35:34 2023] GET /compute/v2.1/servers/64a9c052-89a9-48ba-80c9-13fb5ef22f0e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 16:35:36 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_cell0:SELECT=2 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:35:36 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_cell0:SELECT=6 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:35:37 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-6182628b-0788-4929-91a7-5b3d8f712147 req-9dc9c271-385f-4af7-9021-fdc8fc35a7e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a5c9b2c-fe1e-4a21-b213-c63e2c28748a", "name": "network-vif-plugged", "status": "completed", "tag": "ee0eba83-c6e1-4415-96d1-e5b496ec0afe"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:35:37 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-6182628b-0788-4929-91a7-5b3d8f712147 req-9dc9c271-385f-4af7-9021-fdc8fc35a7e1 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:35:37 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-6182628b-0788-4929-91a7-5b3d8f712147 req-9dc9c271-385f-4af7-9021-fdc8fc35a7e1 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:35:37 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-6182628b-0788-4929-91a7-5b3d8f712147 req-9dc9c271-385f-4af7-9021-fdc8fc35a7e1 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:35:37 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-6182628b-0788-4929-91a7-5b3d8f712147 req-9dc9c271-385f-4af7-9021-fdc8fc35a7e1 service nova] Creating event network-vif-plugged:ee0eba83-c6e1-4415-96d1-e5b496ec0afe for instance 0a5c9b2c-fe1e-4a21-b213-c63e2c28748a on user Apr 13 16:35:37 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [req-6182628b-0788-4929-91a7-5b3d8f712147 req-9dc9c271-385f-4af7-9021-fdc8fc35a7e1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.163013 Apr 13 16:35:37 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 237/706] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:35:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:35:39 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_cell0:SELECT=2 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:35:39 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-15231421-7390-466c-84ed-48fcd824e509 req-9adb1589-5ab9-4a1c-b833-484f4f4645d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a5c9b2c-fe1e-4a21-b213-c63e2c28748a", "name": "network-vif-plugged", "status": "completed", "tag": "ee0eba83-c6e1-4415-96d1-e5b496ec0afe"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:35:39 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-15231421-7390-466c-84ed-48fcd824e509 req-9adb1589-5ab9-4a1c-b833-484f4f4645d2 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:35:39 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-15231421-7390-466c-84ed-48fcd824e509 req-9adb1589-5ab9-4a1c-b833-484f4f4645d2 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:35:39 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-15231421-7390-466c-84ed-48fcd824e509 req-9adb1589-5ab9-4a1c-b833-484f4f4645d2 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:35:39 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-15231421-7390-466c-84ed-48fcd824e509 req-9adb1589-5ab9-4a1c-b833-484f4f4645d2 service nova] Creating event network-vif-plugged:ee0eba83-c6e1-4415-96d1-e5b496ec0afe for instance 0a5c9b2c-fe1e-4a21-b213-c63e2c28748a on user Apr 13 16:35:39 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [req-15231421-7390-466c-84ed-48fcd824e509 req-9adb1589-5ab9-4a1c-b833-484f4f4645d2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035964 Apr 13 16:35:39 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 236/707] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:35:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:35:39 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-9675bd93-a3e2-49bf-a7ce-e9c5c2100097 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:35:39 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-9675bd93-a3e2-49bf-a7ce-e9c5c2100097 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] [instance: 32b18558-8bf2-4def-bc70-81c4e38fcc6f] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:35:39 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-9675bd93-a3e2-49bf-a7ce-e9c5c2100097 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:35:39 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-9675bd93-a3e2-49bf-a7ce-e9c5c2100097 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:35:39 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-9675bd93-a3e2-49bf-a7ce-e9c5c2100097 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:35:39 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-9675bd93-a3e2-49bf-a7ce-e9c5c2100097 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:35:39 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-9675bd93-a3e2-49bf-a7ce-e9c5c2100097 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:35:39 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-9675bd93-a3e2-49bf-a7ce-e9c5c2100097 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:35:39 user devstack@n-api.service[62055]: INFO nova.api.openstack.wsgi [None req-9675bd93-a3e2-49bf-a7ce-e9c5c2100097 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] HTTP exception thrown: Instance 32b18558-8bf2-4def-bc70-81c4e38fcc6f is not attached to volume 3030feb6-6893-43c8-84b8-46b8535c3077 Apr 13 16:35:39 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-9675bd93-a3e2-49bf-a7ce-e9c5c2100097 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Request method failure captured: Apr 13 16:35:39 user devstack@n-api.service[62055]: request: DELETE /compute/v2.1/servers/32b18558-8bf2-4def-bc70-81c4e38fcc6f/os-volume_attachments/3030feb6-6893-43c8-84b8-46b8535c3077 HTTP/1.1 Apr 13 16:35:39 user devstack@n-api.service[62055]: Accept: application/json Apr 13 16:35:39 user devstack@n-api.service[62055]: Accept-Encoding: identity Apr 13 16:35:39 user devstack@n-api.service[62055]: Connection: close Apr 13 16:35:39 user devstack@n-api.service[62055]: Content-Length: 0 Apr 13 16:35:39 user devstack@n-api.service[62055]: Content-Type: application/json Apr 13 16:35:39 user devstack@n-api.service[62055]: Host: 10.0.0.210 Apr 13 16:35:39 user devstack@n-api.service[62055]: Openstack-System-Scope: None Apr 13 16:35:39 user devstack@n-api.service[62055]: User-Agent: python-urllib3/1.26.15 Apr 13 16:35:39 user devstack@n-api.service[62055]: X-Auth-Token: gAAAAABkOC2uvBBYPQ4izuFncJS2CLfT2BAqsbJ98SY2Uzhse7Jxbkg1-Im_7k55pLwjlmVYs5wK2v3fTA21ZTWUKT9v4TmImBzACyXGyLcBP0JIgBni1X-5ozqD-kRjbvH3g0yBQXUd4uA3aLF9cSdS-4zuyanMw8QN4F_F6EzuRrlMVHmmimI Apr 13 16:35:39 user devstack@n-api.service[62055]: X-Domain-Id: None Apr 13 16:35:39 user devstack@n-api.service[62055]: X-Domain-Name: None Apr 13 16:35:39 user devstack@n-api.service[62055]: X-Identity-Status: Confirmed Apr 13 16:35:39 user devstack@n-api.service[62055]: X-Is-Admin-Project: True Apr 13 16:35:39 user devstack@n-api.service[62055]: X-Project-Domain-Id: default Apr 13 16:35:39 user devstack@n-api.service[62055]: X-Project-Domain-Name: Default Apr 13 16:35:39 user devstack@n-api.service[62055]: X-Project-Id: bb7100b359f341759cb6f6753e1539a8 Apr 13 16:35:39 user devstack@n-api.service[62055]: X-Project-Name: tempest-TestStampPattern-96878995 Apr 13 16:35:39 user devstack@n-api.service[62055]: X-Role: reader,member Apr 13 16:35:39 user devstack@n-api.service[62055]: X-Roles: reader,member Apr 13 16:35:39 user devstack@n-api.service[62055]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/bb7100b359f341759cb6f6753e1539a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bb7100b359f341759cb6f6753e1539a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bb7100b359f341759cb6f6753e1539a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 13 16:35:39 user devstack@n-api.service[62055]: X-Tenant: tempest-TestStampPattern-96878995 Apr 13 16:35:39 user devstack@n-api.service[62055]: X-Tenant-Id: bb7100b359f341759cb6f6753e1539a8 Apr 13 16:35:39 user devstack@n-api.service[62055]: X-Tenant-Name: tempest-TestStampPattern-96878995 Apr 13 16:35:39 user devstack@n-api.service[62055]: X-User: tempest-TestStampPattern-96878995-project-member Apr 13 16:35:39 user devstack@n-api.service[62055]: X-User-Domain-Id: default Apr 13 16:35:39 user devstack@n-api.service[62055]: X-User-Domain-Name: Default Apr 13 16:35:39 user devstack@n-api.service[62055]: X-User-Id: f523740272844b6eb236477d0b116ddb Apr 13 16:35:39 user devstack@n-api.service[62055]: X-User-Name: tempest-TestStampPattern-96878995-project-member Apr 13 16:35:39 user devstack@n-api.service[62055]: method: > Apr 13 16:35:39 user devstack@n-api.service[62055]: exception: Instance 32b18558-8bf2-4def-bc70-81c4e38fcc6f is not attached to volume 3030feb6-6893-43c8-84b8-46b8535c3077 Apr 13 16:35:39 user devstack@n-api.service[62055]: action_args: {'server_id': '32b18558-8bf2-4def-bc70-81c4e38fcc6f', 'id': '3030feb6-6893-43c8-84b8-46b8535c3077'} Apr 13 16:35:39 user devstack@n-api.service[62055]: {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 16:35:39 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:35:39 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Apr 13 16:35:39 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Apr 13 16:35:39 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Apr 13 16:35:39 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Apr 13 16:35:39 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Apr 13 16:35:39 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Apr 13 16:35:39 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 3030feb6-6893-43c8-84b8-46b8535c3077. Apr 13 16:35:39 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:35:39 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:35:39 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:35:39 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:35:39 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 16:35:39 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 16:35:39 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 16:35:39 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 16:35:39 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 16:35:39 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 16:35:39 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Apr 13 16:35:39 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Apr 13 16:35:39 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32b18558-8bf2-4def-bc70-81c4e38fcc6f is not attached to volume 3030feb6-6893-43c8-84b8-46b8535c3077 Apr 13 16:35:39 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:35:39 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:35:39 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:35:39 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:35:39 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 16:35:39 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 16:35:39 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 16:35:39 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 16:35:39 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32b18558-8bf2-4def-bc70-81c4e38fcc6f is not attached to volume 3030feb6-6893-43c8-84b8-46b8535c3077 Apr 13 16:35:39 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:35:39 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-9675bd93-a3e2-49bf-a7ce-e9c5c2100097 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Returning 404 to user: Instance 32b18558-8bf2-4def-bc70-81c4e38fcc6f is not attached to volume 3030feb6-6893-43c8-84b8-46b8535c3077 {{(pid=62055) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 16:35:39 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-9675bd93-a3e2-49bf-a7ce-e9c5c2100097 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/32b18558-8bf2-4def-bc70-81c4e38fcc6f/os-volume_attachments/3030feb6-6893-43c8-84b8-46b8535c3077" status: 404 len: 154 microversion: 2.1 time: 0.104147 Apr 13 16:35:39 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 235/708] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 16:35:39 2023] DELETE /compute/v2.1/servers/32b18558-8bf2-4def-bc70-81c4e38fcc6f/os-volume_attachments/3030feb6-6893-43c8-84b8-46b8535c3077 => generated 154 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 16:35:40 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-66eac412-2f59-4f74-8599-c7b0132ea574 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:35:40 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-66eac412-2f59-4f74-8599-c7b0132ea574 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] [instance: 32b18558-8bf2-4def-bc70-81c4e38fcc6f] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:35:40 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-bfeb7616-4e9f-43f9-9e09-6106330b9b99 req-adfbe99b-ef7a-46df-a530-d7c6f742e700 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32b18558-8bf2-4def-bc70-81c4e38fcc6f", "tag": "f9afb5f6-d601-4106-85c8-6d6179433f28"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:35:40 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-66eac412-2f59-4f74-8599-c7b0132ea574 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:35:40 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-66eac412-2f59-4f74-8599-c7b0132ea574 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:35:40 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-66eac412-2f59-4f74-8599-c7b0132ea574 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:35:40 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-66eac412-2f59-4f74-8599-c7b0132ea574 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:35:40 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-66eac412-2f59-4f74-8599-c7b0132ea574 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:35:40 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-66eac412-2f59-4f74-8599-c7b0132ea574 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:35:40 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-bfeb7616-4e9f-43f9-9e09-6106330b9b99 req-adfbe99b-ef7a-46df-a530-d7c6f742e700 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:35:40 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-bfeb7616-4e9f-43f9-9e09-6106330b9b99 req-adfbe99b-ef7a-46df-a530-d7c6f742e700 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:35:40 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-bfeb7616-4e9f-43f9-9e09-6106330b9b99 req-adfbe99b-ef7a-46df-a530-d7c6f742e700 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:35:40 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-66eac412-2f59-4f74-8599-c7b0132ea574 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] [instance: 32b18558-8bf2-4def-bc70-81c4e38fcc6f] Going to try to terminate instance {{(pid=62053) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 16:35:40 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-bfeb7616-4e9f-43f9-9e09-6106330b9b99 req-adfbe99b-ef7a-46df-a530-d7c6f742e700 service nova] Creating event network-changed:f9afb5f6-d601-4106-85c8-6d6179433f28 for instance 32b18558-8bf2-4def-bc70-81c4e38fcc6f on user Apr 13 16:35:40 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [req-bfeb7616-4e9f-43f9-9e09-6106330b9b99 req-adfbe99b-ef7a-46df-a530-d7c6f742e700 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073969 Apr 13 16:35:40 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 237/709] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:35:40 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:35:40 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-66eac412-2f59-4f74-8599-c7b0132ea574 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/32b18558-8bf2-4def-bc70-81c4e38fcc6f" status: 204 len: 0 microversion: 2.1 time: 0.124066 Apr 13 16:35:40 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 238/710] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 16:35:40 2023] DELETE /compute/v2.1/servers/32b18558-8bf2-4def-bc70-81c4e38fcc6f => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 16:35:40 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-f885a0ef-6f09-4924-877a-58a56e087784 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:35:40 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-f885a0ef-6f09-4924-877a-58a56e087784 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] [instance: 32b18558-8bf2-4def-bc70-81c4e38fcc6f] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:35:40 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-f885a0ef-6f09-4924-877a-58a56e087784 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:35:40 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-f885a0ef-6f09-4924-877a-58a56e087784 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:35:40 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-f885a0ef-6f09-4924-877a-58a56e087784 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:35:40 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-f885a0ef-6f09-4924-877a-58a56e087784 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:35:40 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-f885a0ef-6f09-4924-877a-58a56e087784 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:35:40 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-f885a0ef-6f09-4924-877a-58a56e087784 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:35:40 user devstack@n-api.service[62055]: DEBUG nova.policy [None req-f885a0ef-6f09-4924-877a-58a56e087784 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f523740272844b6eb236477d0b116ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7100b359f341759cb6f6753e1539a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62055) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:35:40 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-f885a0ef-6f09-4924-877a-58a56e087784 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] 10.0.0.210 "GET /compute/v2.1/servers/32b18558-8bf2-4def-bc70-81c4e38fcc6f" status: 200 len: 1662 microversion: 2.1 time: 0.247947 Apr 13 16:35:40 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 236/711] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:35:40 2023] GET /compute/v2.1/servers/32b18558-8bf2-4def-bc70-81c4e38fcc6f => generated 1662 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:35:41 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-f3ae27ff-7a8f-41c8-897f-5ab8c8bf849a tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8156a054-43ea-4eeb-bbec-a270a6779a43"}} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:35:41 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-f3ae27ff-7a8f-41c8-897f-5ab8c8bf849a tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:35:41 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-f3ae27ff-7a8f-41c8-897f-5ab8c8bf849a tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:35:41 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-f3ae27ff-7a8f-41c8-897f-5ab8c8bf849a tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:35:41 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-f3ae27ff-7a8f-41c8-897f-5ab8c8bf849a tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:35:41 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-f3ae27ff-7a8f-41c8-897f-5ab8c8bf849a tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:35:41 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-f3ae27ff-7a8f-41c8-897f-5ab8c8bf849a tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:35:41 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-f3ae27ff-7a8f-41c8-897f-5ab8c8bf849a tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:35:42 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-a3300096-557c-4dff-a995-3bc2ae820672 req-cc2f75b1-8e44-479a-bfbe-ae32f95017ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32b18558-8bf2-4def-bc70-81c4e38fcc6f", "name": "network-vif-unplugged", "status": "completed", "tag": "f9afb5f6-d601-4106-85c8-6d6179433f28"}, {"server_uuid": "32b18558-8bf2-4def-bc70-81c4e38fcc6f", "name": "network-vif-plugged", "status": "completed", "tag": "f9afb5f6-d601-4106-85c8-6d6179433f28"}, {"server_uuid": "32b18558-8bf2-4def-bc70-81c4e38fcc6f", "name": "network-vif-deleted", "tag": "f9afb5f6-d601-4106-85c8-6d6179433f28"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:35:42 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-a3300096-557c-4dff-a995-3bc2ae820672 req-cc2f75b1-8e44-479a-bfbe-ae32f95017ed service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:35:42 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-a3300096-557c-4dff-a995-3bc2ae820672 req-cc2f75b1-8e44-479a-bfbe-ae32f95017ed service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:35:42 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-a3300096-557c-4dff-a995-3bc2ae820672 req-cc2f75b1-8e44-479a-bfbe-ae32f95017ed service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:35:42 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-a3300096-557c-4dff-a995-3bc2ae820672 req-cc2f75b1-8e44-479a-bfbe-ae32f95017ed service nova] Creating event network-vif-unplugged:f9afb5f6-d601-4106-85c8-6d6179433f28 for instance 32b18558-8bf2-4def-bc70-81c4e38fcc6f on user Apr 13 16:35:42 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-a3300096-557c-4dff-a995-3bc2ae820672 req-cc2f75b1-8e44-479a-bfbe-ae32f95017ed service nova] Creating event network-vif-plugged:f9afb5f6-d601-4106-85c8-6d6179433f28 for instance 32b18558-8bf2-4def-bc70-81c4e38fcc6f on user Apr 13 16:35:42 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-a3300096-557c-4dff-a995-3bc2ae820672 req-cc2f75b1-8e44-479a-bfbe-ae32f95017ed service nova] Creating event network-vif-deleted:f9afb5f6-d601-4106-85c8-6d6179433f28 for instance 32b18558-8bf2-4def-bc70-81c4e38fcc6f on user Apr 13 16:35:42 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [req-a3300096-557c-4dff-a995-3bc2ae820672 req-cc2f75b1-8e44-479a-bfbe-ae32f95017ed service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.042473 Apr 13 16:35:42 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 239/712] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:35:42 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:35:42 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-f3ae27ff-7a8f-41c8-897f-5ab8c8bf849a tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] 10.0.0.210 "POST /compute/v2.1/servers/35b23303-e373-4f35-b7ee-76e6815073ce/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.832583 Apr 13 16:35:42 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 238/713] 10.0.0.210 () {66 vars in 1441 bytes} [Thu Apr 13 16:35:41 2023] POST /compute/v2.1/servers/35b23303-e373-4f35-b7ee-76e6815073ce/os-volume_attachments => generated 188 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 16:35:42 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:35:42 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:35:42 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:35:42 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:35:42 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:35:42 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:35:42 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:35:42 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:35:42 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=62055) unshelve /opt/stack/nova/nova/compute/api.py:4596}} Apr 13 16:35:42 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] 10.0.0.210 "POST /compute/v2.1/servers/35b23303-e373-4f35-b7ee-76e6815073ce/action" status: 202 len: 0 microversion: 2.20 time: 0.180721 Apr 13 16:35:42 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 237/714] 10.0.0.210 () {66 vars in 1396 bytes} [Thu Apr 13 16:35:42 2023] POST /compute/v2.1/servers/35b23303-e373-4f35-b7ee-76e6815073ce/action => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 13 16:35:42 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-6fdfe407-6b3c-4878-a557-a8ad1352dc65 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:35:42 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-6fdfe407-6b3c-4878-a557-a8ad1352dc65 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:35:42 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-6fdfe407-6b3c-4878-a557-a8ad1352dc65 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:35:42 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-6fdfe407-6b3c-4878-a557-a8ad1352dc65 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:35:42 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-6fdfe407-6b3c-4878-a557-a8ad1352dc65 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:35:42 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-6fdfe407-6b3c-4878-a557-a8ad1352dc65 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:35:42 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-6fdfe407-6b3c-4878-a557-a8ad1352dc65 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:35:42 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-6fdfe407-6b3c-4878-a557-a8ad1352dc65 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:35:42 user devstack@n-api.service[62053]: DEBUG nova.policy [None req-6fdfe407-6b3c-4878-a557-a8ad1352dc65 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b4e972cd1049509fa899449961ab59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0653ab16660b46cea9c5af58ea0b1931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62053) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:35:42 user devstack@n-api.service[62053]: DEBUG nova.policy [None req-6fdfe407-6b3c-4878-a557-a8ad1352dc65 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48b4e972cd1049509fa899449961ab59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0653ab16660b46cea9c5af58ea0b1931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62053) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:35:42 user devstack@n-api.service[62053]: DEBUG nova.policy [None req-6fdfe407-6b3c-4878-a557-a8ad1352dc65 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48b4e972cd1049509fa899449961ab59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0653ab16660b46cea9c5af58ea0b1931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62053) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:35:42 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-6fdfe407-6b3c-4878-a557-a8ad1352dc65 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] 10.0.0.210 "GET /compute/v2.1/servers/35b23303-e373-4f35-b7ee-76e6815073ce" status: 200 len: 1740 microversion: 2.20 time: 0.224364 Apr 13 16:35:42 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 240/715] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 16:35:42 2023] GET /compute/v2.1/servers/35b23303-e373-4f35-b7ee-76e6815073ce => generated 1740 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 16:35:43 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-85470f3d-a5e1-4934-8e73-d703da63f0f6 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:35:43 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-85470f3d-a5e1-4934-8e73-d703da63f0f6 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:35:43 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-85470f3d-a5e1-4934-8e73-d703da63f0f6 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:35:43 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-85470f3d-a5e1-4934-8e73-d703da63f0f6 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:35:43 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-85470f3d-a5e1-4934-8e73-d703da63f0f6 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:35:43 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-85470f3d-a5e1-4934-8e73-d703da63f0f6 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:35:43 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-85470f3d-a5e1-4934-8e73-d703da63f0f6 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:35:43 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-85470f3d-a5e1-4934-8e73-d703da63f0f6 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:35:43 user devstack@n-api.service[62054]: INFO nova.api.openstack.wsgi [None req-85470f3d-a5e1-4934-8e73-d703da63f0f6 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] HTTP exception thrown: Instance bf98c3a2-dbeb-4ae4-8423-ce55964c4258 could not be found. Apr 13 16:35:43 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-85470f3d-a5e1-4934-8e73-d703da63f0f6 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Request method failure captured: Apr 13 16:35:43 user devstack@n-api.service[62054]: request: GET /compute/v2.1/servers/bf98c3a2-dbeb-4ae4-8423-ce55964c4258 HTTP/1.1 Apr 13 16:35:43 user devstack@n-api.service[62054]: Accept: application/json Apr 13 16:35:43 user devstack@n-api.service[62054]: Accept-Encoding: identity Apr 13 16:35:43 user devstack@n-api.service[62054]: Connection: close Apr 13 16:35:43 user devstack@n-api.service[62054]: Content-Length: 0 Apr 13 16:35:43 user devstack@n-api.service[62054]: Content-Type: application/json Apr 13 16:35:43 user devstack@n-api.service[62054]: Host: 10.0.0.210 Apr 13 16:35:43 user devstack@n-api.service[62054]: Openstack-System-Scope: None Apr 13 16:35:43 user devstack@n-api.service[62054]: User-Agent: python-urllib3/1.26.15 Apr 13 16:35:43 user devstack@n-api.service[62054]: X-Auth-Token: gAAAAABkOC2iSf0-5C9M7XYS52vHUBHgf9jFWTzmGW3iqKO-XcpeDYdL2WB1nHDamnpBPAyVyJUAGC5YyDldzmtDxkxfP1l-g1HuUzBue0puL0FbfcFJ_vLpQv9RbFpy9fUK2d3cpNPD3hgHWKyZqfVnnYiYH7TEH4n6W9rYYOX3QFB5IyZ8WPc Apr 13 16:35:43 user devstack@n-api.service[62054]: X-Domain-Id: None Apr 13 16:35:43 user devstack@n-api.service[62054]: X-Domain-Name: None Apr 13 16:35:43 user devstack@n-api.service[62054]: X-Identity-Status: Confirmed Apr 13 16:35:43 user devstack@n-api.service[62054]: X-Is-Admin-Project: True Apr 13 16:35:43 user devstack@n-api.service[62054]: X-Project-Domain-Id: default Apr 13 16:35:43 user devstack@n-api.service[62054]: X-Project-Domain-Name: Default Apr 13 16:35:43 user devstack@n-api.service[62054]: X-Project-Id: 18e15bc7bee7466a840fb0d0e85d58bd Apr 13 16:35:43 user devstack@n-api.service[62054]: X-Project-Name: tempest-SnapshotDataIntegrityTests-1801153584 Apr 13 16:35:43 user devstack@n-api.service[62054]: X-Role: reader,member Apr 13 16:35:43 user devstack@n-api.service[62054]: X-Roles: reader,member Apr 13 16:35:43 user devstack@n-api.service[62054]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/18e15bc7bee7466a840fb0d0e85d58bd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/18e15bc7bee7466a840fb0d0e85d58bd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/18e15bc7bee7466a840fb0d0e85d58bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 13 16:35:43 user devstack@n-api.service[62054]: X-Tenant: tempest-SnapshotDataIntegrityTests-1801153584 Apr 13 16:35:43 user devstack@n-api.service[62054]: X-Tenant-Id: 18e15bc7bee7466a840fb0d0e85d58bd Apr 13 16:35:43 user devstack@n-api.service[62054]: X-Tenant-Name: tempest-SnapshotDataIntegrityTests-1801153584 Apr 13 16:35:43 user devstack@n-api.service[62054]: X-User: tempest-SnapshotDataIntegrityTests-1801153584-project-member Apr 13 16:35:43 user devstack@n-api.service[62054]: X-User-Domain-Id: default Apr 13 16:35:43 user devstack@n-api.service[62054]: X-User-Domain-Name: Default Apr 13 16:35:43 user devstack@n-api.service[62054]: X-User-Id: 1318d817c48e40988e043fa33e908312 Apr 13 16:35:43 user devstack@n-api.service[62054]: X-User-Name: tempest-SnapshotDataIntegrityTests-1801153584-project-member Apr 13 16:35:43 user devstack@n-api.service[62054]: method: > Apr 13 16:35:43 user devstack@n-api.service[62054]: exception: Instance bf98c3a2-dbeb-4ae4-8423-ce55964c4258 could not be found. Apr 13 16:35:43 user devstack@n-api.service[62054]: action_args: {'id': 'bf98c3a2-dbeb-4ae4-8423-ce55964c4258'} Apr 13 16:35:43 user devstack@n-api.service[62054]: {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 16:35:43 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:35:43 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 16:35:43 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 16:35:43 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 16:35:43 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 16:35:43 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 16:35:43 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 16:35:43 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 16:35:43 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 16:35:43 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf98c3a2-dbeb-4ae4-8423-ce55964c4258 could not be found. Apr 13 16:35:43 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:35:43 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:35:43 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:35:43 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:35:43 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 16:35:43 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 16:35:43 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 16:35:43 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 16:35:43 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 16:35:43 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 16:35:43 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 16:35:43 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 16:35:43 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 16:35:43 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 16:35:43 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 16:35:43 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 16:35:43 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf98c3a2-dbeb-4ae4-8423-ce55964c4258 could not be found. Apr 13 16:35:43 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:35:43 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:35:43 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:35:43 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:35:43 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 16:35:43 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 16:35:43 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 16:35:43 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 16:35:43 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf98c3a2-dbeb-4ae4-8423-ce55964c4258 could not be found. Apr 13 16:35:43 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:35:43 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-85470f3d-a5e1-4934-8e73-d703da63f0f6 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Returning 404 to user: Instance bf98c3a2-dbeb-4ae4-8423-ce55964c4258 could not be found. {{(pid=62054) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 16:35:43 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-85470f3d-a5e1-4934-8e73-d703da63f0f6 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bf98c3a2-dbeb-4ae4-8423-ce55964c4258" status: 404 len: 111 microversion: 2.1 time: 0.043062 Apr 13 16:35:43 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 239/716] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:35:43 2023] GET /compute/v2.1/servers/bf98c3a2-dbeb-4ae4-8423-ce55964c4258 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 16:35:43 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-4129a7ab-2a8c-4c34-a903-dcf728682c48 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Calling method '.version_select at 0x7f96dc51c040>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:35:43 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-4129a7ab-2a8c-4c34-a903-dcf728682c48 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-SnapshotDataIntegrityTests-1768467450" status: 202 len: 0 microversion: 2.1 time: 0.032243 Apr 13 16:35:43 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 238/717] 10.0.0.210 () {62 vars in 1355 bytes} [Thu Apr 13 16:35:43 2023] DELETE /compute/v2.1/os-keypairs/tempest-SnapshotDataIntegrityTests-1768467450 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 16:35:50 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-802a95ff-b50a-45f7-93dd-607ed3d285a8 req-cd171474-33b7-4976-bfa6-9458a7b25656 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35b23303-e373-4f35-b7ee-76e6815073ce", "tag": "d3c66e4e-b15d-4bc9-a838-265ca07a6a66"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:35:50 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:35:50 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-802a95ff-b50a-45f7-93dd-607ed3d285a8 req-cd171474-33b7-4976-bfa6-9458a7b25656 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:35:50 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-802a95ff-b50a-45f7-93dd-607ed3d285a8 req-cd171474-33b7-4976-bfa6-9458a7b25656 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:35:50 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-802a95ff-b50a-45f7-93dd-607ed3d285a8 req-cd171474-33b7-4976-bfa6-9458a7b25656 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:35:50 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:35:50 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-802a95ff-b50a-45f7-93dd-607ed3d285a8 req-cd171474-33b7-4976-bfa6-9458a7b25656 service nova] Creating event network-changed:d3c66e4e-b15d-4bc9-a838-265ca07a6a66 for instance 35b23303-e373-4f35-b7ee-76e6815073ce on user Apr 13 16:35:50 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [req-802a95ff-b50a-45f7-93dd-607ed3d285a8 req-cd171474-33b7-4976-bfa6-9458a7b25656 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111840 Apr 13 16:35:50 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 241/718] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:35:49 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:35:58 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-06c51ef9-f72d-41f5-89f4-a62580b67455 req-1fc2ca2e-3efa-4903-a4ca-218bb5eb8a34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35b23303-e373-4f35-b7ee-76e6815073ce", "name": "network-vif-plugged", "status": "completed", "tag": "d3c66e4e-b15d-4bc9-a838-265ca07a6a66"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:35:58 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_api:SELECT=18 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:35:58 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_cell1:SELECT=27,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:35:58 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-06c51ef9-f72d-41f5-89f4-a62580b67455 req-1fc2ca2e-3efa-4903-a4ca-218bb5eb8a34 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:35:58 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-06c51ef9-f72d-41f5-89f4-a62580b67455 req-1fc2ca2e-3efa-4903-a4ca-218bb5eb8a34 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:35:58 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-06c51ef9-f72d-41f5-89f4-a62580b67455 req-1fc2ca2e-3efa-4903-a4ca-218bb5eb8a34 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:35:58 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-06c51ef9-f72d-41f5-89f4-a62580b67455 req-1fc2ca2e-3efa-4903-a4ca-218bb5eb8a34 service nova] Creating event network-vif-plugged:d3c66e4e-b15d-4bc9-a838-265ca07a6a66 for instance 35b23303-e373-4f35-b7ee-76e6815073ce on user Apr 13 16:35:58 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [req-06c51ef9-f72d-41f5-89f4-a62580b67455 req-1fc2ca2e-3efa-4903-a4ca-218bb5eb8a34 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063344 Apr 13 16:35:58 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 240/719] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:35:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 16:36:00 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:36:00 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:36:00 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [req-1dbd953c-cd76-425a-aa35-93246235812c req-9f44d544-8b9e-43f6-ab68-5a6ecd6b4df4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35b23303-e373-4f35-b7ee-76e6815073ce", "name": "network-vif-plugged", "status": "completed", "tag": "d3c66e4e-b15d-4bc9-a838-265ca07a6a66"}]} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:36:00 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-1dbd953c-cd76-425a-aa35-93246235812c req-9f44d544-8b9e-43f6-ab68-5a6ecd6b4df4 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:36:00 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-1dbd953c-cd76-425a-aa35-93246235812c req-9f44d544-8b9e-43f6-ab68-5a6ecd6b4df4 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:36:00 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-1dbd953c-cd76-425a-aa35-93246235812c req-9f44d544-8b9e-43f6-ab68-5a6ecd6b4df4 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:36:00 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-1dbd953c-cd76-425a-aa35-93246235812c req-9f44d544-8b9e-43f6-ab68-5a6ecd6b4df4 service nova] Creating event network-vif-plugged:d3c66e4e-b15d-4bc9-a838-265ca07a6a66 for instance 35b23303-e373-4f35-b7ee-76e6815073ce on user Apr 13 16:36:00 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [req-1dbd953c-cd76-425a-aa35-93246235812c req-9f44d544-8b9e-43f6-ab68-5a6ecd6b4df4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064777 Apr 13 16:36:00 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 239/720] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:36:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:36:08 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_api:SELECT=1 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:36:08 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-c92f5300-5d8d-4fcb-8ad3-e523a1cd5f23 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:36:08 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-c92f5300-5d8d-4fcb-8ad3-e523a1cd5f23 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:36:08 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-c92f5300-5d8d-4fcb-8ad3-e523a1cd5f23 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:36:08 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-c92f5300-5d8d-4fcb-8ad3-e523a1cd5f23 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:36:08 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-c92f5300-5d8d-4fcb-8ad3-e523a1cd5f23 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:36:08 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-c92f5300-5d8d-4fcb-8ad3-e523a1cd5f23 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:36:08 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-c92f5300-5d8d-4fcb-8ad3-e523a1cd5f23 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:36:08 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-c92f5300-5d8d-4fcb-8ad3-e523a1cd5f23 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:36:09 user devstack@n-api.service[62053]: DEBUG nova.policy [None req-c92f5300-5d8d-4fcb-8ad3-e523a1cd5f23 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b3df1c5c5d441819bcef89ed6966815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980559734a504574a83224deb7423c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62053) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:36:09 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-c92f5300-5d8d-4fcb-8ad3-e523a1cd5f23 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] 10.0.0.210 "GET /compute/v2.1/servers/acbcaee0-a47b-4fee-8765-9b1c9597d515" status: 200 len: 1723 microversion: 2.1 time: 0.442080 Apr 13 16:36:09 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 242/721] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:36:08 2023] GET /compute/v2.1/servers/acbcaee0-a47b-4fee-8765-9b1c9597d515 => generated 1723 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:36:09 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_api:SELECT=2 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:36:09 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-e25865a1-9401-478d-bf73-d9ad733438e1 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:36:09 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-e25865a1-9401-478d-bf73-d9ad733438e1 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:36:09 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-e25865a1-9401-478d-bf73-d9ad733438e1 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:36:09 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-e25865a1-9401-478d-bf73-d9ad733438e1 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:36:09 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-e25865a1-9401-478d-bf73-d9ad733438e1 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:36:09 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-e25865a1-9401-478d-bf73-d9ad733438e1 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:36:09 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-e25865a1-9401-478d-bf73-d9ad733438e1 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:36:09 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-e25865a1-9401-478d-bf73-d9ad733438e1 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:36:09 user devstack@n-api.service[62054]: DEBUG nova.policy [None req-e25865a1-9401-478d-bf73-d9ad733438e1 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b3df1c5c5d441819bcef89ed6966815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980559734a504574a83224deb7423c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62054) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:36:09 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-e25865a1-9401-478d-bf73-d9ad733438e1 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] 10.0.0.210 "GET /compute/v2.1/servers/acbcaee0-a47b-4fee-8765-9b1c9597d515" status: 200 len: 1723 microversion: 2.1 time: 0.154787 Apr 13 16:36:09 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 241/722] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:36:09 2023] GET /compute/v2.1/servers/acbcaee0-a47b-4fee-8765-9b1c9597d515 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:36:16 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-c8c8dce7-4667-47d9-8119-e322afb8d683 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:36:16 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-c8c8dce7-4667-47d9-8119-e322afb8d683 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 0a5c9b2c-fe1e-4a21-b213-c63e2c28748a] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:36:16 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_cell1:SELECT=2 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:36:16 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_api:SELECT=2 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:36:16 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-c8c8dce7-4667-47d9-8119-e322afb8d683 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:36:16 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-c8c8dce7-4667-47d9-8119-e322afb8d683 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:36:16 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-c8c8dce7-4667-47d9-8119-e322afb8d683 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:36:16 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-c8c8dce7-4667-47d9-8119-e322afb8d683 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:36:16 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-c8c8dce7-4667-47d9-8119-e322afb8d683 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:36:16 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-c8c8dce7-4667-47d9-8119-e322afb8d683 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:36:16 user devstack@n-api.service[62055]: DEBUG nova.policy [None req-c8c8dce7-4667-47d9-8119-e322afb8d683 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e10f63cdd49a9a1ebe1fe4c9de0a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d451e0e239f486aa2b3abe9e273eab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62055) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:36:16 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-c8c8dce7-4667-47d9-8119-e322afb8d683 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0a5c9b2c-fe1e-4a21-b213-c63e2c28748a" status: 200 len: 1442 microversion: 2.1 time: 0.159912 Apr 13 16:36:16 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 240/723] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:36:16 2023] GET /compute/v2.1/servers/0a5c9b2c-fe1e-4a21-b213-c63e2c28748a => generated 1442 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:36:18 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-27834ad2-9b35-440c-8986-3198aca10c57 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:36:18 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-27834ad2-9b35-440c-8986-3198aca10c57 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:36:18 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-27834ad2-9b35-440c-8986-3198aca10c57 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:36:18 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-27834ad2-9b35-440c-8986-3198aca10c57 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:36:18 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-27834ad2-9b35-440c-8986-3198aca10c57 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:36:18 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-27834ad2-9b35-440c-8986-3198aca10c57 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:36:18 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-27834ad2-9b35-440c-8986-3198aca10c57 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:36:18 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-27834ad2-9b35-440c-8986-3198aca10c57 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:36:19 user devstack@n-api.service[62053]: DEBUG nova.policy [None req-27834ad2-9b35-440c-8986-3198aca10c57 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45a882dbafb4ea4976e4f45289eb2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d09a74bf684a9fb1dd1e95d6c23f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62053) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:36:19 user devstack@n-api.service[62053]: DEBUG nova.policy [None req-27834ad2-9b35-440c-8986-3198aca10c57 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e45a882dbafb4ea4976e4f45289eb2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d09a74bf684a9fb1dd1e95d6c23f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62053) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:36:19 user devstack@n-api.service[62053]: DEBUG nova.policy [None req-27834ad2-9b35-440c-8986-3198aca10c57 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e45a882dbafb4ea4976e4f45289eb2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d09a74bf684a9fb1dd1e95d6c23f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62053) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:36:19 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-27834ad2-9b35-440c-8986-3198aca10c57 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2956ab05-28ff-4c9e-b646-dbb83b3db278" status: 200 len: 1768 microversion: 2.87 time: 0.155901 Apr 13 16:36:19 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 243/724] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 16:36:18 2023] GET /compute/v2.1/servers/2956ab05-28ff-4c9e-b646-dbb83b3db278 => generated 1768 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 16:36:24 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-28b4c25c-65fd-481e-a277-95290839f3c8 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:36:24 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-28b4c25c-65fd-481e-a277-95290839f3c8 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:36:24 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_api:SELECT=2 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:36:24 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_cell1:SELECT=8 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:36:24 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-28b4c25c-65fd-481e-a277-95290839f3c8 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:36:24 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-28b4c25c-65fd-481e-a277-95290839f3c8 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:36:24 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-28b4c25c-65fd-481e-a277-95290839f3c8 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:36:24 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-28b4c25c-65fd-481e-a277-95290839f3c8 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:36:24 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-28b4c25c-65fd-481e-a277-95290839f3c8 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:36:24 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-28b4c25c-65fd-481e-a277-95290839f3c8 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:36:24 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-28b4c25c-65fd-481e-a277-95290839f3c8 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.103404 Apr 13 16:36:24 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 242/725] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 13 16:36:24 2023] GET /compute/v2.1/servers/bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f/os-interface => generated 283 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:36:25 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [req-d222c6da-9727-41b0-9441-b5d82c204c17 req-df74b76c-523d-437a-b525-7ae22f7266b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f", "tag": "adf9438c-79e3-494a-8650-1b7377eb1062"}]} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:36:25 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-d222c6da-9727-41b0-9441-b5d82c204c17 req-df74b76c-523d-437a-b525-7ae22f7266b4 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:36:25 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-d222c6da-9727-41b0-9441-b5d82c204c17 req-df74b76c-523d-437a-b525-7ae22f7266b4 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:36:25 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-d222c6da-9727-41b0-9441-b5d82c204c17 req-df74b76c-523d-437a-b525-7ae22f7266b4 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:36:25 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-d222c6da-9727-41b0-9441-b5d82c204c17 req-df74b76c-523d-437a-b525-7ae22f7266b4 service nova] Creating event network-changed:adf9438c-79e3-494a-8650-1b7377eb1062 for instance bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f on user Apr 13 16:36:25 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [req-d222c6da-9727-41b0-9441-b5d82c204c17 req-df74b76c-523d-437a-b525-7ae22f7266b4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033149 Apr 13 16:36:25 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 241/726] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:36:25 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:36:25 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-9aea4d86-34d0-49e8-99da-413d8dd9aef7 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:36:25 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-9aea4d86-34d0-49e8-99da-413d8dd9aef7 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:36:25 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-9aea4d86-34d0-49e8-99da-413d8dd9aef7 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:36:25 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-9aea4d86-34d0-49e8-99da-413d8dd9aef7 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:36:25 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-9aea4d86-34d0-49e8-99da-413d8dd9aef7 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:36:25 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-9aea4d86-34d0-49e8-99da-413d8dd9aef7 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:36:25 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-9aea4d86-34d0-49e8-99da-413d8dd9aef7 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:36:25 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-9aea4d86-34d0-49e8-99da-413d8dd9aef7 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:36:25 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-9aea4d86-34d0-49e8-99da-413d8dd9aef7 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f/ips" status: 200 len: 105 microversion: 2.1 time: 0.036089 Apr 13 16:36:25 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 244/727] 10.0.0.210 () {62 vars in 1325 bytes} [Thu Apr 13 16:36:25 2023] GET /compute/v2.1/servers/bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f/ips => generated 105 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:36:26 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-fd58103c-ec7d-46d7-abaa-a56feb441a00 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "548500fd-99a8-4cad-ade8-acd0fce2c8e8"}} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:36:26 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-fd58103c-ec7d-46d7-abaa-a56feb441a00 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:36:26 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-fd58103c-ec7d-46d7-abaa-a56feb441a00 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:36:26 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-fd58103c-ec7d-46d7-abaa-a56feb441a00 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:36:26 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-fd58103c-ec7d-46d7-abaa-a56feb441a00 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:36:26 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-fd58103c-ec7d-46d7-abaa-a56feb441a00 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:36:26 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-fd58103c-ec7d-46d7-abaa-a56feb441a00 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:36:26 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-fd58103c-ec7d-46d7-abaa-a56feb441a00 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:36:27 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-fd58103c-ec7d-46d7-abaa-a56feb441a00 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] 10.0.0.210 "POST /compute/v2.1/servers/bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.282250 Apr 13 16:36:27 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 243/728] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 16:36:26 2023] POST /compute/v2.1/servers/bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f/os-volume_attachments => generated 194 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:36:30 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-4070c478-e605-462c-a017-eda076baa80c tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:36:30 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-4070c478-e605-462c-a017-eda076baa80c tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] [instance: 32b18558-8bf2-4def-bc70-81c4e38fcc6f] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:36:30 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-4070c478-e605-462c-a017-eda076baa80c tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:36:30 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-4070c478-e605-462c-a017-eda076baa80c tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:36:30 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-4070c478-e605-462c-a017-eda076baa80c tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:36:30 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-4070c478-e605-462c-a017-eda076baa80c tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:36:30 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-4070c478-e605-462c-a017-eda076baa80c tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:36:30 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-4070c478-e605-462c-a017-eda076baa80c tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:36:30 user devstack@n-api.service[62055]: INFO nova.api.openstack.wsgi [None req-4070c478-e605-462c-a017-eda076baa80c tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] HTTP exception thrown: Instance 32b18558-8bf2-4def-bc70-81c4e38fcc6f could not be found. Apr 13 16:36:30 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-4070c478-e605-462c-a017-eda076baa80c tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Request method failure captured: Apr 13 16:36:30 user devstack@n-api.service[62055]: request: GET /compute/v2.1/servers/32b18558-8bf2-4def-bc70-81c4e38fcc6f HTTP/1.1 Apr 13 16:36:30 user devstack@n-api.service[62055]: Accept: application/json Apr 13 16:36:30 user devstack@n-api.service[62055]: Accept-Encoding: identity Apr 13 16:36:30 user devstack@n-api.service[62055]: Connection: close Apr 13 16:36:30 user devstack@n-api.service[62055]: Content-Length: 0 Apr 13 16:36:30 user devstack@n-api.service[62055]: Content-Type: application/json Apr 13 16:36:30 user devstack@n-api.service[62055]: Host: 10.0.0.210 Apr 13 16:36:30 user devstack@n-api.service[62055]: Openstack-System-Scope: None Apr 13 16:36:30 user devstack@n-api.service[62055]: User-Agent: python-urllib3/1.26.15 Apr 13 16:36:30 user devstack@n-api.service[62055]: X-Auth-Token: gAAAAABkOC2uvBBYPQ4izuFncJS2CLfT2BAqsbJ98SY2Uzhse7Jxbkg1-Im_7k55pLwjlmVYs5wK2v3fTA21ZTWUKT9v4TmImBzACyXGyLcBP0JIgBni1X-5ozqD-kRjbvH3g0yBQXUd4uA3aLF9cSdS-4zuyanMw8QN4F_F6EzuRrlMVHmmimI Apr 13 16:36:30 user devstack@n-api.service[62055]: X-Domain-Id: None Apr 13 16:36:30 user devstack@n-api.service[62055]: X-Domain-Name: None Apr 13 16:36:30 user devstack@n-api.service[62055]: X-Identity-Status: Confirmed Apr 13 16:36:30 user devstack@n-api.service[62055]: X-Is-Admin-Project: True Apr 13 16:36:30 user devstack@n-api.service[62055]: X-Project-Domain-Id: default Apr 13 16:36:30 user devstack@n-api.service[62055]: X-Project-Domain-Name: Default Apr 13 16:36:30 user devstack@n-api.service[62055]: X-Project-Id: bb7100b359f341759cb6f6753e1539a8 Apr 13 16:36:30 user devstack@n-api.service[62055]: X-Project-Name: tempest-TestStampPattern-96878995 Apr 13 16:36:30 user devstack@n-api.service[62055]: X-Role: reader,member Apr 13 16:36:30 user devstack@n-api.service[62055]: X-Roles: reader,member Apr 13 16:36:30 user devstack@n-api.service[62055]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/bb7100b359f341759cb6f6753e1539a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bb7100b359f341759cb6f6753e1539a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bb7100b359f341759cb6f6753e1539a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 13 16:36:30 user devstack@n-api.service[62055]: X-Tenant: tempest-TestStampPattern-96878995 Apr 13 16:36:30 user devstack@n-api.service[62055]: X-Tenant-Id: bb7100b359f341759cb6f6753e1539a8 Apr 13 16:36:30 user devstack@n-api.service[62055]: X-Tenant-Name: tempest-TestStampPattern-96878995 Apr 13 16:36:30 user devstack@n-api.service[62055]: X-User: tempest-TestStampPattern-96878995-project-member Apr 13 16:36:30 user devstack@n-api.service[62055]: X-User-Domain-Id: default Apr 13 16:36:30 user devstack@n-api.service[62055]: X-User-Domain-Name: Default Apr 13 16:36:30 user devstack@n-api.service[62055]: X-User-Id: f523740272844b6eb236477d0b116ddb Apr 13 16:36:30 user devstack@n-api.service[62055]: X-User-Name: tempest-TestStampPattern-96878995-project-member Apr 13 16:36:30 user devstack@n-api.service[62055]: method: > Apr 13 16:36:30 user devstack@n-api.service[62055]: exception: Instance 32b18558-8bf2-4def-bc70-81c4e38fcc6f could not be found. Apr 13 16:36:30 user devstack@n-api.service[62055]: action_args: {'id': '32b18558-8bf2-4def-bc70-81c4e38fcc6f'} Apr 13 16:36:30 user devstack@n-api.service[62055]: {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 16:36:30 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:36:30 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 16:36:30 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 16:36:30 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 16:36:30 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 16:36:30 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 16:36:30 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 16:36:30 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 16:36:30 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 16:36:30 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32b18558-8bf2-4def-bc70-81c4e38fcc6f could not be found. Apr 13 16:36:30 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:36:30 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:36:30 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:36:30 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:36:30 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 16:36:30 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 16:36:30 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 16:36:30 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 16:36:30 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 16:36:30 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 16:36:30 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 16:36:30 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 16:36:30 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 16:36:30 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 16:36:30 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 16:36:30 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 16:36:30 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32b18558-8bf2-4def-bc70-81c4e38fcc6f could not be found. Apr 13 16:36:30 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:36:30 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:36:30 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:36:30 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:36:30 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 16:36:30 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 16:36:30 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 16:36:30 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 16:36:30 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32b18558-8bf2-4def-bc70-81c4e38fcc6f could not be found. Apr 13 16:36:30 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:36:30 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-4070c478-e605-462c-a017-eda076baa80c tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Returning 404 to user: Instance 32b18558-8bf2-4def-bc70-81c4e38fcc6f could not be found. {{(pid=62055) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 16:36:30 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-4070c478-e605-462c-a017-eda076baa80c tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] 10.0.0.210 "GET /compute/v2.1/servers/32b18558-8bf2-4def-bc70-81c4e38fcc6f" status: 404 len: 111 microversion: 2.1 time: 0.049647 Apr 13 16:36:30 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 242/729] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:36:30 2023] GET /compute/v2.1/servers/32b18558-8bf2-4def-bc70-81c4e38fcc6f => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 16:36:32 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-6797a8c3-013c-4165-a56b-a0642514c9f7 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:36:32 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-6797a8c3-013c-4165-a56b-a0642514c9f7 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:36:32 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-6797a8c3-013c-4165-a56b-a0642514c9f7 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:36:32 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-6797a8c3-013c-4165-a56b-a0642514c9f7 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:36:32 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-6797a8c3-013c-4165-a56b-a0642514c9f7 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:36:32 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-6797a8c3-013c-4165-a56b-a0642514c9f7 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:36:32 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-6797a8c3-013c-4165-a56b-a0642514c9f7 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:36:32 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-6797a8c3-013c-4165-a56b-a0642514c9f7 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:36:33 user devstack@n-api.service[62053]: DEBUG nova.policy [None req-6797a8c3-013c-4165-a56b-a0642514c9f7 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b4e972cd1049509fa899449961ab59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0653ab16660b46cea9c5af58ea0b1931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62053) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:36:33 user devstack@n-api.service[62053]: DEBUG nova.policy [None req-6797a8c3-013c-4165-a56b-a0642514c9f7 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48b4e972cd1049509fa899449961ab59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0653ab16660b46cea9c5af58ea0b1931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62053) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:36:33 user devstack@n-api.service[62053]: DEBUG nova.policy [None req-6797a8c3-013c-4165-a56b-a0642514c9f7 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48b4e972cd1049509fa899449961ab59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0653ab16660b46cea9c5af58ea0b1931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62053) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:36:33 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-6797a8c3-013c-4165-a56b-a0642514c9f7 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] 10.0.0.210 "GET /compute/v2.1/servers/35b23303-e373-4f35-b7ee-76e6815073ce" status: 200 len: 1785 microversion: 2.20 time: 0.170362 Apr 13 16:36:33 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 245/730] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 16:36:32 2023] GET /compute/v2.1/servers/35b23303-e373-4f35-b7ee-76e6815073ce => generated 1785 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 16:36:33 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-eb8126d8-d2b2-4e11-881f-5b9701b86ea8 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Calling method '.version_select at 0x7f96e47b7e20>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:36:33 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-eb8126d8-d2b2-4e11-881f-5b9701b86ea8 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-792944514" status: 202 len: 0 microversion: 2.1 time: 0.029814 Apr 13 16:36:33 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 244/731] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 16:36:33 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-792944514 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 16:36:34 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-b6684cf4-b888-4142-aa1a-e99b6062f0f1 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:36:34 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-b6684cf4-b888-4142-aa1a-e99b6062f0f1 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:36:34 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-b6684cf4-b888-4142-aa1a-e99b6062f0f1 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:36:34 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-b6684cf4-b888-4142-aa1a-e99b6062f0f1 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:36:34 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-b6684cf4-b888-4142-aa1a-e99b6062f0f1 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:36:34 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-b6684cf4-b888-4142-aa1a-e99b6062f0f1 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:36:34 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-b6684cf4-b888-4142-aa1a-e99b6062f0f1 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:36:34 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-b6684cf4-b888-4142-aa1a-e99b6062f0f1 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:36:34 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-b6684cf4-b888-4142-aa1a-e99b6062f0f1 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062279 Apr 13 16:36:34 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 243/732] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 16:36:34 2023] GET /compute/v2.1/servers/bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:36:34 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-1bc57595-9b0a-4ed9-a453-61824a0610c4 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:36:34 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-1bc57595-9b0a-4ed9-a453-61824a0610c4 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:36:34 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-1bc57595-9b0a-4ed9-a453-61824a0610c4 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:36:34 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-1bc57595-9b0a-4ed9-a453-61824a0610c4 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:36:34 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-1bc57595-9b0a-4ed9-a453-61824a0610c4 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:36:34 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-1bc57595-9b0a-4ed9-a453-61824a0610c4 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:36:34 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-1bc57595-9b0a-4ed9-a453-61824a0610c4 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:36:34 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-1bc57595-9b0a-4ed9-a453-61824a0610c4 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:36:34 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-1bc57595-9b0a-4ed9-a453-61824a0610c4 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f/os-volume_attachments/548500fd-99a8-4cad-ade8-acd0fce2c8e8" status: 200 len: 194 microversion: 2.1 time: 0.041265 Apr 13 16:36:34 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 246/733] 10.0.0.210 () {62 vars in 1490 bytes} [Thu Apr 13 16:36:34 2023] GET /compute/v2.1/servers/bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f/os-volume_attachments/548500fd-99a8-4cad-ade8-acd0fce2c8e8 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:36:36 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-ca578feb-f4f8-4fa0-85f0-1c59b8e7b768 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "db98e2a6-2772-4d6b-80fc-67f564ded02b"}} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:36:36 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-ca578feb-f4f8-4fa0-85f0-1c59b8e7b768 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:36:36 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-ca578feb-f4f8-4fa0-85f0-1c59b8e7b768 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:36:36 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-ca578feb-f4f8-4fa0-85f0-1c59b8e7b768 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:36:36 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-ca578feb-f4f8-4fa0-85f0-1c59b8e7b768 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:36:36 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-ca578feb-f4f8-4fa0-85f0-1c59b8e7b768 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:36:36 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-ca578feb-f4f8-4fa0-85f0-1c59b8e7b768 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:36:36 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-ca578feb-f4f8-4fa0-85f0-1c59b8e7b768 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:36:36 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-ca578feb-f4f8-4fa0-85f0-1c59b8e7b768 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] 10.0.0.210 "POST /compute/v2.1/servers/bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.333609 Apr 13 16:36:36 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 245/734] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 16:36:36 2023] POST /compute/v2.1/servers/bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f/os-volume_attachments => generated 194 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:36:44 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-94e92000-0ec1-4afe-b7e2-9f1ed2210565 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:36:44 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-94e92000-0ec1-4afe-b7e2-9f1ed2210565 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:36:44 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-94e92000-0ec1-4afe-b7e2-9f1ed2210565 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:36:44 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-94e92000-0ec1-4afe-b7e2-9f1ed2210565 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:36:44 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-94e92000-0ec1-4afe-b7e2-9f1ed2210565 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:36:44 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-94e92000-0ec1-4afe-b7e2-9f1ed2210565 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:36:44 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-94e92000-0ec1-4afe-b7e2-9f1ed2210565 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:36:44 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-94e92000-0ec1-4afe-b7e2-9f1ed2210565 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:36:44 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-94e92000-0ec1-4afe-b7e2-9f1ed2210565 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.049093 Apr 13 16:36:44 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 244/735] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 16:36:44 2023] GET /compute/v2.1/servers/bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f/os-volume_attachments => generated 371 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:36:44 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-489c5dba-bea0-4f63-9838-0fdc2496936e tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:36:44 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-489c5dba-bea0-4f63-9838-0fdc2496936e tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:36:44 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_api:SELECT=13 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:36:44 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-489c5dba-bea0-4f63-9838-0fdc2496936e tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:36:44 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-489c5dba-bea0-4f63-9838-0fdc2496936e tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:36:44 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-489c5dba-bea0-4f63-9838-0fdc2496936e tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:36:44 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-489c5dba-bea0-4f63-9838-0fdc2496936e tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:36:44 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-489c5dba-bea0-4f63-9838-0fdc2496936e tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:36:44 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-489c5dba-bea0-4f63-9838-0fdc2496936e tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:36:44 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_cell1:SELECT=30 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:36:44 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-489c5dba-bea0-4f63-9838-0fdc2496936e tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f/os-volume_attachments/548500fd-99a8-4cad-ade8-acd0fce2c8e8" status: 200 len: 194 microversion: 2.1 time: 0.045764 Apr 13 16:36:44 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 247/736] 10.0.0.210 () {62 vars in 1490 bytes} [Thu Apr 13 16:36:44 2023] GET /compute/v2.1/servers/bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f/os-volume_attachments/548500fd-99a8-4cad-ade8-acd0fce2c8e8 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:36:44 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-80cb0e00-6cba-4c00-85a2-42ded02e5a22 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:36:44 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-80cb0e00-6cba-4c00-85a2-42ded02e5a22 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:36:44 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-80cb0e00-6cba-4c00-85a2-42ded02e5a22 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:36:44 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-80cb0e00-6cba-4c00-85a2-42ded02e5a22 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:36:44 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-80cb0e00-6cba-4c00-85a2-42ded02e5a22 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:36:44 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-80cb0e00-6cba-4c00-85a2-42ded02e5a22 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:36:44 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-80cb0e00-6cba-4c00-85a2-42ded02e5a22 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:36:44 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-80cb0e00-6cba-4c00-85a2-42ded02e5a22 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:36:44 user devstack@n-api.service[62054]: DEBUG nova.objects.instance [None req-80cb0e00-6cba-4c00-85a2-42ded02e5a22 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lazy-loading 'services' on Instance uuid bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f {{(pid=62054) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 16:36:44 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-80cb0e00-6cba-4c00-85a2-42ded02e5a22 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f/os-volume_attachments/548500fd-99a8-4cad-ade8-acd0fce2c8e8" status: 202 len: 0 microversion: 2.1 time: 0.176987 Apr 13 16:36:44 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 246/737] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 16:36:44 2023] DELETE /compute/v2.1/servers/bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f/os-volume_attachments/548500fd-99a8-4cad-ade8-acd0fce2c8e8 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 16:36:46 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-03c355d6-6ada-4f54-bbcc-d134a22f66b3 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:36:46 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-03c355d6-6ada-4f54-bbcc-d134a22f66b3 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:36:46 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_api:SELECT=11 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:36:46 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-03c355d6-6ada-4f54-bbcc-d134a22f66b3 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:36:46 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-03c355d6-6ada-4f54-bbcc-d134a22f66b3 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:36:46 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-03c355d6-6ada-4f54-bbcc-d134a22f66b3 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:36:46 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-03c355d6-6ada-4f54-bbcc-d134a22f66b3 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:36:46 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-03c355d6-6ada-4f54-bbcc-d134a22f66b3 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:36:46 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-03c355d6-6ada-4f54-bbcc-d134a22f66b3 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:36:46 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_cell1:SELECT=23 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:36:46 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-03c355d6-6ada-4f54-bbcc-d134a22f66b3 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f/os-volume_attachments/db98e2a6-2772-4d6b-80fc-67f564ded02b" status: 200 len: 194 microversion: 2.1 time: 0.045799 Apr 13 16:36:46 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 245/738] 10.0.0.210 () {62 vars in 1490 bytes} [Thu Apr 13 16:36:46 2023] GET /compute/v2.1/servers/bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f/os-volume_attachments/db98e2a6-2772-4d6b-80fc-67f564ded02b => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:36:46 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-a97a0e87-bc01-4de6-a4d6-805536885c9a tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:36:46 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-a97a0e87-bc01-4de6-a4d6-805536885c9a tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:36:46 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-a97a0e87-bc01-4de6-a4d6-805536885c9a tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:36:46 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-a97a0e87-bc01-4de6-a4d6-805536885c9a tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:36:46 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-a97a0e87-bc01-4de6-a4d6-805536885c9a tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:36:46 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-a97a0e87-bc01-4de6-a4d6-805536885c9a tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:36:46 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-a97a0e87-bc01-4de6-a4d6-805536885c9a tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:36:46 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-a97a0e87-bc01-4de6-a4d6-805536885c9a tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:36:46 user devstack@n-api.service[62053]: DEBUG nova.objects.instance [None req-a97a0e87-bc01-4de6-a4d6-805536885c9a tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lazy-loading 'services' on Instance uuid bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f {{(pid=62053) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 16:36:46 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-a97a0e87-bc01-4de6-a4d6-805536885c9a tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f/os-volume_attachments/db98e2a6-2772-4d6b-80fc-67f564ded02b" status: 202 len: 0 microversion: 2.1 time: 0.157472 Apr 13 16:36:46 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 248/739] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 16:36:46 2023] DELETE /compute/v2.1/servers/bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f/os-volume_attachments/db98e2a6-2772-4d6b-80fc-67f564ded02b => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 16:36:49 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-81fd518a-2de1-47b1-9470-0c9f22b43dc5 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:36:49 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-81fd518a-2de1-47b1-9470-0c9f22b43dc5 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:36:49 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-81fd518a-2de1-47b1-9470-0c9f22b43dc5 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:36:49 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-81fd518a-2de1-47b1-9470-0c9f22b43dc5 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:36:49 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-81fd518a-2de1-47b1-9470-0c9f22b43dc5 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:36:49 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-81fd518a-2de1-47b1-9470-0c9f22b43dc5 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:36:49 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-81fd518a-2de1-47b1-9470-0c9f22b43dc5 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:36:49 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-81fd518a-2de1-47b1-9470-0c9f22b43dc5 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:36:49 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-81fd518a-2de1-47b1-9470-0c9f22b43dc5 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046297 Apr 13 16:36:49 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 247/740] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 16:36:49 2023] GET /compute/v2.1/servers/bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 16:36:49 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-fbdedcd1-bf03-46ed-8c3d-233d7069f82c tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:36:49 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-fbdedcd1-bf03-46ed-8c3d-233d7069f82c tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:36:49 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-fbdedcd1-bf03-46ed-8c3d-233d7069f82c tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:36:49 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-fbdedcd1-bf03-46ed-8c3d-233d7069f82c tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:36:49 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-fbdedcd1-bf03-46ed-8c3d-233d7069f82c tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:36:49 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-fbdedcd1-bf03-46ed-8c3d-233d7069f82c tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:36:49 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-fbdedcd1-bf03-46ed-8c3d-233d7069f82c tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:36:49 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-fbdedcd1-bf03-46ed-8c3d-233d7069f82c tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:36:49 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-fbdedcd1-bf03-46ed-8c3d-233d7069f82c tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053166 Apr 13 16:36:49 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 246/741] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 16:36:49 2023] GET /compute/v2.1/servers/bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 16:36:49 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-df36a749-5094-4bbd-bdba-3ae092dc6127 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:36:49 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-df36a749-5094-4bbd-bdba-3ae092dc6127 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:36:49 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-df36a749-5094-4bbd-bdba-3ae092dc6127 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:36:49 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-df36a749-5094-4bbd-bdba-3ae092dc6127 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:36:49 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-df36a749-5094-4bbd-bdba-3ae092dc6127 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:36:49 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-df36a749-5094-4bbd-bdba-3ae092dc6127 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:36:49 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-df36a749-5094-4bbd-bdba-3ae092dc6127 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:36:49 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-df36a749-5094-4bbd-bdba-3ae092dc6127 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:36:49 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-df36a749-5094-4bbd-bdba-3ae092dc6127 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f] Going to try to terminate instance {{(pid=62053) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 16:36:49 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-df36a749-5094-4bbd-bdba-3ae092dc6127 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f" status: 204 len: 0 microversion: 2.1 time: 0.112629 Apr 13 16:36:49 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 249/742] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 16:36:49 2023] DELETE /compute/v2.1/servers/bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 16:36:49 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-1ada7d1e-a7fe-4de3-a499-818d6c9c8e16 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:36:49 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-1ada7d1e-a7fe-4de3-a499-818d6c9c8e16 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:36:49 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-1ada7d1e-a7fe-4de3-a499-818d6c9c8e16 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:36:49 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-1ada7d1e-a7fe-4de3-a499-818d6c9c8e16 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:36:49 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-1ada7d1e-a7fe-4de3-a499-818d6c9c8e16 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:36:49 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-1ada7d1e-a7fe-4de3-a499-818d6c9c8e16 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:36:49 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-1ada7d1e-a7fe-4de3-a499-818d6c9c8e16 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:36:49 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-1ada7d1e-a7fe-4de3-a499-818d6c9c8e16 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:36:49 user devstack@n-api.service[62054]: DEBUG nova.policy [None req-1ada7d1e-a7fe-4de3-a499-818d6c9c8e16 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47fab402fb794a5a9281cfb7fe188813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24904988cf334657b084fd726c7ecf8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62054) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:36:49 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-1ada7d1e-a7fe-4de3-a499-818d6c9c8e16 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f" status: 200 len: 1664 microversion: 2.1 time: 0.246385 Apr 13 16:36:49 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 248/743] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:36:49 2023] GET /compute/v2.1/servers/bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f => generated 1664 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:36:49 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [req-c3ec3535-01aa-414b-8768-9e9d41efc98b req-31e77605-983e-45c2-932a-1133cf00b0dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f", "name": "network-vif-unplugged", "status": "completed", "tag": "adf9438c-79e3-494a-8650-1b7377eb1062"}]} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:36:49 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-c3ec3535-01aa-414b-8768-9e9d41efc98b req-31e77605-983e-45c2-932a-1133cf00b0dd service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:36:49 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-c3ec3535-01aa-414b-8768-9e9d41efc98b req-31e77605-983e-45c2-932a-1133cf00b0dd service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:36:49 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-c3ec3535-01aa-414b-8768-9e9d41efc98b req-31e77605-983e-45c2-932a-1133cf00b0dd service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:36:49 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-c3ec3535-01aa-414b-8768-9e9d41efc98b req-31e77605-983e-45c2-932a-1133cf00b0dd service nova] Creating event network-vif-unplugged:adf9438c-79e3-494a-8650-1b7377eb1062 for instance bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f on user Apr 13 16:36:49 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [req-c3ec3535-01aa-414b-8768-9e9d41efc98b req-31e77605-983e-45c2-932a-1133cf00b0dd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031624 Apr 13 16:36:49 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 247/744] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:36:49 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:36:51 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-a39ec604-d119-4600-9f67-bc95efa24c7f req-27e51a92-71fe-4c84-93d2-6e36b73bebfe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f", "name": "network-vif-deleted", "tag": "adf9438c-79e3-494a-8650-1b7377eb1062"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:36:51 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-a39ec604-d119-4600-9f67-bc95efa24c7f req-27e51a92-71fe-4c84-93d2-6e36b73bebfe service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:36:51 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-a39ec604-d119-4600-9f67-bc95efa24c7f req-27e51a92-71fe-4c84-93d2-6e36b73bebfe service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:36:51 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-a39ec604-d119-4600-9f67-bc95efa24c7f req-27e51a92-71fe-4c84-93d2-6e36b73bebfe service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:36:51 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-a39ec604-d119-4600-9f67-bc95efa24c7f req-27e51a92-71fe-4c84-93d2-6e36b73bebfe service nova] Creating event network-vif-deleted:adf9438c-79e3-494a-8650-1b7377eb1062 for instance bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f on user Apr 13 16:36:51 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [req-a39ec604-d119-4600-9f67-bc95efa24c7f req-27e51a92-71fe-4c84-93d2-6e36b73bebfe service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028468 Apr 13 16:36:51 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 250/745] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:36:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:36:52 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-48ed2716-bda3-4553-9e9d-296d2579b5c5 req-6202ac3d-de8e-4426-ad53-ecb17238eff2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f", "name": "network-vif-plugged", "status": "completed", "tag": "adf9438c-79e3-494a-8650-1b7377eb1062"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:36:52 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-48ed2716-bda3-4553-9e9d-296d2579b5c5 req-6202ac3d-de8e-4426-ad53-ecb17238eff2 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:36:52 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-48ed2716-bda3-4553-9e9d-296d2579b5c5 req-6202ac3d-de8e-4426-ad53-ecb17238eff2 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:36:52 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-48ed2716-bda3-4553-9e9d-296d2579b5c5 req-6202ac3d-de8e-4426-ad53-ecb17238eff2 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:36:52 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-48ed2716-bda3-4553-9e9d-296d2579b5c5 req-6202ac3d-de8e-4426-ad53-ecb17238eff2 service nova] Creating event network-vif-plugged:adf9438c-79e3-494a-8650-1b7377eb1062 for instance bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f on user Apr 13 16:36:52 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [req-48ed2716-bda3-4553-9e9d-296d2579b5c5 req-6202ac3d-de8e-4426-ad53-ecb17238eff2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031611 Apr 13 16:36:52 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 249/746] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:36:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:37:09 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_api:SELECT=5 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:37:09 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_cell1:SELECT=13 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:37:09 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-ea6a7b68-19e1-45d8-bcdb-631184bc86b2 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:37:09 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-ea6a7b68-19e1-45d8-bcdb-631184bc86b2 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:37:09 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-ea6a7b68-19e1-45d8-bcdb-631184bc86b2 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:37:09 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-ea6a7b68-19e1-45d8-bcdb-631184bc86b2 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:37:09 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-ea6a7b68-19e1-45d8-bcdb-631184bc86b2 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:37:09 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-ea6a7b68-19e1-45d8-bcdb-631184bc86b2 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:37:09 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-ea6a7b68-19e1-45d8-bcdb-631184bc86b2 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:37:09 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-ea6a7b68-19e1-45d8-bcdb-631184bc86b2 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:37:09 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-ea6a7b68-19e1-45d8-bcdb-631184bc86b2 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Going to try to terminate instance {{(pid=62055) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 16:37:09 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-ea6a7b68-19e1-45d8-bcdb-631184bc86b2 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/acbcaee0-a47b-4fee-8765-9b1c9597d515" status: 204 len: 0 microversion: 2.1 time: 0.184602 Apr 13 16:37:09 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 248/747] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 16:37:09 2023] DELETE /compute/v2.1/servers/acbcaee0-a47b-4fee-8765-9b1c9597d515 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 16:37:09 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_api:SELECT=12,nova_api:UPDATE=1 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:37:09 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_cell1:SELECT=31,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:37:09 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-94834417-fd4a-49f2-8002-a7429d069c7a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:37:09 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-94834417-fd4a-49f2-8002-a7429d069c7a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:37:09 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-94834417-fd4a-49f2-8002-a7429d069c7a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:37:09 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-94834417-fd4a-49f2-8002-a7429d069c7a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:37:09 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-94834417-fd4a-49f2-8002-a7429d069c7a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:37:09 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-94834417-fd4a-49f2-8002-a7429d069c7a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:37:09 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-94834417-fd4a-49f2-8002-a7429d069c7a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:37:09 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-94834417-fd4a-49f2-8002-a7429d069c7a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:37:09 user devstack@n-api.service[62053]: DEBUG nova.policy [None req-94834417-fd4a-49f2-8002-a7429d069c7a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b3df1c5c5d441819bcef89ed6966815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980559734a504574a83224deb7423c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62053) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:37:09 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-94834417-fd4a-49f2-8002-a7429d069c7a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] 10.0.0.210 "GET /compute/v2.1/servers/acbcaee0-a47b-4fee-8765-9b1c9597d515" status: 200 len: 1729 microversion: 2.1 time: 0.170131 Apr 13 16:37:09 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 251/748] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:37:09 2023] GET /compute/v2.1/servers/acbcaee0-a47b-4fee-8765-9b1c9597d515 => generated 1729 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:37:10 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_api:SELECT=17,nova_api:DELETE=1 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:37:10 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:37:10 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-95003d2d-a2f4-4138-95f1-ae196af82a2a req-13eaa2ab-6ae3-4a60-a766-8a0ae82fcd2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acbcaee0-a47b-4fee-8765-9b1c9597d515", "name": "network-vif-unplugged", "status": "completed", "tag": "13471516-9514-4b85-938f-69657c2990e5"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:37:10 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-95003d2d-a2f4-4138-95f1-ae196af82a2a req-13eaa2ab-6ae3-4a60-a766-8a0ae82fcd2b service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:37:10 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-95003d2d-a2f4-4138-95f1-ae196af82a2a req-13eaa2ab-6ae3-4a60-a766-8a0ae82fcd2b service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:37:10 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-95003d2d-a2f4-4138-95f1-ae196af82a2a req-13eaa2ab-6ae3-4a60-a766-8a0ae82fcd2b service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:37:10 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-95003d2d-a2f4-4138-95f1-ae196af82a2a req-13eaa2ab-6ae3-4a60-a766-8a0ae82fcd2b service nova] Creating event network-vif-unplugged:13471516-9514-4b85-938f-69657c2990e5 for instance acbcaee0-a47b-4fee-8765-9b1c9597d515 on user Apr 13 16:37:10 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [req-95003d2d-a2f4-4138-95f1-ae196af82a2a req-13eaa2ab-6ae3-4a60-a766-8a0ae82fcd2b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.056321 Apr 13 16:37:10 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 250/749] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:37:10 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:37:11 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [req-47ddf54f-f433-42ac-a356-cdffa01b99ec req-6171d127-cbf4-446f-9fb4-3b90e3df7b69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acbcaee0-a47b-4fee-8765-9b1c9597d515", "name": "network-vif-deleted", "tag": "13471516-9514-4b85-938f-69657c2990e5"}]} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:37:11 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-47ddf54f-f433-42ac-a356-cdffa01b99ec req-6171d127-cbf4-446f-9fb4-3b90e3df7b69 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:37:11 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-47ddf54f-f433-42ac-a356-cdffa01b99ec req-6171d127-cbf4-446f-9fb4-3b90e3df7b69 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:37:11 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-47ddf54f-f433-42ac-a356-cdffa01b99ec req-6171d127-cbf4-446f-9fb4-3b90e3df7b69 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:37:11 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-47ddf54f-f433-42ac-a356-cdffa01b99ec req-6171d127-cbf4-446f-9fb4-3b90e3df7b69 service nova] Creating event network-vif-deleted:13471516-9514-4b85-938f-69657c2990e5 for instance acbcaee0-a47b-4fee-8765-9b1c9597d515 on user Apr 13 16:37:11 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [req-47ddf54f-f433-42ac-a356-cdffa01b99ec req-6171d127-cbf4-446f-9fb4-3b90e3df7b69 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037709 Apr 13 16:37:11 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 249/750] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:37:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 16:37:12 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-fd9216bd-474a-4c5b-bd34-6405ec987b37 req-5815fd47-5cf5-474c-869b-19f2633311d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acbcaee0-a47b-4fee-8765-9b1c9597d515", "name": "network-vif-plugged", "status": "completed", "tag": "13471516-9514-4b85-938f-69657c2990e5"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:37:12 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-fd9216bd-474a-4c5b-bd34-6405ec987b37 req-5815fd47-5cf5-474c-869b-19f2633311d6 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:37:12 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-fd9216bd-474a-4c5b-bd34-6405ec987b37 req-5815fd47-5cf5-474c-869b-19f2633311d6 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:37:12 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-fd9216bd-474a-4c5b-bd34-6405ec987b37 req-5815fd47-5cf5-474c-869b-19f2633311d6 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:37:12 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-fd9216bd-474a-4c5b-bd34-6405ec987b37 req-5815fd47-5cf5-474c-869b-19f2633311d6 service nova] Creating event network-vif-plugged:13471516-9514-4b85-938f-69657c2990e5 for instance acbcaee0-a47b-4fee-8765-9b1c9597d515 on user Apr 13 16:37:12 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [req-fd9216bd-474a-4c5b-bd34-6405ec987b37 req-5815fd47-5cf5-474c-869b-19f2633311d6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030313 Apr 13 16:37:12 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 252/751] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:37:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:37:16 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-fce080f3-55b4-4f81-814b-1ae2219c570d tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:37:16 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-fce080f3-55b4-4f81-814b-1ae2219c570d tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 0a5c9b2c-fe1e-4a21-b213-c63e2c28748a] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:37:16 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-fce080f3-55b4-4f81-814b-1ae2219c570d tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:37:16 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-fce080f3-55b4-4f81-814b-1ae2219c570d tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:37:16 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-fce080f3-55b4-4f81-814b-1ae2219c570d tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:37:16 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-fce080f3-55b4-4f81-814b-1ae2219c570d tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:37:16 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-fce080f3-55b4-4f81-814b-1ae2219c570d tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:37:16 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-fce080f3-55b4-4f81-814b-1ae2219c570d tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:37:16 user devstack@n-api.service[62054]: DEBUG nova.policy [None req-fce080f3-55b4-4f81-814b-1ae2219c570d tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e10f63cdd49a9a1ebe1fe4c9de0a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d451e0e239f486aa2b3abe9e273eab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62054) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:37:16 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-fce080f3-55b4-4f81-814b-1ae2219c570d tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0a5c9b2c-fe1e-4a21-b213-c63e2c28748a" status: 200 len: 1442 microversion: 2.1 time: 0.161565 Apr 13 16:37:16 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 251/752] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:37:16 2023] GET /compute/v2.1/servers/0a5c9b2c-fe1e-4a21-b213-c63e2c28748a => generated 1442 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:37:18 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [req-762516f9-4908-427c-96ab-4142a5b92693 req-940f25e0-6777-4501-b689-90b5e4cfeba3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a5c9b2c-fe1e-4a21-b213-c63e2c28748a", "tag": "ee0eba83-c6e1-4415-96d1-e5b496ec0afe"}]} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:37:18 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-762516f9-4908-427c-96ab-4142a5b92693 req-940f25e0-6777-4501-b689-90b5e4cfeba3 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:37:18 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-762516f9-4908-427c-96ab-4142a5b92693 req-940f25e0-6777-4501-b689-90b5e4cfeba3 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:37:18 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-762516f9-4908-427c-96ab-4142a5b92693 req-940f25e0-6777-4501-b689-90b5e4cfeba3 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:37:18 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-762516f9-4908-427c-96ab-4142a5b92693 req-940f25e0-6777-4501-b689-90b5e4cfeba3 service nova] Creating event network-changed:ee0eba83-c6e1-4415-96d1-e5b496ec0afe for instance 0a5c9b2c-fe1e-4a21-b213-c63e2c28748a on user Apr 13 16:37:18 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [req-762516f9-4908-427c-96ab-4142a5b92693 req-940f25e0-6777-4501-b689-90b5e4cfeba3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030096 Apr 13 16:37:18 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 250/753] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:37:18 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:37:19 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-9e938d63-1c66-4c4f-b8a1-1d6daf2d88e4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:37:19 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-9e938d63-1c66-4c4f-b8a1-1d6daf2d88e4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 0a5c9b2c-fe1e-4a21-b213-c63e2c28748a] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:37:19 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-9e938d63-1c66-4c4f-b8a1-1d6daf2d88e4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:37:19 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-9e938d63-1c66-4c4f-b8a1-1d6daf2d88e4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:37:19 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-9e938d63-1c66-4c4f-b8a1-1d6daf2d88e4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:37:19 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-9e938d63-1c66-4c4f-b8a1-1d6daf2d88e4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:37:19 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-9e938d63-1c66-4c4f-b8a1-1d6daf2d88e4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:37:19 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-9e938d63-1c66-4c4f-b8a1-1d6daf2d88e4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:37:19 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-9e938d63-1c66-4c4f-b8a1-1d6daf2d88e4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 0a5c9b2c-fe1e-4a21-b213-c63e2c28748a] Going to try to terminate instance {{(pid=62053) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 16:37:19 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-9e938d63-1c66-4c4f-b8a1-1d6daf2d88e4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0a5c9b2c-fe1e-4a21-b213-c63e2c28748a" status: 204 len: 0 microversion: 2.1 time: 0.117924 Apr 13 16:37:19 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 253/754] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 16:37:19 2023] DELETE /compute/v2.1/servers/0a5c9b2c-fe1e-4a21-b213-c63e2c28748a => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 16:37:19 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-83f04476-086b-44b4-a008-e4f3bc41c2ba tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:37:19 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-83f04476-086b-44b4-a008-e4f3bc41c2ba tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 0a5c9b2c-fe1e-4a21-b213-c63e2c28748a] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:37:19 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-83f04476-086b-44b4-a008-e4f3bc41c2ba tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:37:19 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-83f04476-086b-44b4-a008-e4f3bc41c2ba tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:37:19 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-83f04476-086b-44b4-a008-e4f3bc41c2ba tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:37:19 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-83f04476-086b-44b4-a008-e4f3bc41c2ba tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:37:19 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-83f04476-086b-44b4-a008-e4f3bc41c2ba tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:37:19 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-83f04476-086b-44b4-a008-e4f3bc41c2ba tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:37:19 user devstack@n-api.service[62055]: DEBUG nova.policy [None req-83f04476-086b-44b4-a008-e4f3bc41c2ba tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e10f63cdd49a9a1ebe1fe4c9de0a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d451e0e239f486aa2b3abe9e273eab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62055) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:37:19 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-f95e880d-a93f-4116-b771-765b49c4f911 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:37:19 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-f95e880d-a93f-4116-b771-765b49c4f911 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:37:19 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-f95e880d-a93f-4116-b771-765b49c4f911 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:37:19 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-f95e880d-a93f-4116-b771-765b49c4f911 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:37:19 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-f95e880d-a93f-4116-b771-765b49c4f911 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:37:19 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-83f04476-086b-44b4-a008-e4f3bc41c2ba tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0a5c9b2c-fe1e-4a21-b213-c63e2c28748a" status: 200 len: 1566 microversion: 2.1 time: 0.205879 Apr 13 16:37:19 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-f95e880d-a93f-4116-b771-765b49c4f911 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:37:19 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 251/755] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:37:19 2023] GET /compute/v2.1/servers/0a5c9b2c-fe1e-4a21-b213-c63e2c28748a => generated 1566 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:37:19 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-f95e880d-a93f-4116-b771-765b49c4f911 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:37:19 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-f95e880d-a93f-4116-b771-765b49c4f911 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:37:19 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-f95e880d-a93f-4116-b771-765b49c4f911 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] Going to try to terminate instance {{(pid=62054) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 16:37:19 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-f95e880d-a93f-4116-b771-765b49c4f911 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/2956ab05-28ff-4c9e-b646-dbb83b3db278" status: 204 len: 0 microversion: 2.87 time: 0.436838 Apr 13 16:37:19 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 252/756] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 13 16:37:19 2023] DELETE /compute/v2.1/servers/2956ab05-28ff-4c9e-b646-dbb83b3db278 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 13 16:37:19 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-298cece2-57d0-4b4d-a4d1-c3779228d1b7 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:37:19 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-298cece2-57d0-4b4d-a4d1-c3779228d1b7 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:37:19 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-298cece2-57d0-4b4d-a4d1-c3779228d1b7 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:37:19 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-298cece2-57d0-4b4d-a4d1-c3779228d1b7 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:37:19 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-298cece2-57d0-4b4d-a4d1-c3779228d1b7 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:37:19 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-298cece2-57d0-4b4d-a4d1-c3779228d1b7 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:37:19 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-298cece2-57d0-4b4d-a4d1-c3779228d1b7 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:37:19 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-298cece2-57d0-4b4d-a4d1-c3779228d1b7 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:37:19 user devstack@n-api.service[62053]: DEBUG nova.policy [None req-298cece2-57d0-4b4d-a4d1-c3779228d1b7 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45a882dbafb4ea4976e4f45289eb2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d09a74bf684a9fb1dd1e95d6c23f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62053) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:37:19 user devstack@n-api.service[62053]: DEBUG nova.policy [None req-298cece2-57d0-4b4d-a4d1-c3779228d1b7 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e45a882dbafb4ea4976e4f45289eb2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d09a74bf684a9fb1dd1e95d6c23f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62053) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:37:19 user devstack@n-api.service[62053]: DEBUG nova.policy [None req-298cece2-57d0-4b4d-a4d1-c3779228d1b7 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e45a882dbafb4ea4976e4f45289eb2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d09a74bf684a9fb1dd1e95d6c23f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62053) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:37:19 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-298cece2-57d0-4b4d-a4d1-c3779228d1b7 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2956ab05-28ff-4c9e-b646-dbb83b3db278" status: 200 len: 1774 microversion: 2.87 time: 0.233498 Apr 13 16:37:19 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 254/757] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 16:37:19 2023] GET /compute/v2.1/servers/2956ab05-28ff-4c9e-b646-dbb83b3db278 => generated 1774 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 16:37:19 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [req-b27fbd26-e49b-4346-b8fe-bacce1aa81f9 req-2620bd19-dc7c-4e08-8d77-dc0702c5da5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2956ab05-28ff-4c9e-b646-dbb83b3db278", "name": "network-vif-unplugged", "status": "completed", "tag": "84df62e9-af7c-4e62-83da-b43b511be2a0"}]} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:37:19 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-b27fbd26-e49b-4346-b8fe-bacce1aa81f9 req-2620bd19-dc7c-4e08-8d77-dc0702c5da5c service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:37:19 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-b27fbd26-e49b-4346-b8fe-bacce1aa81f9 req-2620bd19-dc7c-4e08-8d77-dc0702c5da5c service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:37:19 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-b27fbd26-e49b-4346-b8fe-bacce1aa81f9 req-2620bd19-dc7c-4e08-8d77-dc0702c5da5c service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:37:20 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-b27fbd26-e49b-4346-b8fe-bacce1aa81f9 req-2620bd19-dc7c-4e08-8d77-dc0702c5da5c service nova] Creating event network-vif-unplugged:84df62e9-af7c-4e62-83da-b43b511be2a0 for instance 2956ab05-28ff-4c9e-b646-dbb83b3db278 on user Apr 13 16:37:20 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [req-b27fbd26-e49b-4346-b8fe-bacce1aa81f9 req-2620bd19-dc7c-4e08-8d77-dc0702c5da5c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.171853 Apr 13 16:37:20 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 252/758] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:37:19 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:37:20 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-c69676e0-71c2-4a15-99ae-418a37107556 req-c6ff3f62-2279-48a1-a86e-18f4b55616b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a5c9b2c-fe1e-4a21-b213-c63e2c28748a", "tag": "ee0eba83-c6e1-4415-96d1-e5b496ec0afe"}, {"server_uuid": "0a5c9b2c-fe1e-4a21-b213-c63e2c28748a", "name": "network-vif-unplugged", "status": "completed", "tag": "ee0eba83-c6e1-4415-96d1-e5b496ec0afe"}, {"server_uuid": "0a5c9b2c-fe1e-4a21-b213-c63e2c28748a", "name": "network-vif-plugged", "status": "completed", "tag": "ee0eba83-c6e1-4415-96d1-e5b496ec0afe"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:37:20 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-c69676e0-71c2-4a15-99ae-418a37107556 req-c6ff3f62-2279-48a1-a86e-18f4b55616b0 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:37:20 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-c69676e0-71c2-4a15-99ae-418a37107556 req-c6ff3f62-2279-48a1-a86e-18f4b55616b0 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:37:20 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-c69676e0-71c2-4a15-99ae-418a37107556 req-c6ff3f62-2279-48a1-a86e-18f4b55616b0 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:37:20 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-c69676e0-71c2-4a15-99ae-418a37107556 req-c6ff3f62-2279-48a1-a86e-18f4b55616b0 service nova] Creating event network-changed:ee0eba83-c6e1-4415-96d1-e5b496ec0afe for instance 0a5c9b2c-fe1e-4a21-b213-c63e2c28748a on user Apr 13 16:37:20 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-c69676e0-71c2-4a15-99ae-418a37107556 req-c6ff3f62-2279-48a1-a86e-18f4b55616b0 service nova] Creating event network-vif-unplugged:ee0eba83-c6e1-4415-96d1-e5b496ec0afe for instance 0a5c9b2c-fe1e-4a21-b213-c63e2c28748a on user Apr 13 16:37:20 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-c69676e0-71c2-4a15-99ae-418a37107556 req-c6ff3f62-2279-48a1-a86e-18f4b55616b0 service nova] Creating event network-vif-plugged:ee0eba83-c6e1-4415-96d1-e5b496ec0afe for instance 0a5c9b2c-fe1e-4a21-b213-c63e2c28748a on user Apr 13 16:37:20 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [req-c69676e0-71c2-4a15-99ae-418a37107556 req-c6ff3f62-2279-48a1-a86e-18f4b55616b0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 523 microversion: 2.1 time: 0.042909 Apr 13 16:37:20 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 253/759] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:37:20 2023] POST /compute/v2.1/os-server-external-events => generated 523 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:37:21 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-0e2aeca1-6d67-4ca2-920e-83fb4ffb3781 req-b1050d80-26c0-476e-87d0-68bd033cf2f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2956ab05-28ff-4c9e-b646-dbb83b3db278", "name": "network-vif-deleted", "tag": "84df62e9-af7c-4e62-83da-b43b511be2a0"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:37:21 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-0e2aeca1-6d67-4ca2-920e-83fb4ffb3781 req-b1050d80-26c0-476e-87d0-68bd033cf2f2 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:37:21 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-0e2aeca1-6d67-4ca2-920e-83fb4ffb3781 req-b1050d80-26c0-476e-87d0-68bd033cf2f2 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:37:21 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-0e2aeca1-6d67-4ca2-920e-83fb4ffb3781 req-b1050d80-26c0-476e-87d0-68bd033cf2f2 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:37:21 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-0e2aeca1-6d67-4ca2-920e-83fb4ffb3781 req-b1050d80-26c0-476e-87d0-68bd033cf2f2 service nova] Creating event network-vif-deleted:84df62e9-af7c-4e62-83da-b43b511be2a0 for instance 2956ab05-28ff-4c9e-b646-dbb83b3db278 on user Apr 13 16:37:21 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [req-0e2aeca1-6d67-4ca2-920e-83fb4ffb3781 req-b1050d80-26c0-476e-87d0-68bd033cf2f2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038350 Apr 13 16:37:21 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 255/760] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:37:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:37:22 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [req-a5ce26b7-b570-4fd1-95e8-b1d488656c98 req-7451037a-ba66-4544-b979-cdfa354193ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2956ab05-28ff-4c9e-b646-dbb83b3db278", "name": "network-vif-plugged", "status": "completed", "tag": "84df62e9-af7c-4e62-83da-b43b511be2a0"}]} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:37:22 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-a5ce26b7-b570-4fd1-95e8-b1d488656c98 req-7451037a-ba66-4544-b979-cdfa354193ea service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:37:22 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-a5ce26b7-b570-4fd1-95e8-b1d488656c98 req-7451037a-ba66-4544-b979-cdfa354193ea service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:37:22 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-a5ce26b7-b570-4fd1-95e8-b1d488656c98 req-7451037a-ba66-4544-b979-cdfa354193ea service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:37:22 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-a5ce26b7-b570-4fd1-95e8-b1d488656c98 req-7451037a-ba66-4544-b979-cdfa354193ea service nova] Creating event network-vif-plugged:84df62e9-af7c-4e62-83da-b43b511be2a0 for instance 2956ab05-28ff-4c9e-b646-dbb83b3db278 on user Apr 13 16:37:22 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [req-a5ce26b7-b570-4fd1-95e8-b1d488656c98 req-7451037a-ba66-4544-b979-cdfa354193ea service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027852 Apr 13 16:37:22 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 253/761] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:37:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:37:22 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-531e9256-cebc-433e-95c3-915fe30db6ba req-58563782-77be-4af6-9b2f-d8f481f9a4a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a5c9b2c-fe1e-4a21-b213-c63e2c28748a", "name": "network-vif-plugged", "status": "completed", "tag": "ee0eba83-c6e1-4415-96d1-e5b496ec0afe"}, {"server_uuid": "0a5c9b2c-fe1e-4a21-b213-c63e2c28748a", "name": "network-vif-plugged", "status": "completed", "tag": "ee0eba83-c6e1-4415-96d1-e5b496ec0afe"}, {"server_uuid": "0a5c9b2c-fe1e-4a21-b213-c63e2c28748a", "name": "network-vif-unplugged", "status": "completed", "tag": "ee0eba83-c6e1-4415-96d1-e5b496ec0afe"}, {"server_uuid": "0a5c9b2c-fe1e-4a21-b213-c63e2c28748a", "name": "network-vif-plugged", "status": "completed", "tag": "ee0eba83-c6e1-4415-96d1-e5b496ec0afe"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:37:22 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-531e9256-cebc-433e-95c3-915fe30db6ba req-58563782-77be-4af6-9b2f-d8f481f9a4a5 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:37:22 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-531e9256-cebc-433e-95c3-915fe30db6ba req-58563782-77be-4af6-9b2f-d8f481f9a4a5 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:37:22 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-531e9256-cebc-433e-95c3-915fe30db6ba req-58563782-77be-4af6-9b2f-d8f481f9a4a5 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:37:22 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-531e9256-cebc-433e-95c3-915fe30db6ba req-58563782-77be-4af6-9b2f-d8f481f9a4a5 service nova] Creating event network-vif-plugged:ee0eba83-c6e1-4415-96d1-e5b496ec0afe for instance 0a5c9b2c-fe1e-4a21-b213-c63e2c28748a on user Apr 13 16:37:22 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-531e9256-cebc-433e-95c3-915fe30db6ba req-58563782-77be-4af6-9b2f-d8f481f9a4a5 service nova] Creating event network-vif-plugged:ee0eba83-c6e1-4415-96d1-e5b496ec0afe for instance 0a5c9b2c-fe1e-4a21-b213-c63e2c28748a on user Apr 13 16:37:22 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-531e9256-cebc-433e-95c3-915fe30db6ba req-58563782-77be-4af6-9b2f-d8f481f9a4a5 service nova] Creating event network-vif-unplugged:ee0eba83-c6e1-4415-96d1-e5b496ec0afe for instance 0a5c9b2c-fe1e-4a21-b213-c63e2c28748a on user Apr 13 16:37:22 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-531e9256-cebc-433e-95c3-915fe30db6ba req-58563782-77be-4af6-9b2f-d8f481f9a4a5 service nova] Creating event network-vif-plugged:ee0eba83-c6e1-4415-96d1-e5b496ec0afe for instance 0a5c9b2c-fe1e-4a21-b213-c63e2c28748a on user Apr 13 16:37:22 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [req-531e9256-cebc-433e-95c3-915fe30db6ba req-58563782-77be-4af6-9b2f-d8f481f9a4a5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 698 microversion: 2.1 time: 0.036406 Apr 13 16:37:22 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 254/762] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:37:22 2023] POST /compute/v2.1/os-server-external-events => generated 698 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:37:23 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-fd280422-69d8-49f2-99ca-227f05ecbd12 req-5dd067d2-5fd9-4f07-a7fd-34aa3665b019 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a5c9b2c-fe1e-4a21-b213-c63e2c28748a", "name": "network-vif-deleted", "tag": "ee0eba83-c6e1-4415-96d1-e5b496ec0afe"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:37:23 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-fd280422-69d8-49f2-99ca-227f05ecbd12 req-5dd067d2-5fd9-4f07-a7fd-34aa3665b019 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:37:23 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-fd280422-69d8-49f2-99ca-227f05ecbd12 req-5dd067d2-5fd9-4f07-a7fd-34aa3665b019 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:37:23 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-fd280422-69d8-49f2-99ca-227f05ecbd12 req-5dd067d2-5fd9-4f07-a7fd-34aa3665b019 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:37:23 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-fd280422-69d8-49f2-99ca-227f05ecbd12 req-5dd067d2-5fd9-4f07-a7fd-34aa3665b019 service nova] Creating event network-vif-deleted:ee0eba83-c6e1-4415-96d1-e5b496ec0afe for instance 0a5c9b2c-fe1e-4a21-b213-c63e2c28748a on user Apr 13 16:37:23 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [req-fd280422-69d8-49f2-99ca-227f05ecbd12 req-5dd067d2-5fd9-4f07-a7fd-34aa3665b019 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028439 Apr 13 16:37:23 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 256/763] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:37:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:37:33 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:37:33 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:37:33 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-8c51b58b-8672-4f91-8ffe-926f3a2e9583 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:37:33 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-8c51b58b-8672-4f91-8ffe-926f3a2e9583 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:37:33 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-8c51b58b-8672-4f91-8ffe-926f3a2e9583 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:37:33 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-8c51b58b-8672-4f91-8ffe-926f3a2e9583 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:37:33 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-8c51b58b-8672-4f91-8ffe-926f3a2e9583 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:37:33 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-8c51b58b-8672-4f91-8ffe-926f3a2e9583 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:37:33 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-8c51b58b-8672-4f91-8ffe-926f3a2e9583 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:37:33 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-8c51b58b-8672-4f91-8ffe-926f3a2e9583 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:37:33 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-8c51b58b-8672-4f91-8ffe-926f3a2e9583 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] 10.0.0.210 "GET /compute/v2.1/servers/35b23303-e373-4f35-b7ee-76e6815073ce/os-volume_attachments/8156a054-43ea-4eeb-bbec-a270a6779a43" status: 200 len: 194 microversion: 2.20 time: 0.144733 Apr 13 16:37:33 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 254/764] 10.0.0.210 () {64 vars in 1531 bytes} [Thu Apr 13 16:37:33 2023] GET /compute/v2.1/servers/35b23303-e373-4f35-b7ee-76e6815073ce/os-volume_attachments/8156a054-43ea-4eeb-bbec-a270a6779a43 => generated 194 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 16:37:33 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:37:33 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:37:33 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-38df707c-b89b-46c5-8ea6-46e7adf2983b tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:37:33 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-38df707c-b89b-46c5-8ea6-46e7adf2983b tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:37:33 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-38df707c-b89b-46c5-8ea6-46e7adf2983b tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:37:33 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-38df707c-b89b-46c5-8ea6-46e7adf2983b tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:37:33 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-38df707c-b89b-46c5-8ea6-46e7adf2983b tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:37:33 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-38df707c-b89b-46c5-8ea6-46e7adf2983b tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:37:33 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-38df707c-b89b-46c5-8ea6-46e7adf2983b tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:37:33 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-38df707c-b89b-46c5-8ea6-46e7adf2983b tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:37:33 user devstack@n-api.service[62054]: DEBUG nova.objects.instance [None req-38df707c-b89b-46c5-8ea6-46e7adf2983b tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lazy-loading 'services' on Instance uuid 35b23303-e373-4f35-b7ee-76e6815073ce {{(pid=62054) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 16:37:33 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-38df707c-b89b-46c5-8ea6-46e7adf2983b tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/35b23303-e373-4f35-b7ee-76e6815073ce/os-volume_attachments/8156a054-43ea-4eeb-bbec-a270a6779a43" status: 202 len: 0 microversion: 2.20 time: 0.201483 Apr 13 16:37:33 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 255/765] 10.0.0.210 () {64 vars in 1534 bytes} [Thu Apr 13 16:37:33 2023] DELETE /compute/v2.1/servers/35b23303-e373-4f35-b7ee-76e6815073ce/os-volume_attachments/8156a054-43ea-4eeb-bbec-a270a6779a43 => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 13 16:37:33 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-4a09403b-725f-46d0-862d-b4cc8f9eb7d5 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:37:33 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-4a09403b-725f-46d0-862d-b4cc8f9eb7d5 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:37:33 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-4a09403b-725f-46d0-862d-b4cc8f9eb7d5 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:37:33 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-4a09403b-725f-46d0-862d-b4cc8f9eb7d5 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:37:33 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-4a09403b-725f-46d0-862d-b4cc8f9eb7d5 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:37:33 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-4a09403b-725f-46d0-862d-b4cc8f9eb7d5 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:37:33 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-4a09403b-725f-46d0-862d-b4cc8f9eb7d5 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:37:33 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-4a09403b-725f-46d0-862d-b4cc8f9eb7d5 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:37:33 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-4a09403b-725f-46d0-862d-b4cc8f9eb7d5 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] 10.0.0.210 "GET /compute/v2.1/servers/35b23303-e373-4f35-b7ee-76e6815073ce/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050058 Apr 13 16:37:33 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 257/766] 10.0.0.210 () {64 vars in 1420 bytes} [Thu Apr 13 16:37:33 2023] GET /compute/v2.1/servers/35b23303-e373-4f35-b7ee-76e6815073ce/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 16:37:39 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-bb8a9964-c9f1-42fe-8045-3cad84cfee19 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:37:39 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-bb8a9964-c9f1-42fe-8045-3cad84cfee19 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:37:39 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-bb8a9964-c9f1-42fe-8045-3cad84cfee19 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:37:39 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-bb8a9964-c9f1-42fe-8045-3cad84cfee19 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:37:39 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-bb8a9964-c9f1-42fe-8045-3cad84cfee19 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:37:39 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-bb8a9964-c9f1-42fe-8045-3cad84cfee19 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:37:39 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-bb8a9964-c9f1-42fe-8045-3cad84cfee19 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:37:39 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-bb8a9964-c9f1-42fe-8045-3cad84cfee19 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:37:39 user devstack@n-api.service[62055]: INFO nova.api.openstack.wsgi [None req-bb8a9964-c9f1-42fe-8045-3cad84cfee19 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] HTTP exception thrown: Instance bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f could not be found. Apr 13 16:37:39 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-bb8a9964-c9f1-42fe-8045-3cad84cfee19 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Request method failure captured: Apr 13 16:37:39 user devstack@n-api.service[62055]: request: GET /compute/v2.1/servers/bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f HTTP/1.1 Apr 13 16:37:39 user devstack@n-api.service[62055]: Accept: application/json Apr 13 16:37:39 user devstack@n-api.service[62055]: Accept-Encoding: identity Apr 13 16:37:39 user devstack@n-api.service[62055]: Connection: close Apr 13 16:37:39 user devstack@n-api.service[62055]: Content-Length: 0 Apr 13 16:37:39 user devstack@n-api.service[62055]: Content-Type: application/json Apr 13 16:37:39 user devstack@n-api.service[62055]: Host: 10.0.0.210 Apr 13 16:37:39 user devstack@n-api.service[62055]: Openstack-System-Scope: None Apr 13 16:37:39 user devstack@n-api.service[62055]: User-Agent: python-urllib3/1.26.15 Apr 13 16:37:39 user devstack@n-api.service[62055]: X-Auth-Token: gAAAAABkOCyn1k8Th_ku9lHC1hCBGLG5X6QBQKvIDcZzNt5sKERj2rw2GlACSYp2OIBakRae3fpU--rPCIYAIbAtAtnpoWJedbet6b6JWWLA_35Dam2INgFhdFnEC42xxmqmkjQdJdpgJXxn0SsSbT2iDqDs2YoFzl3KlzgdSkM3FuRqPHPE350 Apr 13 16:37:39 user devstack@n-api.service[62055]: X-Domain-Id: None Apr 13 16:37:39 user devstack@n-api.service[62055]: X-Domain-Name: None Apr 13 16:37:39 user devstack@n-api.service[62055]: X-Identity-Status: Confirmed Apr 13 16:37:39 user devstack@n-api.service[62055]: X-Is-Admin-Project: True Apr 13 16:37:39 user devstack@n-api.service[62055]: X-Project-Domain-Id: default Apr 13 16:37:39 user devstack@n-api.service[62055]: X-Project-Domain-Name: Default Apr 13 16:37:39 user devstack@n-api.service[62055]: X-Project-Id: 24904988cf334657b084fd726c7ecf8f Apr 13 16:37:39 user devstack@n-api.service[62055]: X-Project-Name: tempest-AttachVolumeTestJSON-836650657 Apr 13 16:37:39 user devstack@n-api.service[62055]: X-Role: reader,member Apr 13 16:37:39 user devstack@n-api.service[62055]: X-Roles: reader,member Apr 13 16:37:39 user devstack@n-api.service[62055]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/24904988cf334657b084fd726c7ecf8f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/24904988cf334657b084fd726c7ecf8f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/24904988cf334657b084fd726c7ecf8f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 13 16:37:39 user devstack@n-api.service[62055]: X-Tenant: tempest-AttachVolumeTestJSON-836650657 Apr 13 16:37:39 user devstack@n-api.service[62055]: X-Tenant-Id: 24904988cf334657b084fd726c7ecf8f Apr 13 16:37:39 user devstack@n-api.service[62055]: X-Tenant-Name: tempest-AttachVolumeTestJSON-836650657 Apr 13 16:37:39 user devstack@n-api.service[62055]: X-User: tempest-AttachVolumeTestJSON-836650657-project-member Apr 13 16:37:39 user devstack@n-api.service[62055]: X-User-Domain-Id: default Apr 13 16:37:39 user devstack@n-api.service[62055]: X-User-Domain-Name: Default Apr 13 16:37:39 user devstack@n-api.service[62055]: X-User-Id: 47fab402fb794a5a9281cfb7fe188813 Apr 13 16:37:39 user devstack@n-api.service[62055]: X-User-Name: tempest-AttachVolumeTestJSON-836650657-project-member Apr 13 16:37:39 user devstack@n-api.service[62055]: method: > Apr 13 16:37:39 user devstack@n-api.service[62055]: exception: Instance bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f could not be found. Apr 13 16:37:39 user devstack@n-api.service[62055]: action_args: {'id': 'bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f'} Apr 13 16:37:39 user devstack@n-api.service[62055]: {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 16:37:39 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:37:39 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 16:37:39 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 16:37:39 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 16:37:39 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 16:37:39 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 16:37:39 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 16:37:39 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 16:37:39 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 16:37:39 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f could not be found. Apr 13 16:37:39 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:37:39 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:37:39 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:37:39 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:37:39 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 16:37:39 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 16:37:39 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 16:37:39 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 16:37:39 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 16:37:39 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 16:37:39 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 16:37:39 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 16:37:39 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 16:37:39 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 16:37:39 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 16:37:39 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 16:37:39 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f could not be found. Apr 13 16:37:39 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:37:39 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:37:39 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:37:39 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:37:39 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 16:37:39 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 16:37:39 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 16:37:39 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 16:37:39 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f could not be found. Apr 13 16:37:39 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:37:39 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-bb8a9964-c9f1-42fe-8045-3cad84cfee19 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Returning 404 to user: Instance bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f could not be found. {{(pid=62055) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 16:37:39 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-bb8a9964-c9f1-42fe-8045-3cad84cfee19 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f" status: 404 len: 111 microversion: 2.1 time: 0.035843 Apr 13 16:37:39 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 255/767] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:37:39 2023] GET /compute/v2.1/servers/bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 16:37:39 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-657eff90-1868-430b-bdea-6f6800a72b09 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Calling method '.version_select at 0x7f96e47b79a0>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:37:39 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-657eff90-1868-430b-bdea-6f6800a72b09 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2008404613" status: 202 len: 0 microversion: 2.1 time: 0.028433 Apr 13 16:37:39 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 256/768] 10.0.0.210 () {62 vars in 1298 bytes} [Thu Apr 13 16:37:39 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2008404613 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 16:37:46 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-2832dbf9-a1f6-402b-be92-d68c9b06a724 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:37:46 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-2832dbf9-a1f6-402b-be92-d68c9b06a724 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:37:46 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:37:46 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:37:46 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-2832dbf9-a1f6-402b-be92-d68c9b06a724 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:37:46 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-2832dbf9-a1f6-402b-be92-d68c9b06a724 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:37:46 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-2832dbf9-a1f6-402b-be92-d68c9b06a724 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:37:46 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-2832dbf9-a1f6-402b-be92-d68c9b06a724 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:37:46 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-2832dbf9-a1f6-402b-be92-d68c9b06a724 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:37:46 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-2832dbf9-a1f6-402b-be92-d68c9b06a724 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:37:46 user devstack@n-api.service[62053]: INFO nova.api.openstack.wsgi [None req-2832dbf9-a1f6-402b-be92-d68c9b06a724 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] HTTP exception thrown: Instance bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f could not be found. Apr 13 16:37:46 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-2832dbf9-a1f6-402b-be92-d68c9b06a724 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Request method failure captured: Apr 13 16:37:46 user devstack@n-api.service[62053]: request: DELETE /compute/v2.1/servers/bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f HTTP/1.1 Apr 13 16:37:46 user devstack@n-api.service[62053]: Accept: application/json Apr 13 16:37:46 user devstack@n-api.service[62053]: Accept-Encoding: identity Apr 13 16:37:46 user devstack@n-api.service[62053]: Connection: close Apr 13 16:37:46 user devstack@n-api.service[62053]: Content-Length: 0 Apr 13 16:37:46 user devstack@n-api.service[62053]: Content-Type: application/json Apr 13 16:37:46 user devstack@n-api.service[62053]: Host: 10.0.0.210 Apr 13 16:37:46 user devstack@n-api.service[62053]: Openstack-System-Scope: None Apr 13 16:37:46 user devstack@n-api.service[62053]: User-Agent: python-urllib3/1.26.15 Apr 13 16:37:46 user devstack@n-api.service[62053]: X-Auth-Token: gAAAAABkOCyn1k8Th_ku9lHC1hCBGLG5X6QBQKvIDcZzNt5sKERj2rw2GlACSYp2OIBakRae3fpU--rPCIYAIbAtAtnpoWJedbet6b6JWWLA_35Dam2INgFhdFnEC42xxmqmkjQdJdpgJXxn0SsSbT2iDqDs2YoFzl3KlzgdSkM3FuRqPHPE350 Apr 13 16:37:46 user devstack@n-api.service[62053]: X-Domain-Id: None Apr 13 16:37:46 user devstack@n-api.service[62053]: X-Domain-Name: None Apr 13 16:37:46 user devstack@n-api.service[62053]: X-Identity-Status: Confirmed Apr 13 16:37:46 user devstack@n-api.service[62053]: X-Is-Admin-Project: True Apr 13 16:37:46 user devstack@n-api.service[62053]: X-Project-Domain-Id: default Apr 13 16:37:46 user devstack@n-api.service[62053]: X-Project-Domain-Name: Default Apr 13 16:37:46 user devstack@n-api.service[62053]: X-Project-Id: 24904988cf334657b084fd726c7ecf8f Apr 13 16:37:46 user devstack@n-api.service[62053]: X-Project-Name: tempest-AttachVolumeTestJSON-836650657 Apr 13 16:37:46 user devstack@n-api.service[62053]: X-Role: reader,member Apr 13 16:37:46 user devstack@n-api.service[62053]: X-Roles: reader,member Apr 13 16:37:46 user devstack@n-api.service[62053]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/24904988cf334657b084fd726c7ecf8f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/24904988cf334657b084fd726c7ecf8f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/24904988cf334657b084fd726c7ecf8f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 13 16:37:46 user devstack@n-api.service[62053]: X-Tenant: tempest-AttachVolumeTestJSON-836650657 Apr 13 16:37:46 user devstack@n-api.service[62053]: X-Tenant-Id: 24904988cf334657b084fd726c7ecf8f Apr 13 16:37:46 user devstack@n-api.service[62053]: X-Tenant-Name: tempest-AttachVolumeTestJSON-836650657 Apr 13 16:37:46 user devstack@n-api.service[62053]: X-User: tempest-AttachVolumeTestJSON-836650657-project-member Apr 13 16:37:46 user devstack@n-api.service[62053]: X-User-Domain-Id: default Apr 13 16:37:46 user devstack@n-api.service[62053]: X-User-Domain-Name: Default Apr 13 16:37:46 user devstack@n-api.service[62053]: X-User-Id: 47fab402fb794a5a9281cfb7fe188813 Apr 13 16:37:46 user devstack@n-api.service[62053]: X-User-Name: tempest-AttachVolumeTestJSON-836650657-project-member Apr 13 16:37:46 user devstack@n-api.service[62053]: method: > Apr 13 16:37:46 user devstack@n-api.service[62053]: exception: Instance bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f could not be found. Apr 13 16:37:46 user devstack@n-api.service[62053]: action_args: {'id': 'bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f'} Apr 13 16:37:46 user devstack@n-api.service[62053]: {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 16:37:46 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:37:46 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 16:37:46 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 16:37:46 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 16:37:46 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 16:37:46 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 16:37:46 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 16:37:46 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 16:37:46 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 16:37:46 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f could not be found. Apr 13 16:37:46 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:37:46 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:37:46 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:37:46 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:37:46 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 16:37:46 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 16:37:46 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 16:37:46 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 16:37:46 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 16:37:46 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 16:37:46 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 16:37:46 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 16:37:46 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 16:37:46 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 16:37:46 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 16:37:46 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 16:37:46 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 16:37:46 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 16:37:46 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f could not be found. Apr 13 16:37:46 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:37:46 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:37:46 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:37:46 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:37:46 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 16:37:46 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 16:37:46 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 16:37:46 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 16:37:46 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f could not be found. Apr 13 16:37:46 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:37:46 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-2832dbf9-a1f6-402b-be92-d68c9b06a724 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Returning 404 to user: Instance bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f could not be found. {{(pid=62053) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 16:37:46 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-2832dbf9-a1f6-402b-be92-d68c9b06a724 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f" status: 404 len: 111 microversion: 2.1 time: 0.042440 Apr 13 16:37:46 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 258/769] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 16:37:46 2023] DELETE /compute/v2.1/servers/bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 16:37:46 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-5ffcc42a-2281-4779-872f-94e9a0e04d23 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:37:46 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-5ffcc42a-2281-4779-872f-94e9a0e04d23 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:37:46 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-5ffcc42a-2281-4779-872f-94e9a0e04d23 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:37:46 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-5ffcc42a-2281-4779-872f-94e9a0e04d23 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:37:46 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-5ffcc42a-2281-4779-872f-94e9a0e04d23 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:37:46 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-5ffcc42a-2281-4779-872f-94e9a0e04d23 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:37:46 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-5ffcc42a-2281-4779-872f-94e9a0e04d23 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:37:46 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-5ffcc42a-2281-4779-872f-94e9a0e04d23 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:37:46 user devstack@n-api.service[62055]: INFO nova.api.openstack.wsgi [None req-5ffcc42a-2281-4779-872f-94e9a0e04d23 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] HTTP exception thrown: Instance bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f could not be found. Apr 13 16:37:46 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-5ffcc42a-2281-4779-872f-94e9a0e04d23 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Request method failure captured: Apr 13 16:37:46 user devstack@n-api.service[62055]: request: GET /compute/v2.1/servers/bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f HTTP/1.1 Apr 13 16:37:46 user devstack@n-api.service[62055]: Accept: application/json Apr 13 16:37:46 user devstack@n-api.service[62055]: Accept-Encoding: identity Apr 13 16:37:46 user devstack@n-api.service[62055]: Connection: close Apr 13 16:37:46 user devstack@n-api.service[62055]: Content-Length: 0 Apr 13 16:37:46 user devstack@n-api.service[62055]: Content-Type: application/json Apr 13 16:37:46 user devstack@n-api.service[62055]: Host: 10.0.0.210 Apr 13 16:37:46 user devstack@n-api.service[62055]: Openstack-System-Scope: None Apr 13 16:37:46 user devstack@n-api.service[62055]: User-Agent: python-urllib3/1.26.15 Apr 13 16:37:46 user devstack@n-api.service[62055]: X-Auth-Token: gAAAAABkOCyn1k8Th_ku9lHC1hCBGLG5X6QBQKvIDcZzNt5sKERj2rw2GlACSYp2OIBakRae3fpU--rPCIYAIbAtAtnpoWJedbet6b6JWWLA_35Dam2INgFhdFnEC42xxmqmkjQdJdpgJXxn0SsSbT2iDqDs2YoFzl3KlzgdSkM3FuRqPHPE350 Apr 13 16:37:46 user devstack@n-api.service[62055]: X-Domain-Id: None Apr 13 16:37:46 user devstack@n-api.service[62055]: X-Domain-Name: None Apr 13 16:37:46 user devstack@n-api.service[62055]: X-Identity-Status: Confirmed Apr 13 16:37:46 user devstack@n-api.service[62055]: X-Is-Admin-Project: True Apr 13 16:37:46 user devstack@n-api.service[62055]: X-Project-Domain-Id: default Apr 13 16:37:46 user devstack@n-api.service[62055]: X-Project-Domain-Name: Default Apr 13 16:37:46 user devstack@n-api.service[62055]: X-Project-Id: 24904988cf334657b084fd726c7ecf8f Apr 13 16:37:46 user devstack@n-api.service[62055]: X-Project-Name: tempest-AttachVolumeTestJSON-836650657 Apr 13 16:37:46 user devstack@n-api.service[62055]: X-Role: reader,member Apr 13 16:37:46 user devstack@n-api.service[62055]: X-Roles: reader,member Apr 13 16:37:46 user devstack@n-api.service[62055]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/24904988cf334657b084fd726c7ecf8f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/24904988cf334657b084fd726c7ecf8f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/24904988cf334657b084fd726c7ecf8f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 13 16:37:46 user devstack@n-api.service[62055]: X-Tenant: tempest-AttachVolumeTestJSON-836650657 Apr 13 16:37:46 user devstack@n-api.service[62055]: X-Tenant-Id: 24904988cf334657b084fd726c7ecf8f Apr 13 16:37:46 user devstack@n-api.service[62055]: X-Tenant-Name: tempest-AttachVolumeTestJSON-836650657 Apr 13 16:37:46 user devstack@n-api.service[62055]: X-User: tempest-AttachVolumeTestJSON-836650657-project-member Apr 13 16:37:46 user devstack@n-api.service[62055]: X-User-Domain-Id: default Apr 13 16:37:46 user devstack@n-api.service[62055]: X-User-Domain-Name: Default Apr 13 16:37:46 user devstack@n-api.service[62055]: X-User-Id: 47fab402fb794a5a9281cfb7fe188813 Apr 13 16:37:46 user devstack@n-api.service[62055]: X-User-Name: tempest-AttachVolumeTestJSON-836650657-project-member Apr 13 16:37:46 user devstack@n-api.service[62055]: method: > Apr 13 16:37:46 user devstack@n-api.service[62055]: exception: Instance bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f could not be found. Apr 13 16:37:46 user devstack@n-api.service[62055]: action_args: {'id': 'bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f'} Apr 13 16:37:46 user devstack@n-api.service[62055]: {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 16:37:46 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:37:46 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 16:37:46 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 16:37:46 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 16:37:46 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 16:37:46 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 16:37:46 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 16:37:46 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 16:37:46 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 16:37:46 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f could not be found. Apr 13 16:37:46 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:37:46 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:37:46 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:37:46 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:37:46 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 16:37:46 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 16:37:46 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 16:37:46 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 16:37:46 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 16:37:46 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 16:37:46 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 16:37:46 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 16:37:46 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 16:37:46 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 16:37:46 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 16:37:46 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 16:37:46 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f could not be found. Apr 13 16:37:46 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:37:46 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:37:46 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:37:46 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:37:46 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 16:37:46 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 16:37:46 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 16:37:46 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 16:37:46 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f could not be found. Apr 13 16:37:46 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:37:46 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-5ffcc42a-2281-4779-872f-94e9a0e04d23 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Returning 404 to user: Instance bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f could not be found. {{(pid=62055) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 16:37:46 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-5ffcc42a-2281-4779-872f-94e9a0e04d23 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f" status: 404 len: 111 microversion: 2.1 time: 0.029004 Apr 13 16:37:46 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 256/770] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:37:46 2023] GET /compute/v2.1/servers/bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 16:37:48 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-cdb1f7e9-0ec8-42c2-af6c-ab77332a09ed tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:37:48 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-cdb1f7e9-0ec8-42c2-af6c-ab77332a09ed tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:37:48 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:37:48 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-cdb1f7e9-0ec8-42c2-af6c-ab77332a09ed tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:37:48 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-cdb1f7e9-0ec8-42c2-af6c-ab77332a09ed tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:37:48 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-cdb1f7e9-0ec8-42c2-af6c-ab77332a09ed tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:37:48 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-cdb1f7e9-0ec8-42c2-af6c-ab77332a09ed tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:37:48 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-cdb1f7e9-0ec8-42c2-af6c-ab77332a09ed tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:37:48 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-cdb1f7e9-0ec8-42c2-af6c-ab77332a09ed tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:37:48 user devstack@n-api.service[62054]: INFO nova.api.openstack.wsgi [None req-cdb1f7e9-0ec8-42c2-af6c-ab77332a09ed tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] HTTP exception thrown: Instance eaae47b9-a059-49f6-9ae6-d7147003e2f2 could not be found. Apr 13 16:37:48 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-cdb1f7e9-0ec8-42c2-af6c-ab77332a09ed tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Request method failure captured: Apr 13 16:37:48 user devstack@n-api.service[62054]: request: DELETE /compute/v2.1/servers/eaae47b9-a059-49f6-9ae6-d7147003e2f2 HTTP/1.1 Apr 13 16:37:48 user devstack@n-api.service[62054]: Accept: application/json Apr 13 16:37:48 user devstack@n-api.service[62054]: Accept-Encoding: identity Apr 13 16:37:48 user devstack@n-api.service[62054]: Connection: close Apr 13 16:37:48 user devstack@n-api.service[62054]: Content-Length: 0 Apr 13 16:37:48 user devstack@n-api.service[62054]: Content-Type: application/json Apr 13 16:37:48 user devstack@n-api.service[62054]: Host: 10.0.0.210 Apr 13 16:37:48 user devstack@n-api.service[62054]: Openstack-System-Scope: None Apr 13 16:37:48 user devstack@n-api.service[62054]: User-Agent: python-urllib3/1.26.15 Apr 13 16:37:48 user devstack@n-api.service[62054]: X-Auth-Token: gAAAAABkOCyn1k8Th_ku9lHC1hCBGLG5X6QBQKvIDcZzNt5sKERj2rw2GlACSYp2OIBakRae3fpU--rPCIYAIbAtAtnpoWJedbet6b6JWWLA_35Dam2INgFhdFnEC42xxmqmkjQdJdpgJXxn0SsSbT2iDqDs2YoFzl3KlzgdSkM3FuRqPHPE350 Apr 13 16:37:48 user devstack@n-api.service[62054]: X-Domain-Id: None Apr 13 16:37:48 user devstack@n-api.service[62054]: X-Domain-Name: None Apr 13 16:37:48 user devstack@n-api.service[62054]: X-Identity-Status: Confirmed Apr 13 16:37:48 user devstack@n-api.service[62054]: X-Is-Admin-Project: True Apr 13 16:37:48 user devstack@n-api.service[62054]: X-Project-Domain-Id: default Apr 13 16:37:48 user devstack@n-api.service[62054]: X-Project-Domain-Name: Default Apr 13 16:37:48 user devstack@n-api.service[62054]: X-Project-Id: 24904988cf334657b084fd726c7ecf8f Apr 13 16:37:48 user devstack@n-api.service[62054]: X-Project-Name: tempest-AttachVolumeTestJSON-836650657 Apr 13 16:37:48 user devstack@n-api.service[62054]: X-Role: reader,member Apr 13 16:37:48 user devstack@n-api.service[62054]: X-Roles: reader,member Apr 13 16:37:48 user devstack@n-api.service[62054]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/24904988cf334657b084fd726c7ecf8f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/24904988cf334657b084fd726c7ecf8f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/24904988cf334657b084fd726c7ecf8f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 13 16:37:48 user devstack@n-api.service[62054]: X-Tenant: tempest-AttachVolumeTestJSON-836650657 Apr 13 16:37:48 user devstack@n-api.service[62054]: X-Tenant-Id: 24904988cf334657b084fd726c7ecf8f Apr 13 16:37:48 user devstack@n-api.service[62054]: X-Tenant-Name: tempest-AttachVolumeTestJSON-836650657 Apr 13 16:37:48 user devstack@n-api.service[62054]: X-User: tempest-AttachVolumeTestJSON-836650657-project-member Apr 13 16:37:48 user devstack@n-api.service[62054]: X-User-Domain-Id: default Apr 13 16:37:48 user devstack@n-api.service[62054]: X-User-Domain-Name: Default Apr 13 16:37:48 user devstack@n-api.service[62054]: X-User-Id: 47fab402fb794a5a9281cfb7fe188813 Apr 13 16:37:48 user devstack@n-api.service[62054]: X-User-Name: tempest-AttachVolumeTestJSON-836650657-project-member Apr 13 16:37:48 user devstack@n-api.service[62054]: method: > Apr 13 16:37:48 user devstack@n-api.service[62054]: exception: Instance eaae47b9-a059-49f6-9ae6-d7147003e2f2 could not be found. Apr 13 16:37:48 user devstack@n-api.service[62054]: action_args: {'id': 'eaae47b9-a059-49f6-9ae6-d7147003e2f2'} Apr 13 16:37:48 user devstack@n-api.service[62054]: {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 16:37:48 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:37:48 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 16:37:48 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 16:37:48 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 16:37:48 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 16:37:48 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 16:37:48 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 16:37:48 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 16:37:48 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 16:37:48 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eaae47b9-a059-49f6-9ae6-d7147003e2f2 could not be found. Apr 13 16:37:48 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:37:48 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:37:48 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:37:48 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:37:48 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 16:37:48 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 16:37:48 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 16:37:48 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 16:37:48 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 16:37:48 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 16:37:48 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 16:37:48 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 16:37:48 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 16:37:48 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 16:37:48 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 16:37:48 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 16:37:48 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 16:37:48 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 16:37:48 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eaae47b9-a059-49f6-9ae6-d7147003e2f2 could not be found. Apr 13 16:37:48 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:37:48 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:37:48 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:37:48 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:37:48 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 16:37:48 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 16:37:48 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 16:37:48 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 16:37:48 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eaae47b9-a059-49f6-9ae6-d7147003e2f2 could not be found. Apr 13 16:37:48 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:37:48 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-cdb1f7e9-0ec8-42c2-af6c-ab77332a09ed tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Returning 404 to user: Instance eaae47b9-a059-49f6-9ae6-d7147003e2f2 could not be found. {{(pid=62054) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 16:37:48 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-cdb1f7e9-0ec8-42c2-af6c-ab77332a09ed tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/eaae47b9-a059-49f6-9ae6-d7147003e2f2" status: 404 len: 111 microversion: 2.1 time: 0.033338 Apr 13 16:37:48 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 257/771] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 16:37:48 2023] DELETE /compute/v2.1/servers/eaae47b9-a059-49f6-9ae6-d7147003e2f2 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 16:37:48 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-07f0d2c0-92fc-48ef-b839-f47621391fc6 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:37:48 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-07f0d2c0-92fc-48ef-b839-f47621391fc6 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:37:48 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-07f0d2c0-92fc-48ef-b839-f47621391fc6 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:37:48 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-07f0d2c0-92fc-48ef-b839-f47621391fc6 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:37:48 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-07f0d2c0-92fc-48ef-b839-f47621391fc6 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:37:48 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-07f0d2c0-92fc-48ef-b839-f47621391fc6 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:37:48 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-07f0d2c0-92fc-48ef-b839-f47621391fc6 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:37:48 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-07f0d2c0-92fc-48ef-b839-f47621391fc6 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:37:48 user devstack@n-api.service[62053]: INFO nova.api.openstack.wsgi [None req-07f0d2c0-92fc-48ef-b839-f47621391fc6 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] HTTP exception thrown: Instance eaae47b9-a059-49f6-9ae6-d7147003e2f2 could not be found. Apr 13 16:37:48 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-07f0d2c0-92fc-48ef-b839-f47621391fc6 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Request method failure captured: Apr 13 16:37:48 user devstack@n-api.service[62053]: request: GET /compute/v2.1/servers/eaae47b9-a059-49f6-9ae6-d7147003e2f2 HTTP/1.1 Apr 13 16:37:48 user devstack@n-api.service[62053]: Accept: application/json Apr 13 16:37:48 user devstack@n-api.service[62053]: Accept-Encoding: identity Apr 13 16:37:48 user devstack@n-api.service[62053]: Connection: close Apr 13 16:37:48 user devstack@n-api.service[62053]: Content-Length: 0 Apr 13 16:37:48 user devstack@n-api.service[62053]: Content-Type: application/json Apr 13 16:37:48 user devstack@n-api.service[62053]: Host: 10.0.0.210 Apr 13 16:37:48 user devstack@n-api.service[62053]: Openstack-System-Scope: None Apr 13 16:37:48 user devstack@n-api.service[62053]: User-Agent: python-urllib3/1.26.15 Apr 13 16:37:48 user devstack@n-api.service[62053]: X-Auth-Token: gAAAAABkOCyn1k8Th_ku9lHC1hCBGLG5X6QBQKvIDcZzNt5sKERj2rw2GlACSYp2OIBakRae3fpU--rPCIYAIbAtAtnpoWJedbet6b6JWWLA_35Dam2INgFhdFnEC42xxmqmkjQdJdpgJXxn0SsSbT2iDqDs2YoFzl3KlzgdSkM3FuRqPHPE350 Apr 13 16:37:48 user devstack@n-api.service[62053]: X-Domain-Id: None Apr 13 16:37:48 user devstack@n-api.service[62053]: X-Domain-Name: None Apr 13 16:37:48 user devstack@n-api.service[62053]: X-Identity-Status: Confirmed Apr 13 16:37:48 user devstack@n-api.service[62053]: X-Is-Admin-Project: True Apr 13 16:37:48 user devstack@n-api.service[62053]: X-Project-Domain-Id: default Apr 13 16:37:48 user devstack@n-api.service[62053]: X-Project-Domain-Name: Default Apr 13 16:37:48 user devstack@n-api.service[62053]: X-Project-Id: 24904988cf334657b084fd726c7ecf8f Apr 13 16:37:48 user devstack@n-api.service[62053]: X-Project-Name: tempest-AttachVolumeTestJSON-836650657 Apr 13 16:37:48 user devstack@n-api.service[62053]: X-Role: reader,member Apr 13 16:37:48 user devstack@n-api.service[62053]: X-Roles: reader,member Apr 13 16:37:48 user devstack@n-api.service[62053]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/24904988cf334657b084fd726c7ecf8f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/24904988cf334657b084fd726c7ecf8f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/24904988cf334657b084fd726c7ecf8f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 13 16:37:48 user devstack@n-api.service[62053]: X-Tenant: tempest-AttachVolumeTestJSON-836650657 Apr 13 16:37:48 user devstack@n-api.service[62053]: X-Tenant-Id: 24904988cf334657b084fd726c7ecf8f Apr 13 16:37:48 user devstack@n-api.service[62053]: X-Tenant-Name: tempest-AttachVolumeTestJSON-836650657 Apr 13 16:37:48 user devstack@n-api.service[62053]: X-User: tempest-AttachVolumeTestJSON-836650657-project-member Apr 13 16:37:48 user devstack@n-api.service[62053]: X-User-Domain-Id: default Apr 13 16:37:48 user devstack@n-api.service[62053]: X-User-Domain-Name: Default Apr 13 16:37:48 user devstack@n-api.service[62053]: X-User-Id: 47fab402fb794a5a9281cfb7fe188813 Apr 13 16:37:48 user devstack@n-api.service[62053]: X-User-Name: tempest-AttachVolumeTestJSON-836650657-project-member Apr 13 16:37:48 user devstack@n-api.service[62053]: method: > Apr 13 16:37:48 user devstack@n-api.service[62053]: exception: Instance eaae47b9-a059-49f6-9ae6-d7147003e2f2 could not be found. Apr 13 16:37:48 user devstack@n-api.service[62053]: action_args: {'id': 'eaae47b9-a059-49f6-9ae6-d7147003e2f2'} Apr 13 16:37:48 user devstack@n-api.service[62053]: {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 16:37:48 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:37:48 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 16:37:48 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 16:37:48 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 16:37:48 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 16:37:48 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 16:37:48 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 16:37:48 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 16:37:48 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 16:37:48 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eaae47b9-a059-49f6-9ae6-d7147003e2f2 could not be found. Apr 13 16:37:48 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:37:48 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:37:48 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:37:48 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:37:48 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 16:37:48 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 16:37:48 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 16:37:48 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 16:37:48 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 16:37:48 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 16:37:48 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 16:37:48 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 16:37:48 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 16:37:48 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 16:37:48 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 16:37:48 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 16:37:48 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eaae47b9-a059-49f6-9ae6-d7147003e2f2 could not be found. Apr 13 16:37:48 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:37:48 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:37:48 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:37:48 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:37:48 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 16:37:48 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 16:37:48 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 16:37:48 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 16:37:48 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eaae47b9-a059-49f6-9ae6-d7147003e2f2 could not be found. Apr 13 16:37:48 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:37:48 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-07f0d2c0-92fc-48ef-b839-f47621391fc6 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Returning 404 to user: Instance eaae47b9-a059-49f6-9ae6-d7147003e2f2 could not be found. {{(pid=62053) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 16:37:48 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-07f0d2c0-92fc-48ef-b839-f47621391fc6 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eaae47b9-a059-49f6-9ae6-d7147003e2f2" status: 404 len: 111 microversion: 2.1 time: 0.029616 Apr 13 16:37:48 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 259/772] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:37:48 2023] GET /compute/v2.1/servers/eaae47b9-a059-49f6-9ae6-d7147003e2f2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 16:38:00 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-c921a9e8-20da-4717-a459-bc5f5f8cc431 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:38:00 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-c921a9e8-20da-4717-a459-bc5f5f8cc431 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:38:00 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_api:SELECT=6 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:38:00 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_cell1:SELECT=10 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:38:00 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-c921a9e8-20da-4717-a459-bc5f5f8cc431 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:38:00 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-c921a9e8-20da-4717-a459-bc5f5f8cc431 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:38:00 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-c921a9e8-20da-4717-a459-bc5f5f8cc431 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:38:00 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-c921a9e8-20da-4717-a459-bc5f5f8cc431 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:38:00 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-c921a9e8-20da-4717-a459-bc5f5f8cc431 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:38:00 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-c921a9e8-20da-4717-a459-bc5f5f8cc431 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:38:00 user devstack@n-api.service[62055]: INFO nova.api.openstack.wsgi [None req-c921a9e8-20da-4717-a459-bc5f5f8cc431 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] HTTP exception thrown: Instance acbcaee0-a47b-4fee-8765-9b1c9597d515 could not be found. Apr 13 16:38:00 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-c921a9e8-20da-4717-a459-bc5f5f8cc431 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Request method failure captured: Apr 13 16:38:00 user devstack@n-api.service[62055]: request: GET /compute/v2.1/servers/acbcaee0-a47b-4fee-8765-9b1c9597d515 HTTP/1.1 Apr 13 16:38:00 user devstack@n-api.service[62055]: Accept: application/json Apr 13 16:38:00 user devstack@n-api.service[62055]: Accept-Encoding: identity Apr 13 16:38:00 user devstack@n-api.service[62055]: Connection: close Apr 13 16:38:00 user devstack@n-api.service[62055]: Content-Length: 0 Apr 13 16:38:00 user devstack@n-api.service[62055]: Content-Type: application/json Apr 13 16:38:00 user devstack@n-api.service[62055]: Host: 10.0.0.210 Apr 13 16:38:00 user devstack@n-api.service[62055]: Openstack-System-Scope: None Apr 13 16:38:00 user devstack@n-api.service[62055]: User-Agent: python-urllib3/1.26.15 Apr 13 16:38:00 user devstack@n-api.service[62055]: X-Auth-Token: gAAAAABkOCyK6iWxIKqDSv6H0rT6hYe7MptxZpmd0isb-i7vUg3jso0s7xsZUrxtoSvPcGgCBo4hK2dNDP0kQx-ibuil0c2Kvsteo-AJ1R0h80Zm73FGeLTKieLGMCzhQ82f-tUm8n-Fpt56d3KgkMnkmwHhKR_MJqNeo3xk_dFOMXNz_EA5ymA Apr 13 16:38:00 user devstack@n-api.service[62055]: X-Domain-Id: None Apr 13 16:38:00 user devstack@n-api.service[62055]: X-Domain-Name: None Apr 13 16:38:00 user devstack@n-api.service[62055]: X-Identity-Status: Confirmed Apr 13 16:38:00 user devstack@n-api.service[62055]: X-Is-Admin-Project: True Apr 13 16:38:00 user devstack@n-api.service[62055]: X-Project-Domain-Id: default Apr 13 16:38:00 user devstack@n-api.service[62055]: X-Project-Domain-Name: Default Apr 13 16:38:00 user devstack@n-api.service[62055]: X-Project-Id: 980559734a504574a83224deb7423c77 Apr 13 16:38:00 user devstack@n-api.service[62055]: X-Project-Name: tempest-ServerActionsTestJSON-713402718 Apr 13 16:38:00 user devstack@n-api.service[62055]: X-Role: reader,member Apr 13 16:38:00 user devstack@n-api.service[62055]: X-Roles: reader,member Apr 13 16:38:00 user devstack@n-api.service[62055]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/980559734a504574a83224deb7423c77"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/980559734a504574a83224deb7423c77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/980559734a504574a83224deb7423c77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 13 16:38:00 user devstack@n-api.service[62055]: X-Tenant: tempest-ServerActionsTestJSON-713402718 Apr 13 16:38:00 user devstack@n-api.service[62055]: X-Tenant-Id: 980559734a504574a83224deb7423c77 Apr 13 16:38:00 user devstack@n-api.service[62055]: X-Tenant-Name: tempest-ServerActionsTestJSON-713402718 Apr 13 16:38:00 user devstack@n-api.service[62055]: X-User: tempest-ServerActionsTestJSON-713402718-project-member Apr 13 16:38:00 user devstack@n-api.service[62055]: X-User-Domain-Id: default Apr 13 16:38:00 user devstack@n-api.service[62055]: X-User-Domain-Name: Default Apr 13 16:38:00 user devstack@n-api.service[62055]: X-User-Id: 1b3df1c5c5d441819bcef89ed6966815 Apr 13 16:38:00 user devstack@n-api.service[62055]: X-User-Name: tempest-ServerActionsTestJSON-713402718-project-member Apr 13 16:38:00 user devstack@n-api.service[62055]: method: > Apr 13 16:38:00 user devstack@n-api.service[62055]: exception: Instance acbcaee0-a47b-4fee-8765-9b1c9597d515 could not be found. Apr 13 16:38:00 user devstack@n-api.service[62055]: action_args: {'id': 'acbcaee0-a47b-4fee-8765-9b1c9597d515'} Apr 13 16:38:00 user devstack@n-api.service[62055]: {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 16:38:00 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:38:00 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 16:38:00 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 16:38:00 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 16:38:00 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 16:38:00 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 16:38:00 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 16:38:00 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 16:38:00 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 16:38:00 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance acbcaee0-a47b-4fee-8765-9b1c9597d515 could not be found. Apr 13 16:38:00 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:38:00 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:38:00 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:38:00 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:38:00 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 16:38:00 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 16:38:00 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 16:38:00 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 16:38:00 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 16:38:00 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 16:38:00 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 16:38:00 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 16:38:00 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 16:38:00 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 16:38:00 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 16:38:00 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 16:38:00 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance acbcaee0-a47b-4fee-8765-9b1c9597d515 could not be found. Apr 13 16:38:00 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:38:00 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:38:00 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:38:00 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:38:00 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 16:38:00 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 16:38:00 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 16:38:00 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 16:38:00 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance acbcaee0-a47b-4fee-8765-9b1c9597d515 could not be found. Apr 13 16:38:00 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:38:00 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-c921a9e8-20da-4717-a459-bc5f5f8cc431 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Returning 404 to user: Instance acbcaee0-a47b-4fee-8765-9b1c9597d515 could not be found. {{(pid=62055) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 16:38:00 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-c921a9e8-20da-4717-a459-bc5f5f8cc431 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] 10.0.0.210 "GET /compute/v2.1/servers/acbcaee0-a47b-4fee-8765-9b1c9597d515" status: 404 len: 111 microversion: 2.1 time: 0.037243 Apr 13 16:38:00 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 257/773] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:38:00 2023] GET /compute/v2.1/servers/acbcaee0-a47b-4fee-8765-9b1c9597d515 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 16:38:00 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-a3504644-4972-4ce0-aa65-e9eb4d70ecec tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:38:00 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-a3504644-4972-4ce0-aa65-e9eb4d70ecec tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:38:00 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_api:SELECT=7,nova_api:DELETE=1 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:38:00 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_cell1:SELECT=2 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:38:00 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-a3504644-4972-4ce0-aa65-e9eb4d70ecec tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:38:00 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-a3504644-4972-4ce0-aa65-e9eb4d70ecec tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:38:00 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-a3504644-4972-4ce0-aa65-e9eb4d70ecec tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:38:00 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-a3504644-4972-4ce0-aa65-e9eb4d70ecec tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:38:00 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-a3504644-4972-4ce0-aa65-e9eb4d70ecec tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:38:00 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-a3504644-4972-4ce0-aa65-e9eb4d70ecec tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:38:00 user devstack@n-api.service[62054]: INFO nova.api.openstack.wsgi [None req-a3504644-4972-4ce0-aa65-e9eb4d70ecec tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] HTTP exception thrown: Instance acbcaee0-a47b-4fee-8765-9b1c9597d515 could not be found. Apr 13 16:38:00 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-a3504644-4972-4ce0-aa65-e9eb4d70ecec tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Request method failure captured: Apr 13 16:38:00 user devstack@n-api.service[62054]: request: GET /compute/v2.1/servers/acbcaee0-a47b-4fee-8765-9b1c9597d515/os-volume_attachments HTTP/1.1 Apr 13 16:38:00 user devstack@n-api.service[62054]: Accept: application/json Apr 13 16:38:00 user devstack@n-api.service[62054]: Accept-Encoding: identity Apr 13 16:38:00 user devstack@n-api.service[62054]: Connection: close Apr 13 16:38:00 user devstack@n-api.service[62054]: Content-Length: 0 Apr 13 16:38:00 user devstack@n-api.service[62054]: Content-Type: application/json Apr 13 16:38:00 user devstack@n-api.service[62054]: Host: 10.0.0.210 Apr 13 16:38:00 user devstack@n-api.service[62054]: Openstack-System-Scope: None Apr 13 16:38:00 user devstack@n-api.service[62054]: User-Agent: python-urllib3/1.26.15 Apr 13 16:38:00 user devstack@n-api.service[62054]: X-Auth-Token: gAAAAABkOCyK6iWxIKqDSv6H0rT6hYe7MptxZpmd0isb-i7vUg3jso0s7xsZUrxtoSvPcGgCBo4hK2dNDP0kQx-ibuil0c2Kvsteo-AJ1R0h80Zm73FGeLTKieLGMCzhQ82f-tUm8n-Fpt56d3KgkMnkmwHhKR_MJqNeo3xk_dFOMXNz_EA5ymA Apr 13 16:38:00 user devstack@n-api.service[62054]: X-Domain-Id: None Apr 13 16:38:00 user devstack@n-api.service[62054]: X-Domain-Name: None Apr 13 16:38:00 user devstack@n-api.service[62054]: X-Identity-Status: Confirmed Apr 13 16:38:00 user devstack@n-api.service[62054]: X-Is-Admin-Project: True Apr 13 16:38:00 user devstack@n-api.service[62054]: X-Project-Domain-Id: default Apr 13 16:38:00 user devstack@n-api.service[62054]: X-Project-Domain-Name: Default Apr 13 16:38:00 user devstack@n-api.service[62054]: X-Project-Id: 980559734a504574a83224deb7423c77 Apr 13 16:38:00 user devstack@n-api.service[62054]: X-Project-Name: tempest-ServerActionsTestJSON-713402718 Apr 13 16:38:00 user devstack@n-api.service[62054]: X-Role: reader,member Apr 13 16:38:00 user devstack@n-api.service[62054]: X-Roles: reader,member Apr 13 16:38:00 user devstack@n-api.service[62054]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/980559734a504574a83224deb7423c77"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/980559734a504574a83224deb7423c77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/980559734a504574a83224deb7423c77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 13 16:38:00 user devstack@n-api.service[62054]: X-Tenant: tempest-ServerActionsTestJSON-713402718 Apr 13 16:38:00 user devstack@n-api.service[62054]: X-Tenant-Id: 980559734a504574a83224deb7423c77 Apr 13 16:38:00 user devstack@n-api.service[62054]: X-Tenant-Name: tempest-ServerActionsTestJSON-713402718 Apr 13 16:38:00 user devstack@n-api.service[62054]: X-User: tempest-ServerActionsTestJSON-713402718-project-member Apr 13 16:38:00 user devstack@n-api.service[62054]: X-User-Domain-Id: default Apr 13 16:38:00 user devstack@n-api.service[62054]: X-User-Domain-Name: Default Apr 13 16:38:00 user devstack@n-api.service[62054]: X-User-Id: 1b3df1c5c5d441819bcef89ed6966815 Apr 13 16:38:00 user devstack@n-api.service[62054]: X-User-Name: tempest-ServerActionsTestJSON-713402718-project-member Apr 13 16:38:00 user devstack@n-api.service[62054]: method: > Apr 13 16:38:00 user devstack@n-api.service[62054]: exception: Instance acbcaee0-a47b-4fee-8765-9b1c9597d515 could not be found. Apr 13 16:38:00 user devstack@n-api.service[62054]: action_args: {'server_id': 'acbcaee0-a47b-4fee-8765-9b1c9597d515'} Apr 13 16:38:00 user devstack@n-api.service[62054]: {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 16:38:00 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:38:00 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 16:38:00 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 16:38:00 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 16:38:00 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 16:38:00 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 16:38:00 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 16:38:00 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 16:38:00 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 16:38:00 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance acbcaee0-a47b-4fee-8765-9b1c9597d515 could not be found. Apr 13 16:38:00 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:38:00 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:38:00 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:38:00 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:38:00 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 16:38:00 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 16:38:00 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 16:38:00 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 16:38:00 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 16:38:00 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 16:38:00 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 13 16:38:00 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 16:38:00 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 13 16:38:00 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 16:38:00 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Apr 13 16:38:00 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Apr 13 16:38:00 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 16:38:00 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 16:38:00 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance acbcaee0-a47b-4fee-8765-9b1c9597d515 could not be found. Apr 13 16:38:00 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:38:00 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:38:00 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:38:00 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:38:00 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 16:38:00 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 16:38:00 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 16:38:00 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 16:38:00 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance acbcaee0-a47b-4fee-8765-9b1c9597d515 could not be found. Apr 13 16:38:00 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:38:00 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-a3504644-4972-4ce0-aa65-e9eb4d70ecec tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Returning 404 to user: Instance acbcaee0-a47b-4fee-8765-9b1c9597d515 could not be found. {{(pid=62054) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 16:38:00 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-a3504644-4972-4ce0-aa65-e9eb4d70ecec tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] 10.0.0.210 "GET /compute/v2.1/servers/acbcaee0-a47b-4fee-8765-9b1c9597d515/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.036386 Apr 13 16:38:00 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 258/774] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 16:38:00 2023] GET /compute/v2.1/servers/acbcaee0-a47b-4fee-8765-9b1c9597d515/os-volume_attachments => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 16:38:00 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-2b97cc18-7177-47b5-853d-ded97e1befb0 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:38:00 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-2b97cc18-7177-47b5-853d-ded97e1befb0 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:38:00 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_api:SELECT=4 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:38:00 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_cell1:SELECT=4 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:38:00 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-2b97cc18-7177-47b5-853d-ded97e1befb0 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:38:00 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-2b97cc18-7177-47b5-853d-ded97e1befb0 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:38:00 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-2b97cc18-7177-47b5-853d-ded97e1befb0 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:38:00 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-2b97cc18-7177-47b5-853d-ded97e1befb0 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:38:00 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-2b97cc18-7177-47b5-853d-ded97e1befb0 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:38:00 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-2b97cc18-7177-47b5-853d-ded97e1befb0 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:38:00 user devstack@n-api.service[62053]: INFO nova.api.openstack.wsgi [None req-2b97cc18-7177-47b5-853d-ded97e1befb0 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] HTTP exception thrown: Instance acbcaee0-a47b-4fee-8765-9b1c9597d515 could not be found. Apr 13 16:38:00 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-2b97cc18-7177-47b5-853d-ded97e1befb0 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Request method failure captured: Apr 13 16:38:00 user devstack@n-api.service[62053]: request: GET /compute/v2.1/servers/acbcaee0-a47b-4fee-8765-9b1c9597d515 HTTP/1.1 Apr 13 16:38:00 user devstack@n-api.service[62053]: Accept: application/json Apr 13 16:38:00 user devstack@n-api.service[62053]: Accept-Encoding: identity Apr 13 16:38:00 user devstack@n-api.service[62053]: Connection: close Apr 13 16:38:00 user devstack@n-api.service[62053]: Content-Length: 0 Apr 13 16:38:00 user devstack@n-api.service[62053]: Content-Type: application/json Apr 13 16:38:00 user devstack@n-api.service[62053]: Host: 10.0.0.210 Apr 13 16:38:00 user devstack@n-api.service[62053]: Openstack-System-Scope: None Apr 13 16:38:00 user devstack@n-api.service[62053]: User-Agent: python-urllib3/1.26.15 Apr 13 16:38:00 user devstack@n-api.service[62053]: X-Auth-Token: gAAAAABkOCyK6iWxIKqDSv6H0rT6hYe7MptxZpmd0isb-i7vUg3jso0s7xsZUrxtoSvPcGgCBo4hK2dNDP0kQx-ibuil0c2Kvsteo-AJ1R0h80Zm73FGeLTKieLGMCzhQ82f-tUm8n-Fpt56d3KgkMnkmwHhKR_MJqNeo3xk_dFOMXNz_EA5ymA Apr 13 16:38:00 user devstack@n-api.service[62053]: X-Domain-Id: None Apr 13 16:38:00 user devstack@n-api.service[62053]: X-Domain-Name: None Apr 13 16:38:00 user devstack@n-api.service[62053]: X-Identity-Status: Confirmed Apr 13 16:38:00 user devstack@n-api.service[62053]: X-Is-Admin-Project: True Apr 13 16:38:00 user devstack@n-api.service[62053]: X-Project-Domain-Id: default Apr 13 16:38:00 user devstack@n-api.service[62053]: X-Project-Domain-Name: Default Apr 13 16:38:00 user devstack@n-api.service[62053]: X-Project-Id: 980559734a504574a83224deb7423c77 Apr 13 16:38:00 user devstack@n-api.service[62053]: X-Project-Name: tempest-ServerActionsTestJSON-713402718 Apr 13 16:38:00 user devstack@n-api.service[62053]: X-Role: reader,member Apr 13 16:38:00 user devstack@n-api.service[62053]: X-Roles: reader,member Apr 13 16:38:00 user devstack@n-api.service[62053]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/980559734a504574a83224deb7423c77"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/980559734a504574a83224deb7423c77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/980559734a504574a83224deb7423c77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 13 16:38:00 user devstack@n-api.service[62053]: X-Tenant: tempest-ServerActionsTestJSON-713402718 Apr 13 16:38:00 user devstack@n-api.service[62053]: X-Tenant-Id: 980559734a504574a83224deb7423c77 Apr 13 16:38:00 user devstack@n-api.service[62053]: X-Tenant-Name: tempest-ServerActionsTestJSON-713402718 Apr 13 16:38:00 user devstack@n-api.service[62053]: X-User: tempest-ServerActionsTestJSON-713402718-project-member Apr 13 16:38:00 user devstack@n-api.service[62053]: X-User-Domain-Id: default Apr 13 16:38:00 user devstack@n-api.service[62053]: X-User-Domain-Name: Default Apr 13 16:38:00 user devstack@n-api.service[62053]: X-User-Id: 1b3df1c5c5d441819bcef89ed6966815 Apr 13 16:38:00 user devstack@n-api.service[62053]: X-User-Name: tempest-ServerActionsTestJSON-713402718-project-member Apr 13 16:38:00 user devstack@n-api.service[62053]: method: > Apr 13 16:38:00 user devstack@n-api.service[62053]: exception: Instance acbcaee0-a47b-4fee-8765-9b1c9597d515 could not be found. Apr 13 16:38:00 user devstack@n-api.service[62053]: action_args: {'id': 'acbcaee0-a47b-4fee-8765-9b1c9597d515'} Apr 13 16:38:00 user devstack@n-api.service[62053]: {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 16:38:00 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:38:00 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 16:38:00 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 16:38:00 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 16:38:00 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 16:38:00 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 16:38:00 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 16:38:00 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 16:38:00 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 16:38:00 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance acbcaee0-a47b-4fee-8765-9b1c9597d515 could not be found. Apr 13 16:38:00 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:38:00 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:38:00 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:38:00 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:38:00 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 16:38:00 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 16:38:00 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 16:38:00 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 16:38:00 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 16:38:00 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 16:38:00 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 16:38:00 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 16:38:00 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 16:38:00 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 16:38:00 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 16:38:00 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 16:38:00 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance acbcaee0-a47b-4fee-8765-9b1c9597d515 could not be found. Apr 13 16:38:00 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:38:00 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:38:00 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:38:00 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:38:00 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 16:38:00 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 16:38:00 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 16:38:00 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 16:38:00 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance acbcaee0-a47b-4fee-8765-9b1c9597d515 could not be found. Apr 13 16:38:00 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:38:00 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-2b97cc18-7177-47b5-853d-ded97e1befb0 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Returning 404 to user: Instance acbcaee0-a47b-4fee-8765-9b1c9597d515 could not be found. {{(pid=62053) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 16:38:00 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-2b97cc18-7177-47b5-853d-ded97e1befb0 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] 10.0.0.210 "GET /compute/v2.1/servers/acbcaee0-a47b-4fee-8765-9b1c9597d515" status: 404 len: 111 microversion: 2.1 time: 0.039430 Apr 13 16:38:00 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 260/775] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:38:00 2023] GET /compute/v2.1/servers/acbcaee0-a47b-4fee-8765-9b1c9597d515 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 16:38:00 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-06f62730-2b9d-4401-a973-dd3161e612ad tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-845961470", "imageRef": "708622a9-7465-4492-ade8-b827198f7e30", "flavorRef": "42", "networks": [{"uuid": "cf1fef97-9ef1-449f-a302-b38110024547"}], "security_groups": [{"name": "tempest-securitygroup--1787105472"}], "key_name": "tempest-keypair-1700037342", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:38:00 user devstack@n-api.service[62055]: DEBUG nova.network.neutron [None req-06f62730-2b9d-4401-a973-dd3161e612ad tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] validate_networks() for [('cf1fef97-9ef1-449f-a302-b38110024547', None, None, None, None, None)] {{(pid=62055) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 16:38:01 user devstack@n-api.service[62055]: DEBUG nova.virt.hardware [None req-06f62730-2b9d-4401-a973-dd3161e612ad tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Flavor limits 0:0:0 {{(pid=62055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 16:38:01 user devstack@n-api.service[62055]: DEBUG nova.virt.hardware [None req-06f62730-2b9d-4401-a973-dd3161e612ad tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Image limits 0:0:0 {{(pid=62055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 16:38:01 user devstack@n-api.service[62055]: DEBUG nova.virt.hardware [None req-06f62730-2b9d-4401-a973-dd3161e612ad tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Flavor pref 0:0:0 {{(pid=62055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 16:38:01 user devstack@n-api.service[62055]: DEBUG nova.virt.hardware [None req-06f62730-2b9d-4401-a973-dd3161e612ad tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Image pref 0:0:0 {{(pid=62055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 16:38:01 user devstack@n-api.service[62055]: DEBUG nova.virt.hardware [None req-06f62730-2b9d-4401-a973-dd3161e612ad tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 16:38:01 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-06f62730-2b9d-4401-a973-dd3161e612ad tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:38:01 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-06f62730-2b9d-4401-a973-dd3161e612ad tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:38:01 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-06f62730-2b9d-4401-a973-dd3161e612ad tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:38:01 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-06f62730-2b9d-4401-a973-dd3161e612ad tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:38:01 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-06f62730-2b9d-4401-a973-dd3161e612ad tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:38:01 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-06f62730-2b9d-4401-a973-dd3161e612ad tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:38:01 user devstack@n-api.service[62055]: DEBUG nova.quota [None req-06f62730-2b9d-4401-a973-dd3161e612ad tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Getting quotas for project 980559734a504574a83224deb7423c77. Resources: {'instances', 'cores', 'ram'} {{(pid=62055) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 16:38:01 user devstack@n-api.service[62055]: DEBUG nova.quota [None req-06f62730-2b9d-4401-a973-dd3161e612ad tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Getting quotas for user 1b3df1c5c5d441819bcef89ed6966815 and project 980559734a504574a83224deb7423c77. Resources: {'instances', 'cores', 'ram'} {{(pid=62055) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 16:38:01 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-06f62730-2b9d-4401-a973-dd3161e612ad tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Going to run 1 instances... {{(pid=62055) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 16:38:01 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-06f62730-2b9d-4401-a973-dd3161e612ad tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 5ed800fe-577d-4624-898c-c7f40da77376] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='708622a9-7465-4492-ade8-b827198f7e30',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=62055) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 16:38:01 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-06f62730-2b9d-4401-a973-dd3161e612ad tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.885198 Apr 13 16:38:01 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 258/776] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 16:38:00 2023] POST /compute/v2.1/servers => generated 404 bytes in 887 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 16:38:01 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-4f293389-7a44-43bb-bb19-79bb82f7ee39 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:38:01 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-4f293389-7a44-43bb-bb19-79bb82f7ee39 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 5ed800fe-577d-4624-898c-c7f40da77376] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:38:01 user devstack@n-api.service[62054]: DEBUG nova.policy [None req-4f293389-7a44-43bb-bb19-79bb82f7ee39 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b3df1c5c5d441819bcef89ed6966815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980559734a504574a83224deb7423c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62054) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:38:01 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-4f293389-7a44-43bb-bb19-79bb82f7ee39 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5ed800fe-577d-4624-898c-c7f40da77376" status: 200 len: 1232 microversion: 2.1 time: 0.079334 Apr 13 16:38:01 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 259/777] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:38:01 2023] GET /compute/v2.1/servers/5ed800fe-577d-4624-898c-c7f40da77376 => generated 1232 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:38:03 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-ffe055d4-4a14-4e6e-9566-7e84f35b21b5 req-f759de75-5186-4afe-bdb5-d7a96b6d4390 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ed800fe-577d-4624-898c-c7f40da77376", "tag": "09531419-c0ff-4d13-89bd-06caa28e019d"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:38:03 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-ffe055d4-4a14-4e6e-9566-7e84f35b21b5 req-f759de75-5186-4afe-bdb5-d7a96b6d4390 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:38:03 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-ffe055d4-4a14-4e6e-9566-7e84f35b21b5 req-f759de75-5186-4afe-bdb5-d7a96b6d4390 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:38:03 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-ffe055d4-4a14-4e6e-9566-7e84f35b21b5 req-f759de75-5186-4afe-bdb5-d7a96b6d4390 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:38:03 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-ffe055d4-4a14-4e6e-9566-7e84f35b21b5 req-f759de75-5186-4afe-bdb5-d7a96b6d4390 service nova] Creating event network-changed:09531419-c0ff-4d13-89bd-06caa28e019d for instance 5ed800fe-577d-4624-898c-c7f40da77376 on user Apr 13 16:38:03 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [req-ffe055d4-4a14-4e6e-9566-7e84f35b21b5 req-f759de75-5186-4afe-bdb5-d7a96b6d4390 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041116 Apr 13 16:38:03 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 261/778] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:38:03 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:38:05 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [req-8aef0c70-a73e-4644-9367-d907b6cea322 req-48aab17e-982c-48e0-92c3-5d102052c3b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ed800fe-577d-4624-898c-c7f40da77376", "name": "network-vif-plugged", "status": "completed", "tag": "09531419-c0ff-4d13-89bd-06caa28e019d"}]} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:38:06 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-8aef0c70-a73e-4644-9367-d907b6cea322 req-48aab17e-982c-48e0-92c3-5d102052c3b2 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:38:06 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-8aef0c70-a73e-4644-9367-d907b6cea322 req-48aab17e-982c-48e0-92c3-5d102052c3b2 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:38:06 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-8aef0c70-a73e-4644-9367-d907b6cea322 req-48aab17e-982c-48e0-92c3-5d102052c3b2 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:38:06 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-8aef0c70-a73e-4644-9367-d907b6cea322 req-48aab17e-982c-48e0-92c3-5d102052c3b2 service nova] Creating event network-vif-plugged:09531419-c0ff-4d13-89bd-06caa28e019d for instance 5ed800fe-577d-4624-898c-c7f40da77376 on user Apr 13 16:38:06 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [req-8aef0c70-a73e-4644-9367-d907b6cea322 req-48aab17e-982c-48e0-92c3-5d102052c3b2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031524 Apr 13 16:38:06 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 259/779] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:38:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:38:08 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-4507a3fb-c260-4521-a254-b1fa71ef67b9 req-1529ce1a-69b3-439c-bc44-bc5769ea5f28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ed800fe-577d-4624-898c-c7f40da77376", "name": "network-vif-plugged", "status": "completed", "tag": "09531419-c0ff-4d13-89bd-06caa28e019d"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:38:08 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-4507a3fb-c260-4521-a254-b1fa71ef67b9 req-1529ce1a-69b3-439c-bc44-bc5769ea5f28 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:38:08 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-4507a3fb-c260-4521-a254-b1fa71ef67b9 req-1529ce1a-69b3-439c-bc44-bc5769ea5f28 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:38:08 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-4507a3fb-c260-4521-a254-b1fa71ef67b9 req-1529ce1a-69b3-439c-bc44-bc5769ea5f28 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:38:08 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-4507a3fb-c260-4521-a254-b1fa71ef67b9 req-1529ce1a-69b3-439c-bc44-bc5769ea5f28 service nova] Creating event network-vif-plugged:09531419-c0ff-4d13-89bd-06caa28e019d for instance 5ed800fe-577d-4624-898c-c7f40da77376 on user Apr 13 16:38:08 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [req-4507a3fb-c260-4521-a254-b1fa71ef67b9 req-1529ce1a-69b3-439c-bc44-bc5769ea5f28 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037498 Apr 13 16:38:08 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 260/780] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:38:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 16:38:09 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-ca307781-132b-41bf-8c4b-d212aa9ef23b tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:38:09 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-ca307781-132b-41bf-8c4b-d212aa9ef23b tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 0a5c9b2c-fe1e-4a21-b213-c63e2c28748a] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:38:09 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-ca307781-132b-41bf-8c4b-d212aa9ef23b tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:38:09 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-ca307781-132b-41bf-8c4b-d212aa9ef23b tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:38:09 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-ca307781-132b-41bf-8c4b-d212aa9ef23b tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:38:09 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-ca307781-132b-41bf-8c4b-d212aa9ef23b tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:38:09 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-ca307781-132b-41bf-8c4b-d212aa9ef23b tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:38:09 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-ca307781-132b-41bf-8c4b-d212aa9ef23b tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:38:09 user devstack@n-api.service[62053]: INFO nova.api.openstack.wsgi [None req-ca307781-132b-41bf-8c4b-d212aa9ef23b tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] HTTP exception thrown: Instance 0a5c9b2c-fe1e-4a21-b213-c63e2c28748a could not be found. Apr 13 16:38:09 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-ca307781-132b-41bf-8c4b-d212aa9ef23b tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Request method failure captured: Apr 13 16:38:09 user devstack@n-api.service[62053]: request: GET /compute/v2.1/servers/0a5c9b2c-fe1e-4a21-b213-c63e2c28748a HTTP/1.1 Apr 13 16:38:09 user devstack@n-api.service[62053]: Accept: application/json Apr 13 16:38:09 user devstack@n-api.service[62053]: Accept-Encoding: identity Apr 13 16:38:09 user devstack@n-api.service[62053]: Connection: close Apr 13 16:38:09 user devstack@n-api.service[62053]: Content-Length: 0 Apr 13 16:38:09 user devstack@n-api.service[62053]: Content-Type: application/json Apr 13 16:38:09 user devstack@n-api.service[62053]: Host: 10.0.0.210 Apr 13 16:38:09 user devstack@n-api.service[62053]: Openstack-System-Scope: None Apr 13 16:38:09 user devstack@n-api.service[62053]: User-Agent: python-urllib3/1.26.15 Apr 13 16:38:09 user devstack@n-api.service[62053]: X-Auth-Token: gAAAAABkOCwkI2hCVv3q2RMbn5sWNaNksO2jlEae5ib0A_n2-4Ip_Pl-WyakKOiBGyr1g-8idBZHWfWrP88wr7DW2Z-7RXK4r2oTVrS71NZCSisAoUDBhj4KwKB40I0svywhzMPIjrB1h0EwajlcYKhM2GYo5FTaZ-MnJbSWEwEZAY8gyi1eSaE Apr 13 16:38:09 user devstack@n-api.service[62053]: X-Domain-Id: None Apr 13 16:38:09 user devstack@n-api.service[62053]: X-Domain-Name: None Apr 13 16:38:09 user devstack@n-api.service[62053]: X-Identity-Status: Confirmed Apr 13 16:38:09 user devstack@n-api.service[62053]: X-Is-Admin-Project: True Apr 13 16:38:09 user devstack@n-api.service[62053]: X-Project-Domain-Id: default Apr 13 16:38:09 user devstack@n-api.service[62053]: X-Project-Domain-Name: Default Apr 13 16:38:09 user devstack@n-api.service[62053]: X-Project-Id: 8d451e0e239f486aa2b3abe9e273eab3 Apr 13 16:38:09 user devstack@n-api.service[62053]: X-Project-Name: tempest-TestVolumeBootPattern-438786227 Apr 13 16:38:09 user devstack@n-api.service[62053]: X-Role: reader,member Apr 13 16:38:09 user devstack@n-api.service[62053]: X-Roles: reader,member Apr 13 16:38:09 user devstack@n-api.service[62053]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8d451e0e239f486aa2b3abe9e273eab3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8d451e0e239f486aa2b3abe9e273eab3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8d451e0e239f486aa2b3abe9e273eab3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 13 16:38:09 user devstack@n-api.service[62053]: X-Tenant: tempest-TestVolumeBootPattern-438786227 Apr 13 16:38:09 user devstack@n-api.service[62053]: X-Tenant-Id: 8d451e0e239f486aa2b3abe9e273eab3 Apr 13 16:38:09 user devstack@n-api.service[62053]: X-Tenant-Name: tempest-TestVolumeBootPattern-438786227 Apr 13 16:38:09 user devstack@n-api.service[62053]: X-User: tempest-TestVolumeBootPattern-438786227-project-member Apr 13 16:38:09 user devstack@n-api.service[62053]: X-User-Domain-Id: default Apr 13 16:38:09 user devstack@n-api.service[62053]: X-User-Domain-Name: Default Apr 13 16:38:09 user devstack@n-api.service[62053]: X-User-Id: d70e10f63cdd49a9a1ebe1fe4c9de0a2 Apr 13 16:38:09 user devstack@n-api.service[62053]: X-User-Name: tempest-TestVolumeBootPattern-438786227-project-member Apr 13 16:38:09 user devstack@n-api.service[62053]: method: > Apr 13 16:38:09 user devstack@n-api.service[62053]: exception: Instance 0a5c9b2c-fe1e-4a21-b213-c63e2c28748a could not be found. Apr 13 16:38:09 user devstack@n-api.service[62053]: action_args: {'id': '0a5c9b2c-fe1e-4a21-b213-c63e2c28748a'} Apr 13 16:38:09 user devstack@n-api.service[62053]: {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 16:38:09 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:38:09 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 16:38:09 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 16:38:09 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 16:38:09 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 16:38:09 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 16:38:09 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 16:38:09 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 16:38:09 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 16:38:09 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a5c9b2c-fe1e-4a21-b213-c63e2c28748a could not be found. Apr 13 16:38:09 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:38:09 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:38:09 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:38:09 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:38:09 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 16:38:09 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 16:38:09 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 16:38:09 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 16:38:09 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 16:38:09 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 16:38:09 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 16:38:09 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 16:38:09 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 16:38:09 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 16:38:09 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 16:38:09 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 16:38:09 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a5c9b2c-fe1e-4a21-b213-c63e2c28748a could not be found. Apr 13 16:38:09 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:38:09 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:38:09 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:38:09 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:38:09 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 16:38:09 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 16:38:09 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 16:38:09 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 16:38:09 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a5c9b2c-fe1e-4a21-b213-c63e2c28748a could not be found. Apr 13 16:38:09 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:38:09 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-ca307781-132b-41bf-8c4b-d212aa9ef23b tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Returning 404 to user: Instance 0a5c9b2c-fe1e-4a21-b213-c63e2c28748a could not be found. {{(pid=62053) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 16:38:09 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-ca307781-132b-41bf-8c4b-d212aa9ef23b tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0a5c9b2c-fe1e-4a21-b213-c63e2c28748a" status: 404 len: 111 microversion: 2.1 time: 0.305345 Apr 13 16:38:09 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 262/781] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:38:09 2023] GET /compute/v2.1/servers/0a5c9b2c-fe1e-4a21-b213-c63e2c28748a => generated 111 bytes in 308 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 16:38:09 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-10f9112d-9b04-4ae6-a1bf-871a5ae57987 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:38:09 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-10f9112d-9b04-4ae6-a1bf-871a5ae57987 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:38:09 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-10f9112d-9b04-4ae6-a1bf-871a5ae57987 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:38:09 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-10f9112d-9b04-4ae6-a1bf-871a5ae57987 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:38:09 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-10f9112d-9b04-4ae6-a1bf-871a5ae57987 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:38:09 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-10f9112d-9b04-4ae6-a1bf-871a5ae57987 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:38:09 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-10f9112d-9b04-4ae6-a1bf-871a5ae57987 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:38:09 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-10f9112d-9b04-4ae6-a1bf-871a5ae57987 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:38:09 user devstack@n-api.service[62055]: INFO nova.api.openstack.wsgi [None req-10f9112d-9b04-4ae6-a1bf-871a5ae57987 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] HTTP exception thrown: Instance 2956ab05-28ff-4c9e-b646-dbb83b3db278 could not be found. Apr 13 16:38:09 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-10f9112d-9b04-4ae6-a1bf-871a5ae57987 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Request method failure captured: Apr 13 16:38:09 user devstack@n-api.service[62055]: request: GET /compute/v2.1/servers/2956ab05-28ff-4c9e-b646-dbb83b3db278 HTTP/1.1 Apr 13 16:38:09 user devstack@n-api.service[62055]: Accept: application/json Apr 13 16:38:09 user devstack@n-api.service[62055]: Accept-Encoding: identity Apr 13 16:38:09 user devstack@n-api.service[62055]: Connection: close Apr 13 16:38:09 user devstack@n-api.service[62055]: Content-Length: 0 Apr 13 16:38:09 user devstack@n-api.service[62055]: Content-Type: application/json Apr 13 16:38:09 user devstack@n-api.service[62055]: Host: 10.0.0.210 Apr 13 16:38:09 user devstack@n-api.service[62055]: Openstack-System-Scope: None Apr 13 16:38:09 user devstack@n-api.service[62055]: User-Agent: python-urllib3/1.26.15 Apr 13 16:38:09 user devstack@n-api.service[62055]: X-Auth-Token: gAAAAABkOCu7MtWsOKSMJjfUQoU1oULuxX5_cxyqm3fiJ7uecNfGTxHfJGIzcsyuCKeTwX-UXiHsZPrgRPfRBnnspVLwGwCfG0xufWPhyTPeWFp1wJprkPGdV6PWcITd2zUKfAsRW_LPw8sefk-_NFDd_MYVeClml_YnSb-VpMEF_XYmDOZUCRg Apr 13 16:38:09 user devstack@n-api.service[62055]: X-Domain-Id: None Apr 13 16:38:09 user devstack@n-api.service[62055]: X-Domain-Name: None Apr 13 16:38:09 user devstack@n-api.service[62055]: X-Identity-Status: Confirmed Apr 13 16:38:09 user devstack@n-api.service[62055]: X-Is-Admin-Project: True Apr 13 16:38:09 user devstack@n-api.service[62055]: X-Openstack-Nova-Api-Version: 2.87 Apr 13 16:38:09 user devstack@n-api.service[62055]: X-Project-Domain-Id: default Apr 13 16:38:09 user devstack@n-api.service[62055]: X-Project-Domain-Name: Default Apr 13 16:38:09 user devstack@n-api.service[62055]: X-Project-Id: b2d09a74bf684a9fb1dd1e95d6c23f3c Apr 13 16:38:09 user devstack@n-api.service[62055]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-1960261099 Apr 13 16:38:09 user devstack@n-api.service[62055]: X-Role: reader,member Apr 13 16:38:09 user devstack@n-api.service[62055]: X-Roles: reader,member Apr 13 16:38:09 user devstack@n-api.service[62055]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b2d09a74bf684a9fb1dd1e95d6c23f3c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b2d09a74bf684a9fb1dd1e95d6c23f3c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b2d09a74bf684a9fb1dd1e95d6c23f3c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 13 16:38:09 user devstack@n-api.service[62055]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-1960261099 Apr 13 16:38:09 user devstack@n-api.service[62055]: X-Tenant-Id: b2d09a74bf684a9fb1dd1e95d6c23f3c Apr 13 16:38:09 user devstack@n-api.service[62055]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-1960261099 Apr 13 16:38:09 user devstack@n-api.service[62055]: X-User: tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member Apr 13 16:38:09 user devstack@n-api.service[62055]: X-User-Domain-Id: default Apr 13 16:38:09 user devstack@n-api.service[62055]: X-User-Domain-Name: Default Apr 13 16:38:09 user devstack@n-api.service[62055]: X-User-Id: e45a882dbafb4ea4976e4f45289eb2b8 Apr 13 16:38:09 user devstack@n-api.service[62055]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member Apr 13 16:38:09 user devstack@n-api.service[62055]: method: > Apr 13 16:38:09 user devstack@n-api.service[62055]: exception: Instance 2956ab05-28ff-4c9e-b646-dbb83b3db278 could not be found. Apr 13 16:38:09 user devstack@n-api.service[62055]: action_args: {'id': '2956ab05-28ff-4c9e-b646-dbb83b3db278'} Apr 13 16:38:09 user devstack@n-api.service[62055]: {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 16:38:09 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:38:09 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 16:38:09 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 16:38:09 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 16:38:09 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 16:38:09 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 16:38:09 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 16:38:09 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 16:38:09 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 16:38:09 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2956ab05-28ff-4c9e-b646-dbb83b3db278 could not be found. Apr 13 16:38:09 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:38:09 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:38:09 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:38:09 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:38:09 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 16:38:09 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 16:38:09 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 16:38:09 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 16:38:09 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 16:38:09 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 16:38:09 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 16:38:09 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 16:38:09 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 16:38:09 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 16:38:09 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 16:38:09 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 16:38:09 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2956ab05-28ff-4c9e-b646-dbb83b3db278 could not be found. Apr 13 16:38:09 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:38:09 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:38:09 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:38:09 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:38:09 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 16:38:09 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 16:38:09 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 16:38:09 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 16:38:09 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2956ab05-28ff-4c9e-b646-dbb83b3db278 could not be found. Apr 13 16:38:09 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:38:09 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-10f9112d-9b04-4ae6-a1bf-871a5ae57987 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Returning 404 to user: Instance 2956ab05-28ff-4c9e-b646-dbb83b3db278 could not be found. {{(pid=62055) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 16:38:09 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-10f9112d-9b04-4ae6-a1bf-871a5ae57987 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2956ab05-28ff-4c9e-b646-dbb83b3db278" status: 404 len: 111 microversion: 2.87 time: 0.034514 Apr 13 16:38:09 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 260/782] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 16:38:09 2023] GET /compute/v2.1/servers/2956ab05-28ff-4c9e-b646-dbb83b3db278 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 13 16:38:10 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-f1b92347-5061-44ee-b769-bb9b2ae2dcd8 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:38:10 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-f1b92347-5061-44ee-b769-bb9b2ae2dcd8 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 650427bd-4dad-4bcd-922d-c17e60b36807] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:38:10 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-f1b92347-5061-44ee-b769-bb9b2ae2dcd8 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:38:10 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-f1b92347-5061-44ee-b769-bb9b2ae2dcd8 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:38:10 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-f1b92347-5061-44ee-b769-bb9b2ae2dcd8 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:38:10 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-f1b92347-5061-44ee-b769-bb9b2ae2dcd8 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:38:10 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-f1b92347-5061-44ee-b769-bb9b2ae2dcd8 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:38:10 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-f1b92347-5061-44ee-b769-bb9b2ae2dcd8 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:38:10 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-f1b92347-5061-44ee-b769-bb9b2ae2dcd8 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 650427bd-4dad-4bcd-922d-c17e60b36807] Going to try to terminate instance {{(pid=62054) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 16:38:10 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-f1b92347-5061-44ee-b769-bb9b2ae2dcd8 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/650427bd-4dad-4bcd-922d-c17e60b36807" status: 204 len: 0 microversion: 2.87 time: 0.133003 Apr 13 16:38:10 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 261/783] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 13 16:38:10 2023] DELETE /compute/v2.1/servers/650427bd-4dad-4bcd-922d-c17e60b36807 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 13 16:38:10 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-ad7de502-07c6-4451-b9f8-145c6d20d5db tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:38:10 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-ad7de502-07c6-4451-b9f8-145c6d20d5db tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 650427bd-4dad-4bcd-922d-c17e60b36807] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:38:10 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-ad7de502-07c6-4451-b9f8-145c6d20d5db tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:38:10 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-ad7de502-07c6-4451-b9f8-145c6d20d5db tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:38:10 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-ad7de502-07c6-4451-b9f8-145c6d20d5db tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:38:10 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-ad7de502-07c6-4451-b9f8-145c6d20d5db tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:38:10 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-ad7de502-07c6-4451-b9f8-145c6d20d5db tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:38:10 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-ad7de502-07c6-4451-b9f8-145c6d20d5db tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:38:10 user devstack@n-api.service[62053]: DEBUG nova.policy [None req-ad7de502-07c6-4451-b9f8-145c6d20d5db tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45a882dbafb4ea4976e4f45289eb2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d09a74bf684a9fb1dd1e95d6c23f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62053) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:38:10 user devstack@n-api.service[62053]: DEBUG nova.policy [None req-ad7de502-07c6-4451-b9f8-145c6d20d5db tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e45a882dbafb4ea4976e4f45289eb2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d09a74bf684a9fb1dd1e95d6c23f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62053) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:38:10 user devstack@n-api.service[62053]: DEBUG nova.policy [None req-ad7de502-07c6-4451-b9f8-145c6d20d5db tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e45a882dbafb4ea4976e4f45289eb2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d09a74bf684a9fb1dd1e95d6c23f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62053) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:38:10 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-ad7de502-07c6-4451-b9f8-145c6d20d5db tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] 10.0.0.210 "GET /compute/v2.1/servers/650427bd-4dad-4bcd-922d-c17e60b36807" status: 200 len: 1696 microversion: 2.87 time: 0.227896 Apr 13 16:38:10 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 263/784] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 16:38:10 2023] GET /compute/v2.1/servers/650427bd-4dad-4bcd-922d-c17e60b36807 => generated 1696 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 16:38:10 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [req-856ec627-5381-4f9d-8dfe-aad58377ebed req-0e84b0cd-4c70-4ee7-ae2c-9b38d4f6fd75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "650427bd-4dad-4bcd-922d-c17e60b36807", "name": "network-vif-unplugged", "status": "completed", "tag": "c6fe8d62-f2ba-44d6-a5e3-da6f35679b3f"}]} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:38:10 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-856ec627-5381-4f9d-8dfe-aad58377ebed req-0e84b0cd-4c70-4ee7-ae2c-9b38d4f6fd75 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:38:10 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-856ec627-5381-4f9d-8dfe-aad58377ebed req-0e84b0cd-4c70-4ee7-ae2c-9b38d4f6fd75 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:38:10 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-856ec627-5381-4f9d-8dfe-aad58377ebed req-0e84b0cd-4c70-4ee7-ae2c-9b38d4f6fd75 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:38:10 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-856ec627-5381-4f9d-8dfe-aad58377ebed req-0e84b0cd-4c70-4ee7-ae2c-9b38d4f6fd75 service nova] Creating event network-vif-unplugged:c6fe8d62-f2ba-44d6-a5e3-da6f35679b3f for instance 650427bd-4dad-4bcd-922d-c17e60b36807 on user Apr 13 16:38:10 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [req-856ec627-5381-4f9d-8dfe-aad58377ebed req-0e84b0cd-4c70-4ee7-ae2c-9b38d4f6fd75 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039557 Apr 13 16:38:10 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 261/785] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:38:10 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:38:11 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_cell0:SELECT=2 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:38:11 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-c92c2357-6cb4-4b9f-b0ab-95beb6abce12 req-a14c4cd2-2d3f-47ac-a590-186066b2a277 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "650427bd-4dad-4bcd-922d-c17e60b36807", "name": "network-vif-deleted", "tag": "c6fe8d62-f2ba-44d6-a5e3-da6f35679b3f"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:38:11 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-c92c2357-6cb4-4b9f-b0ab-95beb6abce12 req-a14c4cd2-2d3f-47ac-a590-186066b2a277 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:38:11 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-c92c2357-6cb4-4b9f-b0ab-95beb6abce12 req-a14c4cd2-2d3f-47ac-a590-186066b2a277 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:38:11 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-c92c2357-6cb4-4b9f-b0ab-95beb6abce12 req-a14c4cd2-2d3f-47ac-a590-186066b2a277 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:38:11 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-c92c2357-6cb4-4b9f-b0ab-95beb6abce12 req-a14c4cd2-2d3f-47ac-a590-186066b2a277 service nova] Creating event network-vif-deleted:c6fe8d62-f2ba-44d6-a5e3-da6f35679b3f for instance 650427bd-4dad-4bcd-922d-c17e60b36807 on user Apr 13 16:38:11 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [req-c92c2357-6cb4-4b9f-b0ab-95beb6abce12 req-a14c4cd2-2d3f-47ac-a590-186066b2a277 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032566 Apr 13 16:38:11 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 262/786] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:38:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:38:12 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-8ffbe959-2369-4dff-a5d8-68369dee2d8e req-38248eba-4244-45d9-a845-9b1e1204fe08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "650427bd-4dad-4bcd-922d-c17e60b36807", "name": "network-vif-plugged", "status": "completed", "tag": "c6fe8d62-f2ba-44d6-a5e3-da6f35679b3f"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:38:12 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-8ffbe959-2369-4dff-a5d8-68369dee2d8e req-38248eba-4244-45d9-a845-9b1e1204fe08 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:38:12 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-8ffbe959-2369-4dff-a5d8-68369dee2d8e req-38248eba-4244-45d9-a845-9b1e1204fe08 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:38:12 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-8ffbe959-2369-4dff-a5d8-68369dee2d8e req-38248eba-4244-45d9-a845-9b1e1204fe08 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:38:12 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-8ffbe959-2369-4dff-a5d8-68369dee2d8e req-38248eba-4244-45d9-a845-9b1e1204fe08 service nova] Creating event network-vif-plugged:c6fe8d62-f2ba-44d6-a5e3-da6f35679b3f for instance 650427bd-4dad-4bcd-922d-c17e60b36807 on user Apr 13 16:38:12 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [req-8ffbe959-2369-4dff-a5d8-68369dee2d8e req-38248eba-4244-45d9-a845-9b1e1204fe08 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041224 Apr 13 16:38:12 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 264/787] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:38:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:38:14 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_cell0:SELECT=2 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:38:14 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_cell0:SELECT=6 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:38:14 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-3e1e900b-b338-42e0-9d28-9c67756fd79d tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:38:14 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-3e1e900b-b338-42e0-9d28-9c67756fd79d tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 220e1c3e-1378-46fc-acc1-ee1bafac7722] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:38:14 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-4d3cfd7c-d18f-4950-9034-50ebdad205c2 req-5e6cd082-5e83-4c38-99b1-5e8b44c477f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "220e1c3e-1378-46fc-acc1-ee1bafac7722", "tag": "96415b19-4e1b-41c6-a070-cff24e7b20ab"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:38:14 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-3e1e900b-b338-42e0-9d28-9c67756fd79d tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:38:14 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-3e1e900b-b338-42e0-9d28-9c67756fd79d tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:38:14 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-3e1e900b-b338-42e0-9d28-9c67756fd79d tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:38:14 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-4d3cfd7c-d18f-4950-9034-50ebdad205c2 req-5e6cd082-5e83-4c38-99b1-5e8b44c477f9 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:38:14 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-4d3cfd7c-d18f-4950-9034-50ebdad205c2 req-5e6cd082-5e83-4c38-99b1-5e8b44c477f9 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:38:14 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-3e1e900b-b338-42e0-9d28-9c67756fd79d tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:38:14 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-4d3cfd7c-d18f-4950-9034-50ebdad205c2 req-5e6cd082-5e83-4c38-99b1-5e8b44c477f9 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:38:14 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-3e1e900b-b338-42e0-9d28-9c67756fd79d tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:38:14 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-3e1e900b-b338-42e0-9d28-9c67756fd79d tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:38:14 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-4d3cfd7c-d18f-4950-9034-50ebdad205c2 req-5e6cd082-5e83-4c38-99b1-5e8b44c477f9 service nova] Creating event network-changed:96415b19-4e1b-41c6-a070-cff24e7b20ab for instance 220e1c3e-1378-46fc-acc1-ee1bafac7722 on user Apr 13 16:38:14 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [req-4d3cfd7c-d18f-4950-9034-50ebdad205c2 req-5e6cd082-5e83-4c38-99b1-5e8b44c477f9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031091 Apr 13 16:38:14 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 263/788] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:38:14 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:38:14 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-3e1e900b-b338-42e0-9d28-9c67756fd79d tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 220e1c3e-1378-46fc-acc1-ee1bafac7722] Going to try to terminate instance {{(pid=62055) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 16:38:14 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-3e1e900b-b338-42e0-9d28-9c67756fd79d tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/220e1c3e-1378-46fc-acc1-ee1bafac7722" status: 204 len: 0 microversion: 2.1 time: 0.146592 Apr 13 16:38:14 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 262/789] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 16:38:14 2023] DELETE /compute/v2.1/servers/220e1c3e-1378-46fc-acc1-ee1bafac7722 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 16:38:14 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-95784ca8-59a7-42f7-a6ef-6c6f84a2c49a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:38:14 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-95784ca8-59a7-42f7-a6ef-6c6f84a2c49a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 220e1c3e-1378-46fc-acc1-ee1bafac7722] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:38:15 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-95784ca8-59a7-42f7-a6ef-6c6f84a2c49a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:38:15 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-95784ca8-59a7-42f7-a6ef-6c6f84a2c49a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:38:15 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-95784ca8-59a7-42f7-a6ef-6c6f84a2c49a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:38:15 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-95784ca8-59a7-42f7-a6ef-6c6f84a2c49a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:38:15 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-95784ca8-59a7-42f7-a6ef-6c6f84a2c49a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:38:15 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-95784ca8-59a7-42f7-a6ef-6c6f84a2c49a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:38:15 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-8acee889-7dab-4491-97db-1a3166574d12 req-0a6f1d7f-13d5-4437-9b23-715a355e5a66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "220e1c3e-1378-46fc-acc1-ee1bafac7722", "name": "network-vif-unplugged", "status": "completed", "tag": "96415b19-4e1b-41c6-a070-cff24e7b20ab"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:38:15 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-8acee889-7dab-4491-97db-1a3166574d12 req-0a6f1d7f-13d5-4437-9b23-715a355e5a66 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:38:15 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-8acee889-7dab-4491-97db-1a3166574d12 req-0a6f1d7f-13d5-4437-9b23-715a355e5a66 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:38:15 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-8acee889-7dab-4491-97db-1a3166574d12 req-0a6f1d7f-13d5-4437-9b23-715a355e5a66 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:38:15 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-8acee889-7dab-4491-97db-1a3166574d12 req-0a6f1d7f-13d5-4437-9b23-715a355e5a66 service nova] Creating event network-vif-unplugged:96415b19-4e1b-41c6-a070-cff24e7b20ab for instance 220e1c3e-1378-46fc-acc1-ee1bafac7722 on user Apr 13 16:38:15 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [req-8acee889-7dab-4491-97db-1a3166574d12 req-0a6f1d7f-13d5-4437-9b23-715a355e5a66 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029749 Apr 13 16:38:15 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 264/790] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:38:15 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:38:15 user devstack@n-api.service[62053]: DEBUG nova.policy [None req-95784ca8-59a7-42f7-a6ef-6c6f84a2c49a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e10f63cdd49a9a1ebe1fe4c9de0a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d451e0e239f486aa2b3abe9e273eab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62053) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:38:15 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-95784ca8-59a7-42f7-a6ef-6c6f84a2c49a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] 10.0.0.210 "GET /compute/v2.1/servers/220e1c3e-1378-46fc-acc1-ee1bafac7722" status: 200 len: 1566 microversion: 2.1 time: 0.294142 Apr 13 16:38:15 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 265/791] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:38:14 2023] GET /compute/v2.1/servers/220e1c3e-1378-46fc-acc1-ee1bafac7722 => generated 1566 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:38:16 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [req-3f8463dd-de22-497c-9dc1-8518bf127f53 req-c0b6dfb7-14f1-4328-b32b-b96dae19d793 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "220e1c3e-1378-46fc-acc1-ee1bafac7722", "name": "network-vif-deleted", "tag": "96415b19-4e1b-41c6-a070-cff24e7b20ab"}]} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:38:16 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-3f8463dd-de22-497c-9dc1-8518bf127f53 req-c0b6dfb7-14f1-4328-b32b-b96dae19d793 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:38:16 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-3f8463dd-de22-497c-9dc1-8518bf127f53 req-c0b6dfb7-14f1-4328-b32b-b96dae19d793 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:38:16 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-3f8463dd-de22-497c-9dc1-8518bf127f53 req-c0b6dfb7-14f1-4328-b32b-b96dae19d793 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:38:16 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-3f8463dd-de22-497c-9dc1-8518bf127f53 req-c0b6dfb7-14f1-4328-b32b-b96dae19d793 service nova] Creating event network-vif-deleted:96415b19-4e1b-41c6-a070-cff24e7b20ab for instance 220e1c3e-1378-46fc-acc1-ee1bafac7722 on user Apr 13 16:38:16 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [req-3f8463dd-de22-497c-9dc1-8518bf127f53 req-c0b6dfb7-14f1-4328-b32b-b96dae19d793 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035192 Apr 13 16:38:16 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 263/792] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:38:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:38:17 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-50bfe0e1-0db9-45dd-9b95-8a94bf5370f0 req-aa646ece-bbc5-439e-8a10-86e85a6cd89e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "220e1c3e-1378-46fc-acc1-ee1bafac7722", "name": "network-vif-plugged", "status": "completed", "tag": "96415b19-4e1b-41c6-a070-cff24e7b20ab"}, {"server_uuid": "220e1c3e-1378-46fc-acc1-ee1bafac7722", "name": "network-vif-plugged", "status": "completed", "tag": "96415b19-4e1b-41c6-a070-cff24e7b20ab"}, {"server_uuid": "220e1c3e-1378-46fc-acc1-ee1bafac7722", "name": "network-vif-plugged", "status": "completed", "tag": "96415b19-4e1b-41c6-a070-cff24e7b20ab"}, {"server_uuid": "220e1c3e-1378-46fc-acc1-ee1bafac7722", "name": "network-vif-unplugged", "status": "completed", "tag": "96415b19-4e1b-41c6-a070-cff24e7b20ab"}, {"server_uuid": "220e1c3e-1378-46fc-acc1-ee1bafac7722", "name": "network-vif-plugged", "status": "completed", "tag": "96415b19-4e1b-41c6-a070-cff24e7b20ab"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:38:17 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-50bfe0e1-0db9-45dd-9b95-8a94bf5370f0 req-aa646ece-bbc5-439e-8a10-86e85a6cd89e service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:38:17 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-50bfe0e1-0db9-45dd-9b95-8a94bf5370f0 req-aa646ece-bbc5-439e-8a10-86e85a6cd89e service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:38:17 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-50bfe0e1-0db9-45dd-9b95-8a94bf5370f0 req-aa646ece-bbc5-439e-8a10-86e85a6cd89e service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:38:17 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-50bfe0e1-0db9-45dd-9b95-8a94bf5370f0 req-aa646ece-bbc5-439e-8a10-86e85a6cd89e service nova] Creating event network-vif-plugged:96415b19-4e1b-41c6-a070-cff24e7b20ab for instance 220e1c3e-1378-46fc-acc1-ee1bafac7722 on user Apr 13 16:38:17 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-50bfe0e1-0db9-45dd-9b95-8a94bf5370f0 req-aa646ece-bbc5-439e-8a10-86e85a6cd89e service nova] Creating event network-vif-plugged:96415b19-4e1b-41c6-a070-cff24e7b20ab for instance 220e1c3e-1378-46fc-acc1-ee1bafac7722 on user Apr 13 16:38:17 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-50bfe0e1-0db9-45dd-9b95-8a94bf5370f0 req-aa646ece-bbc5-439e-8a10-86e85a6cd89e service nova] Creating event network-vif-plugged:96415b19-4e1b-41c6-a070-cff24e7b20ab for instance 220e1c3e-1378-46fc-acc1-ee1bafac7722 on user Apr 13 16:38:17 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-50bfe0e1-0db9-45dd-9b95-8a94bf5370f0 req-aa646ece-bbc5-439e-8a10-86e85a6cd89e service nova] Creating event network-vif-unplugged:96415b19-4e1b-41c6-a070-cff24e7b20ab for instance 220e1c3e-1378-46fc-acc1-ee1bafac7722 on user Apr 13 16:38:17 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-50bfe0e1-0db9-45dd-9b95-8a94bf5370f0 req-aa646ece-bbc5-439e-8a10-86e85a6cd89e service nova] Creating event network-vif-plugged:96415b19-4e1b-41c6-a070-cff24e7b20ab for instance 220e1c3e-1378-46fc-acc1-ee1bafac7722 on user Apr 13 16:38:17 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [req-50bfe0e1-0db9-45dd-9b95-8a94bf5370f0 req-aa646ece-bbc5-439e-8a10-86e85a6cd89e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.032696 Apr 13 16:38:17 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 265/793] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:38:17 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:38:23 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-874f01c0-5b60-4fa9-821d-c1140918950b tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:38:23 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-874f01c0-5b60-4fa9-821d-c1140918950b tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:38:23 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-874f01c0-5b60-4fa9-821d-c1140918950b tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:38:23 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-874f01c0-5b60-4fa9-821d-c1140918950b tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:38:23 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-874f01c0-5b60-4fa9-821d-c1140918950b tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:38:23 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-874f01c0-5b60-4fa9-821d-c1140918950b tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:38:23 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-874f01c0-5b60-4fa9-821d-c1140918950b tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:38:23 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-874f01c0-5b60-4fa9-821d-c1140918950b tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:38:23 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-874f01c0-5b60-4fa9-821d-c1140918950b tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] 10.0.0.210 "GET /compute/v2.1/servers/35b23303-e373-4f35-b7ee-76e6815073ce/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.050452 Apr 13 16:38:23 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 266/794] 10.0.0.210 () {64 vars in 1420 bytes} [Thu Apr 13 16:38:23 2023] GET /compute/v2.1/servers/35b23303-e373-4f35-b7ee-76e6815073ce/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:38:23 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-b20e20d4-76db-4fc3-b798-f876fc7c242d tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:38:23 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-b20e20d4-76db-4fc3-b798-f876fc7c242d tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:38:23 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-b20e20d4-76db-4fc3-b798-f876fc7c242d tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:38:23 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-b20e20d4-76db-4fc3-b798-f876fc7c242d tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:38:23 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-b20e20d4-76db-4fc3-b798-f876fc7c242d tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:38:23 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-b20e20d4-76db-4fc3-b798-f876fc7c242d tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:38:23 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-b20e20d4-76db-4fc3-b798-f876fc7c242d tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:38:23 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-b20e20d4-76db-4fc3-b798-f876fc7c242d tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:38:23 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-b20e20d4-76db-4fc3-b798-f876fc7c242d tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Going to try to terminate instance {{(pid=62055) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 16:38:24 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-b20e20d4-76db-4fc3-b798-f876fc7c242d tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/35b23303-e373-4f35-b7ee-76e6815073ce" status: 204 len: 0 microversion: 2.20 time: 0.155623 Apr 13 16:38:24 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 264/795] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 13 16:38:23 2023] DELETE /compute/v2.1/servers/35b23303-e373-4f35-b7ee-76e6815073ce => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 13 16:38:24 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-8c3e9c87-7f5b-4381-a538-be6a1b6a47a3 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:38:24 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-8c3e9c87-7f5b-4381-a538-be6a1b6a47a3 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:38:24 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-8c3e9c87-7f5b-4381-a538-be6a1b6a47a3 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:38:24 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-8c3e9c87-7f5b-4381-a538-be6a1b6a47a3 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:38:24 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-8c3e9c87-7f5b-4381-a538-be6a1b6a47a3 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:38:24 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-8c3e9c87-7f5b-4381-a538-be6a1b6a47a3 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:38:24 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-8c3e9c87-7f5b-4381-a538-be6a1b6a47a3 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:38:24 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-8c3e9c87-7f5b-4381-a538-be6a1b6a47a3 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:38:24 user devstack@n-api.service[62054]: DEBUG nova.policy [None req-8c3e9c87-7f5b-4381-a538-be6a1b6a47a3 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b4e972cd1049509fa899449961ab59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0653ab16660b46cea9c5af58ea0b1931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62054) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:38:24 user devstack@n-api.service[62054]: DEBUG nova.policy [None req-8c3e9c87-7f5b-4381-a538-be6a1b6a47a3 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48b4e972cd1049509fa899449961ab59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0653ab16660b46cea9c5af58ea0b1931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62054) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:38:24 user devstack@n-api.service[62054]: DEBUG nova.policy [None req-8c3e9c87-7f5b-4381-a538-be6a1b6a47a3 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48b4e972cd1049509fa899449961ab59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0653ab16660b46cea9c5af58ea0b1931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62054) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:38:24 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-8c3e9c87-7f5b-4381-a538-be6a1b6a47a3 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] 10.0.0.210 "GET /compute/v2.1/servers/35b23303-e373-4f35-b7ee-76e6815073ce" status: 200 len: 1713 microversion: 2.20 time: 0.346700 Apr 13 16:38:24 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 266/796] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 16:38:24 2023] GET /compute/v2.1/servers/35b23303-e373-4f35-b7ee-76e6815073ce => generated 1713 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 16:38:24 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-06ead680-0d61-48ad-87ab-51cc974245d0 req-95a876fe-9f65-4d52-8d20-e5913fac34f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35b23303-e373-4f35-b7ee-76e6815073ce", "name": "network-vif-unplugged", "status": "completed", "tag": "d3c66e4e-b15d-4bc9-a838-265ca07a6a66"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:38:24 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-06ead680-0d61-48ad-87ab-51cc974245d0 req-95a876fe-9f65-4d52-8d20-e5913fac34f5 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:38:24 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-06ead680-0d61-48ad-87ab-51cc974245d0 req-95a876fe-9f65-4d52-8d20-e5913fac34f5 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:38:24 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-06ead680-0d61-48ad-87ab-51cc974245d0 req-95a876fe-9f65-4d52-8d20-e5913fac34f5 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:38:24 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-06ead680-0d61-48ad-87ab-51cc974245d0 req-95a876fe-9f65-4d52-8d20-e5913fac34f5 service nova] Creating event network-vif-unplugged:d3c66e4e-b15d-4bc9-a838-265ca07a6a66 for instance 35b23303-e373-4f35-b7ee-76e6815073ce on user Apr 13 16:38:24 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [req-06ead680-0d61-48ad-87ab-51cc974245d0 req-95a876fe-9f65-4d52-8d20-e5913fac34f5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044649 Apr 13 16:38:24 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 267/797] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:38:24 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:38:25 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [req-708fae6c-67e6-4cb1-bfaf-058dc401831a req-da3147f1-628f-4635-8dcd-ef9d66f86f44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35b23303-e373-4f35-b7ee-76e6815073ce", "name": "network-vif-deleted", "tag": "d3c66e4e-b15d-4bc9-a838-265ca07a6a66"}]} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:38:25 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-708fae6c-67e6-4cb1-bfaf-058dc401831a req-da3147f1-628f-4635-8dcd-ef9d66f86f44 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:38:25 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-708fae6c-67e6-4cb1-bfaf-058dc401831a req-da3147f1-628f-4635-8dcd-ef9d66f86f44 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:38:25 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-708fae6c-67e6-4cb1-bfaf-058dc401831a req-da3147f1-628f-4635-8dcd-ef9d66f86f44 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:38:25 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-708fae6c-67e6-4cb1-bfaf-058dc401831a req-da3147f1-628f-4635-8dcd-ef9d66f86f44 service nova] Creating event network-vif-deleted:d3c66e4e-b15d-4bc9-a838-265ca07a6a66 for instance 35b23303-e373-4f35-b7ee-76e6815073ce on user Apr 13 16:38:25 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [req-708fae6c-67e6-4cb1-bfaf-058dc401831a req-da3147f1-628f-4635-8dcd-ef9d66f86f44 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051648 Apr 13 16:38:25 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 265/798] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:38:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:38:26 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-0df9ea84-77b5-4673-8186-cb89c16b1ee1 req-a84c394b-9b4d-46ba-a7ac-26e5eacc0381 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35b23303-e373-4f35-b7ee-76e6815073ce", "name": "network-vif-plugged", "status": "completed", "tag": "d3c66e4e-b15d-4bc9-a838-265ca07a6a66"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:38:26 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-0df9ea84-77b5-4673-8186-cb89c16b1ee1 req-a84c394b-9b4d-46ba-a7ac-26e5eacc0381 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:38:26 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-0df9ea84-77b5-4673-8186-cb89c16b1ee1 req-a84c394b-9b4d-46ba-a7ac-26e5eacc0381 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:38:26 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-0df9ea84-77b5-4673-8186-cb89c16b1ee1 req-a84c394b-9b4d-46ba-a7ac-26e5eacc0381 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:38:26 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-0df9ea84-77b5-4673-8186-cb89c16b1ee1 req-a84c394b-9b4d-46ba-a7ac-26e5eacc0381 service nova] Creating event network-vif-plugged:d3c66e4e-b15d-4bc9-a838-265ca07a6a66 for instance 35b23303-e373-4f35-b7ee-76e6815073ce on user Apr 13 16:38:26 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [req-0df9ea84-77b5-4673-8186-cb89c16b1ee1 req-a84c394b-9b4d-46ba-a7ac-26e5eacc0381 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030308 Apr 13 16:38:26 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 267/799] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:38:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:38:51 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_api:SELECT=18 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:38:51 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_cell1:SELECT=28 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:38:51 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-0abd8116-2bad-4c39-b1b4-e7cb688239a3 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:38:51 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-0abd8116-2bad-4c39-b1b4-e7cb688239a3 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 5ed800fe-577d-4624-898c-c7f40da77376] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:38:51 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-0abd8116-2bad-4c39-b1b4-e7cb688239a3 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:38:51 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-0abd8116-2bad-4c39-b1b4-e7cb688239a3 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:38:51 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-0abd8116-2bad-4c39-b1b4-e7cb688239a3 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:38:51 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-0abd8116-2bad-4c39-b1b4-e7cb688239a3 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:38:51 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-0abd8116-2bad-4c39-b1b4-e7cb688239a3 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:38:51 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-0abd8116-2bad-4c39-b1b4-e7cb688239a3 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:38:51 user devstack@n-api.service[62053]: DEBUG nova.policy [None req-0abd8116-2bad-4c39-b1b4-e7cb688239a3 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b3df1c5c5d441819bcef89ed6966815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980559734a504574a83224deb7423c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62053) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:38:51 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-0abd8116-2bad-4c39-b1b4-e7cb688239a3 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5ed800fe-577d-4624-898c-c7f40da77376" status: 200 len: 1539 microversion: 2.1 time: 0.189099 Apr 13 16:38:51 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 268/800] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:38:51 2023] GET /compute/v2.1/servers/5ed800fe-577d-4624-898c-c7f40da77376 => generated 1539 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 13 16:39:00 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:39:00 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:39:00 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-8e95612d-d724-4a55-98e4-c421b865cd4d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:39:00 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-8e95612d-d724-4a55-98e4-c421b865cd4d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 650427bd-4dad-4bcd-922d-c17e60b36807] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:39:00 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-8e95612d-d724-4a55-98e4-c421b865cd4d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:39:00 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-8e95612d-d724-4a55-98e4-c421b865cd4d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:39:00 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-8e95612d-d724-4a55-98e4-c421b865cd4d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:39:00 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-8e95612d-d724-4a55-98e4-c421b865cd4d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:39:00 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-8e95612d-d724-4a55-98e4-c421b865cd4d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:39:00 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-8e95612d-d724-4a55-98e4-c421b865cd4d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:39:00 user devstack@n-api.service[62055]: INFO nova.api.openstack.wsgi [None req-8e95612d-d724-4a55-98e4-c421b865cd4d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] HTTP exception thrown: Instance 650427bd-4dad-4bcd-922d-c17e60b36807 could not be found. Apr 13 16:39:00 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-8e95612d-d724-4a55-98e4-c421b865cd4d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Request method failure captured: Apr 13 16:39:00 user devstack@n-api.service[62055]: request: GET /compute/v2.1/servers/650427bd-4dad-4bcd-922d-c17e60b36807 HTTP/1.1 Apr 13 16:39:00 user devstack@n-api.service[62055]: Accept: application/json Apr 13 16:39:00 user devstack@n-api.service[62055]: Accept-Encoding: identity Apr 13 16:39:00 user devstack@n-api.service[62055]: Connection: close Apr 13 16:39:00 user devstack@n-api.service[62055]: Content-Length: 0 Apr 13 16:39:00 user devstack@n-api.service[62055]: Content-Type: application/json Apr 13 16:39:00 user devstack@n-api.service[62055]: Host: 10.0.0.210 Apr 13 16:39:00 user devstack@n-api.service[62055]: Openstack-System-Scope: None Apr 13 16:39:00 user devstack@n-api.service[62055]: User-Agent: python-urllib3/1.26.15 Apr 13 16:39:00 user devstack@n-api.service[62055]: X-Auth-Token: gAAAAABkOCu7MtWsOKSMJjfUQoU1oULuxX5_cxyqm3fiJ7uecNfGTxHfJGIzcsyuCKeTwX-UXiHsZPrgRPfRBnnspVLwGwCfG0xufWPhyTPeWFp1wJprkPGdV6PWcITd2zUKfAsRW_LPw8sefk-_NFDd_MYVeClml_YnSb-VpMEF_XYmDOZUCRg Apr 13 16:39:00 user devstack@n-api.service[62055]: X-Domain-Id: None Apr 13 16:39:00 user devstack@n-api.service[62055]: X-Domain-Name: None Apr 13 16:39:00 user devstack@n-api.service[62055]: X-Identity-Status: Confirmed Apr 13 16:39:00 user devstack@n-api.service[62055]: X-Is-Admin-Project: True Apr 13 16:39:00 user devstack@n-api.service[62055]: X-Openstack-Nova-Api-Version: 2.87 Apr 13 16:39:00 user devstack@n-api.service[62055]: X-Project-Domain-Id: default Apr 13 16:39:00 user devstack@n-api.service[62055]: X-Project-Domain-Name: Default Apr 13 16:39:00 user devstack@n-api.service[62055]: X-Project-Id: b2d09a74bf684a9fb1dd1e95d6c23f3c Apr 13 16:39:00 user devstack@n-api.service[62055]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-1960261099 Apr 13 16:39:00 user devstack@n-api.service[62055]: X-Role: reader,member Apr 13 16:39:00 user devstack@n-api.service[62055]: X-Roles: reader,member Apr 13 16:39:00 user devstack@n-api.service[62055]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b2d09a74bf684a9fb1dd1e95d6c23f3c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b2d09a74bf684a9fb1dd1e95d6c23f3c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b2d09a74bf684a9fb1dd1e95d6c23f3c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 13 16:39:00 user devstack@n-api.service[62055]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-1960261099 Apr 13 16:39:00 user devstack@n-api.service[62055]: X-Tenant-Id: b2d09a74bf684a9fb1dd1e95d6c23f3c Apr 13 16:39:00 user devstack@n-api.service[62055]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-1960261099 Apr 13 16:39:00 user devstack@n-api.service[62055]: X-User: tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member Apr 13 16:39:00 user devstack@n-api.service[62055]: X-User-Domain-Id: default Apr 13 16:39:00 user devstack@n-api.service[62055]: X-User-Domain-Name: Default Apr 13 16:39:00 user devstack@n-api.service[62055]: X-User-Id: e45a882dbafb4ea4976e4f45289eb2b8 Apr 13 16:39:00 user devstack@n-api.service[62055]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member Apr 13 16:39:00 user devstack@n-api.service[62055]: method: > Apr 13 16:39:00 user devstack@n-api.service[62055]: exception: Instance 650427bd-4dad-4bcd-922d-c17e60b36807 could not be found. Apr 13 16:39:00 user devstack@n-api.service[62055]: action_args: {'id': '650427bd-4dad-4bcd-922d-c17e60b36807'} Apr 13 16:39:00 user devstack@n-api.service[62055]: {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 16:39:00 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:39:00 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 16:39:00 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 16:39:00 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 16:39:00 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 16:39:00 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 16:39:00 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 16:39:00 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 16:39:00 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 16:39:00 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 650427bd-4dad-4bcd-922d-c17e60b36807 could not be found. Apr 13 16:39:00 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:39:00 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:39:00 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:39:00 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:39:00 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 16:39:00 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 16:39:00 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 16:39:00 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 16:39:00 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 16:39:00 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 16:39:00 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 16:39:00 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 16:39:00 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 16:39:00 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 16:39:00 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 16:39:00 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 16:39:00 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 650427bd-4dad-4bcd-922d-c17e60b36807 could not be found. Apr 13 16:39:00 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:39:00 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:39:00 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:39:00 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:39:00 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 16:39:00 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 16:39:00 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 16:39:00 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 16:39:00 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 650427bd-4dad-4bcd-922d-c17e60b36807 could not be found. Apr 13 16:39:00 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:39:00 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-8e95612d-d724-4a55-98e4-c421b865cd4d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Returning 404 to user: Instance 650427bd-4dad-4bcd-922d-c17e60b36807 could not be found. {{(pid=62055) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 16:39:00 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-8e95612d-d724-4a55-98e4-c421b865cd4d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] 10.0.0.210 "GET /compute/v2.1/servers/650427bd-4dad-4bcd-922d-c17e60b36807" status: 404 len: 111 microversion: 2.87 time: 0.056059 Apr 13 16:39:00 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 266/801] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 16:39:00 2023] GET /compute/v2.1/servers/650427bd-4dad-4bcd-922d-c17e60b36807 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 13 16:39:00 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:39:00 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:39:00 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-a17c6fd3-18bf-4d9c-894c-6b9e03d5976c tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:39:00 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-a17c6fd3-18bf-4d9c-894c-6b9e03d5976c tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:39:00 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-a17c6fd3-18bf-4d9c-894c-6b9e03d5976c tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:39:00 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-a17c6fd3-18bf-4d9c-894c-6b9e03d5976c tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:39:00 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-a17c6fd3-18bf-4d9c-894c-6b9e03d5976c tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:39:00 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-a17c6fd3-18bf-4d9c-894c-6b9e03d5976c tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:39:00 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-a17c6fd3-18bf-4d9c-894c-6b9e03d5976c tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:39:00 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-a17c6fd3-18bf-4d9c-894c-6b9e03d5976c tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:39:00 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-a17c6fd3-18bf-4d9c-894c-6b9e03d5976c tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] Going to try to terminate instance {{(pid=62054) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 16:39:00 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-a17c6fd3-18bf-4d9c-894c-6b9e03d5976c tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/235f827c-7116-48e9-84c5-0c9761c18e1e" status: 204 len: 0 microversion: 2.87 time: 0.125241 Apr 13 16:39:00 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 268/802] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 13 16:39:00 2023] DELETE /compute/v2.1/servers/235f827c-7116-48e9-84c5-0c9761c18e1e => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 13 16:39:00 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-38aa897c-c114-47f6-93f0-5adc427a18b7 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:39:00 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-38aa897c-c114-47f6-93f0-5adc427a18b7 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:39:00 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-38aa897c-c114-47f6-93f0-5adc427a18b7 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:39:00 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-38aa897c-c114-47f6-93f0-5adc427a18b7 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:39:00 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-38aa897c-c114-47f6-93f0-5adc427a18b7 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:39:00 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-38aa897c-c114-47f6-93f0-5adc427a18b7 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:39:00 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-38aa897c-c114-47f6-93f0-5adc427a18b7 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:39:00 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-38aa897c-c114-47f6-93f0-5adc427a18b7 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:39:01 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [req-76edbd6f-14cf-484a-9efa-8281c370ab75 req-09ad0cd6-8f09-4e04-b0a9-d1f32602011a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "235f827c-7116-48e9-84c5-0c9761c18e1e", "name": "network-vif-unplugged", "status": "completed", "tag": "b72a6c8b-7244-41c2-a4f7-6da43b4944b8"}]} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:39:01 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-76edbd6f-14cf-484a-9efa-8281c370ab75 req-09ad0cd6-8f09-4e04-b0a9-d1f32602011a service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:39:01 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-76edbd6f-14cf-484a-9efa-8281c370ab75 req-09ad0cd6-8f09-4e04-b0a9-d1f32602011a service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:39:01 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-76edbd6f-14cf-484a-9efa-8281c370ab75 req-09ad0cd6-8f09-4e04-b0a9-d1f32602011a service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:39:01 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-76edbd6f-14cf-484a-9efa-8281c370ab75 req-09ad0cd6-8f09-4e04-b0a9-d1f32602011a service nova] Creating event network-vif-unplugged:b72a6c8b-7244-41c2-a4f7-6da43b4944b8 for instance 235f827c-7116-48e9-84c5-0c9761c18e1e on user Apr 13 16:39:01 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [req-76edbd6f-14cf-484a-9efa-8281c370ab75 req-09ad0cd6-8f09-4e04-b0a9-d1f32602011a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039236 Apr 13 16:39:01 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 267/803] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:39:01 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:39:01 user devstack@n-api.service[62053]: DEBUG nova.policy [None req-38aa897c-c114-47f6-93f0-5adc427a18b7 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45a882dbafb4ea4976e4f45289eb2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d09a74bf684a9fb1dd1e95d6c23f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62053) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:39:01 user devstack@n-api.service[62053]: DEBUG nova.policy [None req-38aa897c-c114-47f6-93f0-5adc427a18b7 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e45a882dbafb4ea4976e4f45289eb2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d09a74bf684a9fb1dd1e95d6c23f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62053) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:39:01 user devstack@n-api.service[62053]: DEBUG nova.policy [None req-38aa897c-c114-47f6-93f0-5adc427a18b7 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e45a882dbafb4ea4976e4f45289eb2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d09a74bf684a9fb1dd1e95d6c23f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62053) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:39:01 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-38aa897c-c114-47f6-93f0-5adc427a18b7 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] 10.0.0.210 "GET /compute/v2.1/servers/235f827c-7116-48e9-84c5-0c9761c18e1e" status: 200 len: 1775 microversion: 2.87 time: 0.448653 Apr 13 16:39:01 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 269/804] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 16:39:00 2023] GET /compute/v2.1/servers/235f827c-7116-48e9-84c5-0c9761c18e1e => generated 1775 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 16:39:02 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-b3272faa-fae1-48fe-97f7-aae14982db2a req-764e0c49-eb0f-4be5-baec-bb742b5d2fef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "235f827c-7116-48e9-84c5-0c9761c18e1e", "name": "network-vif-deleted", "tag": "b72a6c8b-7244-41c2-a4f7-6da43b4944b8"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:39:02 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-b3272faa-fae1-48fe-97f7-aae14982db2a req-764e0c49-eb0f-4be5-baec-bb742b5d2fef service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:39:02 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-b3272faa-fae1-48fe-97f7-aae14982db2a req-764e0c49-eb0f-4be5-baec-bb742b5d2fef service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:39:02 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-b3272faa-fae1-48fe-97f7-aae14982db2a req-764e0c49-eb0f-4be5-baec-bb742b5d2fef service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:39:02 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-b3272faa-fae1-48fe-97f7-aae14982db2a req-764e0c49-eb0f-4be5-baec-bb742b5d2fef service nova] Creating event network-vif-deleted:b72a6c8b-7244-41c2-a4f7-6da43b4944b8 for instance 235f827c-7116-48e9-84c5-0c9761c18e1e on user Apr 13 16:39:02 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [req-b3272faa-fae1-48fe-97f7-aae14982db2a req-764e0c49-eb0f-4be5-baec-bb742b5d2fef service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033701 Apr 13 16:39:02 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 269/805] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:39:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:39:03 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [req-4a5b58e1-2339-4f8c-aa1e-0ae3dd011b85 req-e4e3958d-a80b-4980-b30e-2a722bfd63a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "235f827c-7116-48e9-84c5-0c9761c18e1e", "name": "network-vif-plugged", "status": "completed", "tag": "b72a6c8b-7244-41c2-a4f7-6da43b4944b8"}]} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:39:03 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-4a5b58e1-2339-4f8c-aa1e-0ae3dd011b85 req-e4e3958d-a80b-4980-b30e-2a722bfd63a3 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:39:03 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-4a5b58e1-2339-4f8c-aa1e-0ae3dd011b85 req-e4e3958d-a80b-4980-b30e-2a722bfd63a3 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:39:03 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-4a5b58e1-2339-4f8c-aa1e-0ae3dd011b85 req-e4e3958d-a80b-4980-b30e-2a722bfd63a3 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:39:03 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-4a5b58e1-2339-4f8c-aa1e-0ae3dd011b85 req-e4e3958d-a80b-4980-b30e-2a722bfd63a3 service nova] Creating event network-vif-plugged:b72a6c8b-7244-41c2-a4f7-6da43b4944b8 for instance 235f827c-7116-48e9-84c5-0c9761c18e1e on user Apr 13 16:39:03 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [req-4a5b58e1-2339-4f8c-aa1e-0ae3dd011b85 req-e4e3958d-a80b-4980-b30e-2a722bfd63a3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031881 Apr 13 16:39:03 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 268/806] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:39:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:39:05 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-bdf11868-d5b0-45fe-a9ca-738ed8b66149 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:39:05 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-bdf11868-d5b0-45fe-a9ca-738ed8b66149 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 220e1c3e-1378-46fc-acc1-ee1bafac7722] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:39:05 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-bdf11868-d5b0-45fe-a9ca-738ed8b66149 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:39:05 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-bdf11868-d5b0-45fe-a9ca-738ed8b66149 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:39:05 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-bdf11868-d5b0-45fe-a9ca-738ed8b66149 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:39:05 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-bdf11868-d5b0-45fe-a9ca-738ed8b66149 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:39:05 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-bdf11868-d5b0-45fe-a9ca-738ed8b66149 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:39:05 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-bdf11868-d5b0-45fe-a9ca-738ed8b66149 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:39:05 user devstack@n-api.service[62053]: INFO nova.api.openstack.wsgi [None req-bdf11868-d5b0-45fe-a9ca-738ed8b66149 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] HTTP exception thrown: Instance 220e1c3e-1378-46fc-acc1-ee1bafac7722 could not be found. Apr 13 16:39:05 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-bdf11868-d5b0-45fe-a9ca-738ed8b66149 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Request method failure captured: Apr 13 16:39:05 user devstack@n-api.service[62053]: request: GET /compute/v2.1/servers/220e1c3e-1378-46fc-acc1-ee1bafac7722 HTTP/1.1 Apr 13 16:39:05 user devstack@n-api.service[62053]: Accept: application/json Apr 13 16:39:05 user devstack@n-api.service[62053]: Accept-Encoding: identity Apr 13 16:39:05 user devstack@n-api.service[62053]: Connection: close Apr 13 16:39:05 user devstack@n-api.service[62053]: Content-Length: 0 Apr 13 16:39:05 user devstack@n-api.service[62053]: Content-Type: application/json Apr 13 16:39:05 user devstack@n-api.service[62053]: Host: 10.0.0.210 Apr 13 16:39:05 user devstack@n-api.service[62053]: Openstack-System-Scope: None Apr 13 16:39:05 user devstack@n-api.service[62053]: User-Agent: python-urllib3/1.26.15 Apr 13 16:39:05 user devstack@n-api.service[62053]: X-Auth-Token: gAAAAABkOCwkI2hCVv3q2RMbn5sWNaNksO2jlEae5ib0A_n2-4Ip_Pl-WyakKOiBGyr1g-8idBZHWfWrP88wr7DW2Z-7RXK4r2oTVrS71NZCSisAoUDBhj4KwKB40I0svywhzMPIjrB1h0EwajlcYKhM2GYo5FTaZ-MnJbSWEwEZAY8gyi1eSaE Apr 13 16:39:05 user devstack@n-api.service[62053]: X-Domain-Id: None Apr 13 16:39:05 user devstack@n-api.service[62053]: X-Domain-Name: None Apr 13 16:39:05 user devstack@n-api.service[62053]: X-Identity-Status: Confirmed Apr 13 16:39:05 user devstack@n-api.service[62053]: X-Is-Admin-Project: True Apr 13 16:39:05 user devstack@n-api.service[62053]: X-Project-Domain-Id: default Apr 13 16:39:05 user devstack@n-api.service[62053]: X-Project-Domain-Name: Default Apr 13 16:39:05 user devstack@n-api.service[62053]: X-Project-Id: 8d451e0e239f486aa2b3abe9e273eab3 Apr 13 16:39:05 user devstack@n-api.service[62053]: X-Project-Name: tempest-TestVolumeBootPattern-438786227 Apr 13 16:39:05 user devstack@n-api.service[62053]: X-Role: reader,member Apr 13 16:39:05 user devstack@n-api.service[62053]: X-Roles: reader,member Apr 13 16:39:05 user devstack@n-api.service[62053]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8d451e0e239f486aa2b3abe9e273eab3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8d451e0e239f486aa2b3abe9e273eab3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8d451e0e239f486aa2b3abe9e273eab3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 13 16:39:05 user devstack@n-api.service[62053]: X-Tenant: tempest-TestVolumeBootPattern-438786227 Apr 13 16:39:05 user devstack@n-api.service[62053]: X-Tenant-Id: 8d451e0e239f486aa2b3abe9e273eab3 Apr 13 16:39:05 user devstack@n-api.service[62053]: X-Tenant-Name: tempest-TestVolumeBootPattern-438786227 Apr 13 16:39:05 user devstack@n-api.service[62053]: X-User: tempest-TestVolumeBootPattern-438786227-project-member Apr 13 16:39:05 user devstack@n-api.service[62053]: X-User-Domain-Id: default Apr 13 16:39:05 user devstack@n-api.service[62053]: X-User-Domain-Name: Default Apr 13 16:39:05 user devstack@n-api.service[62053]: X-User-Id: d70e10f63cdd49a9a1ebe1fe4c9de0a2 Apr 13 16:39:05 user devstack@n-api.service[62053]: X-User-Name: tempest-TestVolumeBootPattern-438786227-project-member Apr 13 16:39:05 user devstack@n-api.service[62053]: method: > Apr 13 16:39:05 user devstack@n-api.service[62053]: exception: Instance 220e1c3e-1378-46fc-acc1-ee1bafac7722 could not be found. Apr 13 16:39:05 user devstack@n-api.service[62053]: action_args: {'id': '220e1c3e-1378-46fc-acc1-ee1bafac7722'} Apr 13 16:39:05 user devstack@n-api.service[62053]: {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 16:39:05 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:39:05 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 16:39:05 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 16:39:05 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 16:39:05 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 16:39:05 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 16:39:05 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 16:39:05 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 16:39:05 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 16:39:05 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 220e1c3e-1378-46fc-acc1-ee1bafac7722 could not be found. Apr 13 16:39:05 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:39:05 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:39:05 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:39:05 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:39:05 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 16:39:05 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 16:39:05 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 16:39:05 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 16:39:05 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 16:39:05 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 16:39:05 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 16:39:05 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 16:39:05 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 16:39:05 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 16:39:05 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 16:39:05 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 16:39:05 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 220e1c3e-1378-46fc-acc1-ee1bafac7722 could not be found. Apr 13 16:39:05 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:39:05 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:39:05 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:39:05 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:39:05 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 16:39:05 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 16:39:05 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 16:39:05 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 16:39:05 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 220e1c3e-1378-46fc-acc1-ee1bafac7722 could not be found. Apr 13 16:39:05 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:39:05 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-bdf11868-d5b0-45fe-a9ca-738ed8b66149 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Returning 404 to user: Instance 220e1c3e-1378-46fc-acc1-ee1bafac7722 could not be found. {{(pid=62053) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 16:39:05 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-bdf11868-d5b0-45fe-a9ca-738ed8b66149 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] 10.0.0.210 "GET /compute/v2.1/servers/220e1c3e-1378-46fc-acc1-ee1bafac7722" status: 404 len: 111 microversion: 2.1 time: 0.030481 Apr 13 16:39:05 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 270/807] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:39:05 2023] GET /compute/v2.1/servers/220e1c3e-1378-46fc-acc1-ee1bafac7722 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 16:39:05 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-b3d8e8d6-17ea-4c79-86be-2ca58ccef26b tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:39:05 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-b3d8e8d6-17ea-4c79-86be-2ca58ccef26b tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 03200054-c651-4333-acce-3bea3defe22a] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:39:05 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-b3d8e8d6-17ea-4c79-86be-2ca58ccef26b tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:39:05 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-b3d8e8d6-17ea-4c79-86be-2ca58ccef26b tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:39:05 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-b3d8e8d6-17ea-4c79-86be-2ca58ccef26b tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:39:05 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-b3d8e8d6-17ea-4c79-86be-2ca58ccef26b tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:39:05 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-b3d8e8d6-17ea-4c79-86be-2ca58ccef26b tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:39:05 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-b3d8e8d6-17ea-4c79-86be-2ca58ccef26b tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:39:05 user devstack@n-api.service[62054]: INFO nova.api.openstack.wsgi [None req-b3d8e8d6-17ea-4c79-86be-2ca58ccef26b tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] HTTP exception thrown: Instance 03200054-c651-4333-acce-3bea3defe22a could not be found. Apr 13 16:39:05 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-b3d8e8d6-17ea-4c79-86be-2ca58ccef26b tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Request method failure captured: Apr 13 16:39:05 user devstack@n-api.service[62054]: request: DELETE /compute/v2.1/servers/03200054-c651-4333-acce-3bea3defe22a HTTP/1.1 Apr 13 16:39:05 user devstack@n-api.service[62054]: Accept: application/json Apr 13 16:39:05 user devstack@n-api.service[62054]: Accept-Encoding: identity Apr 13 16:39:05 user devstack@n-api.service[62054]: Connection: close Apr 13 16:39:05 user devstack@n-api.service[62054]: Content-Length: 0 Apr 13 16:39:05 user devstack@n-api.service[62054]: Content-Type: application/json Apr 13 16:39:05 user devstack@n-api.service[62054]: Host: 10.0.0.210 Apr 13 16:39:05 user devstack@n-api.service[62054]: Openstack-System-Scope: None Apr 13 16:39:05 user devstack@n-api.service[62054]: User-Agent: python-urllib3/1.26.15 Apr 13 16:39:05 user devstack@n-api.service[62054]: X-Auth-Token: gAAAAABkOCwkI2hCVv3q2RMbn5sWNaNksO2jlEae5ib0A_n2-4Ip_Pl-WyakKOiBGyr1g-8idBZHWfWrP88wr7DW2Z-7RXK4r2oTVrS71NZCSisAoUDBhj4KwKB40I0svywhzMPIjrB1h0EwajlcYKhM2GYo5FTaZ-MnJbSWEwEZAY8gyi1eSaE Apr 13 16:39:05 user devstack@n-api.service[62054]: X-Domain-Id: None Apr 13 16:39:05 user devstack@n-api.service[62054]: X-Domain-Name: None Apr 13 16:39:05 user devstack@n-api.service[62054]: X-Identity-Status: Confirmed Apr 13 16:39:05 user devstack@n-api.service[62054]: X-Is-Admin-Project: True Apr 13 16:39:05 user devstack@n-api.service[62054]: X-Project-Domain-Id: default Apr 13 16:39:05 user devstack@n-api.service[62054]: X-Project-Domain-Name: Default Apr 13 16:39:05 user devstack@n-api.service[62054]: X-Project-Id: 8d451e0e239f486aa2b3abe9e273eab3 Apr 13 16:39:05 user devstack@n-api.service[62054]: X-Project-Name: tempest-TestVolumeBootPattern-438786227 Apr 13 16:39:05 user devstack@n-api.service[62054]: X-Role: reader,member Apr 13 16:39:05 user devstack@n-api.service[62054]: X-Roles: reader,member Apr 13 16:39:05 user devstack@n-api.service[62054]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8d451e0e239f486aa2b3abe9e273eab3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8d451e0e239f486aa2b3abe9e273eab3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8d451e0e239f486aa2b3abe9e273eab3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 13 16:39:05 user devstack@n-api.service[62054]: X-Tenant: tempest-TestVolumeBootPattern-438786227 Apr 13 16:39:05 user devstack@n-api.service[62054]: X-Tenant-Id: 8d451e0e239f486aa2b3abe9e273eab3 Apr 13 16:39:05 user devstack@n-api.service[62054]: X-Tenant-Name: tempest-TestVolumeBootPattern-438786227 Apr 13 16:39:05 user devstack@n-api.service[62054]: X-User: tempest-TestVolumeBootPattern-438786227-project-member Apr 13 16:39:05 user devstack@n-api.service[62054]: X-User-Domain-Id: default Apr 13 16:39:05 user devstack@n-api.service[62054]: X-User-Domain-Name: Default Apr 13 16:39:05 user devstack@n-api.service[62054]: X-User-Id: d70e10f63cdd49a9a1ebe1fe4c9de0a2 Apr 13 16:39:05 user devstack@n-api.service[62054]: X-User-Name: tempest-TestVolumeBootPattern-438786227-project-member Apr 13 16:39:05 user devstack@n-api.service[62054]: method: > Apr 13 16:39:05 user devstack@n-api.service[62054]: exception: Instance 03200054-c651-4333-acce-3bea3defe22a could not be found. Apr 13 16:39:05 user devstack@n-api.service[62054]: action_args: {'id': '03200054-c651-4333-acce-3bea3defe22a'} Apr 13 16:39:05 user devstack@n-api.service[62054]: {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 16:39:05 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:39:05 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 16:39:05 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 16:39:05 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 16:39:05 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 16:39:05 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 16:39:05 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 16:39:05 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 16:39:05 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 16:39:05 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03200054-c651-4333-acce-3bea3defe22a could not be found. Apr 13 16:39:05 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:39:05 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:39:05 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:39:05 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:39:05 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 16:39:05 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 16:39:05 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 16:39:05 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 16:39:05 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 16:39:05 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 16:39:05 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 16:39:05 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 16:39:05 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 16:39:05 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 16:39:05 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 16:39:05 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 16:39:05 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 16:39:05 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 16:39:05 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03200054-c651-4333-acce-3bea3defe22a could not be found. Apr 13 16:39:05 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:39:05 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:39:05 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:39:05 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:39:05 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 16:39:05 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 16:39:05 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 16:39:05 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 16:39:05 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03200054-c651-4333-acce-3bea3defe22a could not be found. Apr 13 16:39:05 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:39:05 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-b3d8e8d6-17ea-4c79-86be-2ca58ccef26b tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Returning 404 to user: Instance 03200054-c651-4333-acce-3bea3defe22a could not be found. {{(pid=62054) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 16:39:05 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-b3d8e8d6-17ea-4c79-86be-2ca58ccef26b tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/03200054-c651-4333-acce-3bea3defe22a" status: 404 len: 111 microversion: 2.1 time: 0.036428 Apr 13 16:39:05 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 270/808] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 16:39:05 2023] DELETE /compute/v2.1/servers/03200054-c651-4333-acce-3bea3defe22a => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 16:39:05 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-3c6d7114-e6ee-4bb4-9a73-0ceccefb73bf tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:39:05 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-3c6d7114-e6ee-4bb4-9a73-0ceccefb73bf tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 03200054-c651-4333-acce-3bea3defe22a] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:39:05 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-3c6d7114-e6ee-4bb4-9a73-0ceccefb73bf tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:39:05 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-3c6d7114-e6ee-4bb4-9a73-0ceccefb73bf tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:39:05 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-3c6d7114-e6ee-4bb4-9a73-0ceccefb73bf tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:39:05 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-3c6d7114-e6ee-4bb4-9a73-0ceccefb73bf tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:39:05 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-3c6d7114-e6ee-4bb4-9a73-0ceccefb73bf tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:39:05 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-3c6d7114-e6ee-4bb4-9a73-0ceccefb73bf tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:39:05 user devstack@n-api.service[62055]: INFO nova.api.openstack.wsgi [None req-3c6d7114-e6ee-4bb4-9a73-0ceccefb73bf tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] HTTP exception thrown: Instance 03200054-c651-4333-acce-3bea3defe22a could not be found. Apr 13 16:39:05 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-3c6d7114-e6ee-4bb4-9a73-0ceccefb73bf tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Request method failure captured: Apr 13 16:39:05 user devstack@n-api.service[62055]: request: GET /compute/v2.1/servers/03200054-c651-4333-acce-3bea3defe22a HTTP/1.1 Apr 13 16:39:05 user devstack@n-api.service[62055]: Accept: application/json Apr 13 16:39:05 user devstack@n-api.service[62055]: Accept-Encoding: identity Apr 13 16:39:05 user devstack@n-api.service[62055]: Connection: close Apr 13 16:39:05 user devstack@n-api.service[62055]: Content-Length: 0 Apr 13 16:39:05 user devstack@n-api.service[62055]: Content-Type: application/json Apr 13 16:39:05 user devstack@n-api.service[62055]: Host: 10.0.0.210 Apr 13 16:39:05 user devstack@n-api.service[62055]: Openstack-System-Scope: None Apr 13 16:39:05 user devstack@n-api.service[62055]: User-Agent: python-urllib3/1.26.15 Apr 13 16:39:05 user devstack@n-api.service[62055]: X-Auth-Token: gAAAAABkOCwkI2hCVv3q2RMbn5sWNaNksO2jlEae5ib0A_n2-4Ip_Pl-WyakKOiBGyr1g-8idBZHWfWrP88wr7DW2Z-7RXK4r2oTVrS71NZCSisAoUDBhj4KwKB40I0svywhzMPIjrB1h0EwajlcYKhM2GYo5FTaZ-MnJbSWEwEZAY8gyi1eSaE Apr 13 16:39:05 user devstack@n-api.service[62055]: X-Domain-Id: None Apr 13 16:39:05 user devstack@n-api.service[62055]: X-Domain-Name: None Apr 13 16:39:05 user devstack@n-api.service[62055]: X-Identity-Status: Confirmed Apr 13 16:39:05 user devstack@n-api.service[62055]: X-Is-Admin-Project: True Apr 13 16:39:05 user devstack@n-api.service[62055]: X-Project-Domain-Id: default Apr 13 16:39:05 user devstack@n-api.service[62055]: X-Project-Domain-Name: Default Apr 13 16:39:05 user devstack@n-api.service[62055]: X-Project-Id: 8d451e0e239f486aa2b3abe9e273eab3 Apr 13 16:39:05 user devstack@n-api.service[62055]: X-Project-Name: tempest-TestVolumeBootPattern-438786227 Apr 13 16:39:05 user devstack@n-api.service[62055]: X-Role: reader,member Apr 13 16:39:05 user devstack@n-api.service[62055]: X-Roles: reader,member Apr 13 16:39:05 user devstack@n-api.service[62055]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8d451e0e239f486aa2b3abe9e273eab3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8d451e0e239f486aa2b3abe9e273eab3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8d451e0e239f486aa2b3abe9e273eab3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 13 16:39:05 user devstack@n-api.service[62055]: X-Tenant: tempest-TestVolumeBootPattern-438786227 Apr 13 16:39:05 user devstack@n-api.service[62055]: X-Tenant-Id: 8d451e0e239f486aa2b3abe9e273eab3 Apr 13 16:39:05 user devstack@n-api.service[62055]: X-Tenant-Name: tempest-TestVolumeBootPattern-438786227 Apr 13 16:39:05 user devstack@n-api.service[62055]: X-User: tempest-TestVolumeBootPattern-438786227-project-member Apr 13 16:39:05 user devstack@n-api.service[62055]: X-User-Domain-Id: default Apr 13 16:39:05 user devstack@n-api.service[62055]: X-User-Domain-Name: Default Apr 13 16:39:05 user devstack@n-api.service[62055]: X-User-Id: d70e10f63cdd49a9a1ebe1fe4c9de0a2 Apr 13 16:39:05 user devstack@n-api.service[62055]: X-User-Name: tempest-TestVolumeBootPattern-438786227-project-member Apr 13 16:39:05 user devstack@n-api.service[62055]: method: > Apr 13 16:39:05 user devstack@n-api.service[62055]: exception: Instance 03200054-c651-4333-acce-3bea3defe22a could not be found. Apr 13 16:39:05 user devstack@n-api.service[62055]: action_args: {'id': '03200054-c651-4333-acce-3bea3defe22a'} Apr 13 16:39:05 user devstack@n-api.service[62055]: {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 16:39:05 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:39:05 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 16:39:05 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 16:39:05 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 16:39:05 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 16:39:05 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 16:39:05 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 16:39:05 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 16:39:05 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 16:39:05 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03200054-c651-4333-acce-3bea3defe22a could not be found. Apr 13 16:39:05 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:39:05 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:39:05 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:39:05 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:39:05 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 16:39:05 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 16:39:05 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 16:39:05 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 16:39:05 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 16:39:05 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 16:39:05 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 16:39:05 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 16:39:05 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 16:39:05 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 16:39:05 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 16:39:05 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 16:39:05 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03200054-c651-4333-acce-3bea3defe22a could not be found. Apr 13 16:39:05 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:39:05 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:39:05 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:39:05 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:39:05 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 16:39:05 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 16:39:05 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 16:39:05 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 16:39:05 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03200054-c651-4333-acce-3bea3defe22a could not be found. Apr 13 16:39:05 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:39:05 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-3c6d7114-e6ee-4bb4-9a73-0ceccefb73bf tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Returning 404 to user: Instance 03200054-c651-4333-acce-3bea3defe22a could not be found. {{(pid=62055) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 16:39:05 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-3c6d7114-e6ee-4bb4-9a73-0ceccefb73bf tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] 10.0.0.210 "GET /compute/v2.1/servers/03200054-c651-4333-acce-3bea3defe22a" status: 404 len: 111 microversion: 2.1 time: 0.034600 Apr 13 16:39:05 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 269/809] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:39:05 2023] GET /compute/v2.1/servers/03200054-c651-4333-acce-3bea3defe22a => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 16:39:08 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-7484d3f9-6a62-4ebb-accc-2b0f4151eaf8 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Calling method '.version_select at 0x7f96e48b4af0>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:39:08 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-7484d3f9-6a62-4ebb-accc-2b0f4151eaf8 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1747083001" status: 202 len: 0 microversion: 2.1 time: 0.023700 Apr 13 16:39:08 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 271/810] 10.0.0.210 () {62 vars in 1340 bytes} [Thu Apr 13 16:39:08 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1747083001 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 16:39:14 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-3545fa1e-bb55-4cb9-b838-19a71808ba5f tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:39:14 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-3545fa1e-bb55-4cb9-b838-19a71808ba5f tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:39:14 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-3545fa1e-bb55-4cb9-b838-19a71808ba5f tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:39:14 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-3545fa1e-bb55-4cb9-b838-19a71808ba5f tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:39:14 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-3545fa1e-bb55-4cb9-b838-19a71808ba5f tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:39:14 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-3545fa1e-bb55-4cb9-b838-19a71808ba5f tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:39:14 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-3545fa1e-bb55-4cb9-b838-19a71808ba5f tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:39:14 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-3545fa1e-bb55-4cb9-b838-19a71808ba5f tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:39:14 user devstack@n-api.service[62054]: INFO nova.api.openstack.wsgi [None req-3545fa1e-bb55-4cb9-b838-19a71808ba5f tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] HTTP exception thrown: Instance 35b23303-e373-4f35-b7ee-76e6815073ce could not be found. Apr 13 16:39:14 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-3545fa1e-bb55-4cb9-b838-19a71808ba5f tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Request method failure captured: Apr 13 16:39:14 user devstack@n-api.service[62054]: request: GET /compute/v2.1/servers/35b23303-e373-4f35-b7ee-76e6815073ce HTTP/1.1 Apr 13 16:39:14 user devstack@n-api.service[62054]: Accept: application/json Apr 13 16:39:14 user devstack@n-api.service[62054]: Accept-Encoding: identity Apr 13 16:39:14 user devstack@n-api.service[62054]: Connection: close Apr 13 16:39:14 user devstack@n-api.service[62054]: Content-Length: 0 Apr 13 16:39:14 user devstack@n-api.service[62054]: Content-Type: application/json Apr 13 16:39:14 user devstack@n-api.service[62054]: Host: 10.0.0.210 Apr 13 16:39:14 user devstack@n-api.service[62054]: Openstack-System-Scope: None Apr 13 16:39:14 user devstack@n-api.service[62054]: User-Agent: python-urllib3/1.26.15 Apr 13 16:39:14 user devstack@n-api.service[62054]: X-Auth-Token: gAAAAABkOC53SZVmZKVketXQGuAVMMknMJdjznVoSSXYAbi3nZlDismOo6vWp1c3OJZOcAv9afVjCXo02Tx5ciDsWKJuJjC1cDN2EFLBuhORZXJ1uO1rD0SviIsoKAVCcdR2S2_fQZO6PmY5eU-ufy22hb3YYguF4rd7O3sgiUpAQcm9s01OX4U Apr 13 16:39:14 user devstack@n-api.service[62054]: X-Domain-Id: None Apr 13 16:39:14 user devstack@n-api.service[62054]: X-Domain-Name: None Apr 13 16:39:14 user devstack@n-api.service[62054]: X-Identity-Status: Confirmed Apr 13 16:39:14 user devstack@n-api.service[62054]: X-Is-Admin-Project: True Apr 13 16:39:14 user devstack@n-api.service[62054]: X-Openstack-Nova-Api-Version: 2.20 Apr 13 16:39:14 user devstack@n-api.service[62054]: X-Project-Domain-Id: default Apr 13 16:39:14 user devstack@n-api.service[62054]: X-Project-Domain-Name: Default Apr 13 16:39:14 user devstack@n-api.service[62054]: X-Project-Id: 0653ab16660b46cea9c5af58ea0b1931 Apr 13 16:39:14 user devstack@n-api.service[62054]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1310775310 Apr 13 16:39:14 user devstack@n-api.service[62054]: X-Role: reader,member Apr 13 16:39:14 user devstack@n-api.service[62054]: X-Roles: reader,member Apr 13 16:39:14 user devstack@n-api.service[62054]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0653ab16660b46cea9c5af58ea0b1931"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0653ab16660b46cea9c5af58ea0b1931"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0653ab16660b46cea9c5af58ea0b1931"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 13 16:39:14 user devstack@n-api.service[62054]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1310775310 Apr 13 16:39:14 user devstack@n-api.service[62054]: X-Tenant-Id: 0653ab16660b46cea9c5af58ea0b1931 Apr 13 16:39:14 user devstack@n-api.service[62054]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1310775310 Apr 13 16:39:14 user devstack@n-api.service[62054]: X-User: tempest-AttachVolumeShelveTestJSON-1310775310-project-member Apr 13 16:39:14 user devstack@n-api.service[62054]: X-User-Domain-Id: default Apr 13 16:39:14 user devstack@n-api.service[62054]: X-User-Domain-Name: Default Apr 13 16:39:14 user devstack@n-api.service[62054]: X-User-Id: 48b4e972cd1049509fa899449961ab59 Apr 13 16:39:14 user devstack@n-api.service[62054]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1310775310-project-member Apr 13 16:39:14 user devstack@n-api.service[62054]: method: > Apr 13 16:39:14 user devstack@n-api.service[62054]: exception: Instance 35b23303-e373-4f35-b7ee-76e6815073ce could not be found. Apr 13 16:39:14 user devstack@n-api.service[62054]: action_args: {'id': '35b23303-e373-4f35-b7ee-76e6815073ce'} Apr 13 16:39:14 user devstack@n-api.service[62054]: {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 16:39:14 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:39:14 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 16:39:14 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 16:39:14 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 16:39:14 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 16:39:14 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 16:39:14 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 16:39:14 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 16:39:14 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 16:39:14 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35b23303-e373-4f35-b7ee-76e6815073ce could not be found. Apr 13 16:39:14 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:39:14 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:39:14 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:39:14 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:39:14 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 16:39:14 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 16:39:14 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 16:39:14 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 16:39:14 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 16:39:14 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 16:39:14 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 16:39:14 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 16:39:14 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 16:39:14 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 16:39:14 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 16:39:14 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 16:39:14 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35b23303-e373-4f35-b7ee-76e6815073ce could not be found. Apr 13 16:39:14 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:39:14 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:39:14 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:39:14 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:39:14 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 16:39:14 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 16:39:14 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 16:39:14 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 16:39:14 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35b23303-e373-4f35-b7ee-76e6815073ce could not be found. Apr 13 16:39:14 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:39:14 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-3545fa1e-bb55-4cb9-b838-19a71808ba5f tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Returning 404 to user: Instance 35b23303-e373-4f35-b7ee-76e6815073ce could not be found. {{(pid=62054) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 16:39:14 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-3545fa1e-bb55-4cb9-b838-19a71808ba5f tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] 10.0.0.210 "GET /compute/v2.1/servers/35b23303-e373-4f35-b7ee-76e6815073ce" status: 404 len: 111 microversion: 2.20 time: 0.031149 Apr 13 16:39:14 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 271/811] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 16:39:14 2023] GET /compute/v2.1/servers/35b23303-e373-4f35-b7ee-76e6815073ce => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 13 16:39:14 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-8538dae2-363c-4304-8d7f-779a9d46b48b tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Calling method '.version_select at 0x7f96dc729d80>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:39:14 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-8538dae2-363c-4304-8d7f-779a9d46b48b tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-179744772" status: 204 len: 0 microversion: 2.20 time: 0.026706 Apr 13 16:39:14 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 270/812] 10.0.0.210 () {64 vars in 1336 bytes} [Thu Apr 13 16:39:14 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-179744772 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 13 16:39:15 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_cell1:SELECT=14 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:39:15 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-8ec2c77c-6a71-41af-ad5b-0b5aa44a1141 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Action: 'create', calling method: .version_select at 0x7f96e48b5360>, body: {"keypair": {"name": "tempest-keypair-707123723", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEMeM+1/KnPrfHwYC3u+Lcza7snpR0t1GJvUaC1TzWStqRV08H+ksCdHvKc+nMr3bT0XCZGDg/vhmXMFwe7jGl2nfjwDh9ruSgNXBv0ppZMEtKuFitRCX7rOQL8v9bZcKA=="}} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:39:15 user devstack@n-api.service[62053]: DEBUG nova.quota [None req-8ec2c77c-6a71-41af-ad5b-0b5aa44a1141 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Getting quotas for project 0653ab16660b46cea9c5af58ea0b1931. Resources: {'key_pairs'} {{(pid=62053) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 16:39:15 user devstack@n-api.service[62053]: DEBUG nova.quota [None req-8ec2c77c-6a71-41af-ad5b-0b5aa44a1141 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Getting quotas for user 48b4e972cd1049509fa899449961ab59 and project 0653ab16660b46cea9c5af58ea0b1931. Resources: {'key_pairs'} {{(pid=62053) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 16:39:15 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-8ec2c77c-6a71-41af-ad5b-0b5aa44a1141 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.055276 Apr 13 16:39:15 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 272/813] 10.0.0.210 () {66 vars in 1277 bytes} [Thu Apr 13 16:39:15 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 57 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 13 16:39:16 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-9d4a75ff-7dc2-4ac0-9cdf-6a24e5eea006 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-152363829", "imageRef": "708622a9-7465-4492-ade8-b827198f7e30", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "5acc9a78-1127-46df-bb60-7544cdd2c1ef"}], "security_groups": [{"name": "tempest-securitygroup--1454678831"}], "key_name": "tempest-keypair-707123723", "user_data": "}} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:39:17 user devstack@n-api.service[62054]: DEBUG nova.network.neutron [None req-9d4a75ff-7dc2-4ac0-9cdf-6a24e5eea006 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] validate_networks() for [('5acc9a78-1127-46df-bb60-7544cdd2c1ef', None, None, None, None, None)] {{(pid=62054) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 16:39:17 user devstack@n-api.service[62054]: DEBUG nova.virt.hardware [None req-9d4a75ff-7dc2-4ac0-9cdf-6a24e5eea006 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Flavor limits 0:0:0 {{(pid=62054) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 16:39:17 user devstack@n-api.service[62054]: DEBUG nova.virt.hardware [None req-9d4a75ff-7dc2-4ac0-9cdf-6a24e5eea006 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Image limits 0:0:0 {{(pid=62054) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 16:39:17 user devstack@n-api.service[62054]: DEBUG nova.virt.hardware [None req-9d4a75ff-7dc2-4ac0-9cdf-6a24e5eea006 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Flavor pref 0:0:0 {{(pid=62054) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 16:39:17 user devstack@n-api.service[62054]: DEBUG nova.virt.hardware [None req-9d4a75ff-7dc2-4ac0-9cdf-6a24e5eea006 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Image pref 0:0:0 {{(pid=62054) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 16:39:17 user devstack@n-api.service[62054]: DEBUG nova.virt.hardware [None req-9d4a75ff-7dc2-4ac0-9cdf-6a24e5eea006 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62054) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 16:39:17 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-9d4a75ff-7dc2-4ac0-9cdf-6a24e5eea006 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:39:17 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-9d4a75ff-7dc2-4ac0-9cdf-6a24e5eea006 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:39:17 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-9d4a75ff-7dc2-4ac0-9cdf-6a24e5eea006 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:39:17 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-9d4a75ff-7dc2-4ac0-9cdf-6a24e5eea006 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:39:17 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-9d4a75ff-7dc2-4ac0-9cdf-6a24e5eea006 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:39:17 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-9d4a75ff-7dc2-4ac0-9cdf-6a24e5eea006 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:39:17 user devstack@n-api.service[62054]: DEBUG nova.quota [None req-9d4a75ff-7dc2-4ac0-9cdf-6a24e5eea006 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Getting quotas for project 0653ab16660b46cea9c5af58ea0b1931. Resources: {'instances', 'cores', 'ram'} {{(pid=62054) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 16:39:17 user devstack@n-api.service[62054]: DEBUG nova.quota [None req-9d4a75ff-7dc2-4ac0-9cdf-6a24e5eea006 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Getting quotas for user 48b4e972cd1049509fa899449961ab59 and project 0653ab16660b46cea9c5af58ea0b1931. Resources: {'instances', 'cores', 'ram'} {{(pid=62054) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 16:39:17 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-9d4a75ff-7dc2-4ac0-9cdf-6a24e5eea006 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Going to run 1 instances... {{(pid=62054) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 16:39:17 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-9d4a75ff-7dc2-4ac0-9cdf-6a24e5eea006 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='708622a9-7465-4492-ade8-b827198f7e30',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=62054) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 16:39:17 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-9d4a75ff-7dc2-4ac0-9cdf-6a24e5eea006 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 0.750760 Apr 13 16:39:17 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 272/814] 10.0.0.210 () {66 vars in 1265 bytes} [Thu Apr 13 16:39:16 2023] POST /compute/v2.1/servers => generated 400 bytes in 753 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 13 16:39:17 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_cell1:SELECT=8 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:39:17 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-7de5473f-1aec-41c8-bc5c-ad98a2f2a053 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:39:17 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-7de5473f-1aec-41c8-bc5c-ad98a2f2a053 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:39:17 user devstack@n-api.service[62055]: DEBUG nova.policy [None req-7de5473f-1aec-41c8-bc5c-ad98a2f2a053 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b4e972cd1049509fa899449961ab59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0653ab16660b46cea9c5af58ea0b1931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62055) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:39:17 user devstack@n-api.service[62055]: DEBUG nova.policy [None req-7de5473f-1aec-41c8-bc5c-ad98a2f2a053 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48b4e972cd1049509fa899449961ab59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0653ab16660b46cea9c5af58ea0b1931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62055) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:39:17 user devstack@n-api.service[62055]: DEBUG nova.policy [None req-7de5473f-1aec-41c8-bc5c-ad98a2f2a053 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48b4e972cd1049509fa899449961ab59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0653ab16660b46cea9c5af58ea0b1931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62055) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:39:17 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-7de5473f-1aec-41c8-bc5c-ad98a2f2a053 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1f6a693f-0a99-434f-871d-f535b71229b9" status: 200 len: 1274 microversion: 2.20 time: 0.082620 Apr 13 16:39:17 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 271/815] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 16:39:17 2023] GET /compute/v2.1/servers/1f6a693f-0a99-434f-871d-f535b71229b9 => generated 1274 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 16:39:20 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-47e0b637-f3cc-4e46-8528-4cc8c069cc10 req-14e5d3f8-fb4d-454a-9073-6e142b811ae5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f6a693f-0a99-434f-871d-f535b71229b9", "tag": "103a0c68-ffc7-4460-836e-0de6c0272d84"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:39:20 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-47e0b637-f3cc-4e46-8528-4cc8c069cc10 req-14e5d3f8-fb4d-454a-9073-6e142b811ae5 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:39:20 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-47e0b637-f3cc-4e46-8528-4cc8c069cc10 req-14e5d3f8-fb4d-454a-9073-6e142b811ae5 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:39:20 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-47e0b637-f3cc-4e46-8528-4cc8c069cc10 req-14e5d3f8-fb4d-454a-9073-6e142b811ae5 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:39:20 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-47e0b637-f3cc-4e46-8528-4cc8c069cc10 req-14e5d3f8-fb4d-454a-9073-6e142b811ae5 service nova] Creating event network-changed:103a0c68-ffc7-4460-836e-0de6c0272d84 for instance 1f6a693f-0a99-434f-871d-f535b71229b9 on user Apr 13 16:39:20 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [req-47e0b637-f3cc-4e46-8528-4cc8c069cc10 req-14e5d3f8-fb4d-454a-9073-6e142b811ae5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030881 Apr 13 16:39:20 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 273/816] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:39:20 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:39:23 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-77f907ab-2ff7-4103-ac1f-ce81eda6cc53 req-769706ea-6420-4c8f-9670-7da1aa1b9885 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f6a693f-0a99-434f-871d-f535b71229b9", "name": "network-vif-plugged", "status": "completed", "tag": "103a0c68-ffc7-4460-836e-0de6c0272d84"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:39:23 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-77f907ab-2ff7-4103-ac1f-ce81eda6cc53 req-769706ea-6420-4c8f-9670-7da1aa1b9885 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:39:23 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-77f907ab-2ff7-4103-ac1f-ce81eda6cc53 req-769706ea-6420-4c8f-9670-7da1aa1b9885 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:39:23 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-77f907ab-2ff7-4103-ac1f-ce81eda6cc53 req-769706ea-6420-4c8f-9670-7da1aa1b9885 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:39:23 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-77f907ab-2ff7-4103-ac1f-ce81eda6cc53 req-769706ea-6420-4c8f-9670-7da1aa1b9885 service nova] Creating event network-vif-plugged:103a0c68-ffc7-4460-836e-0de6c0272d84 for instance 1f6a693f-0a99-434f-871d-f535b71229b9 on user Apr 13 16:39:23 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [req-77f907ab-2ff7-4103-ac1f-ce81eda6cc53 req-769706ea-6420-4c8f-9670-7da1aa1b9885 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037855 Apr 13 16:39:23 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 273/817] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:39:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:39:25 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [req-63b6c2f3-14d2-4fb3-a9b8-7f288e81a3ed req-2ca5b6e1-1f5f-4fc0-94a5-8274b311197a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f6a693f-0a99-434f-871d-f535b71229b9", "name": "network-vif-plugged", "status": "completed", "tag": "103a0c68-ffc7-4460-836e-0de6c0272d84"}]} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:39:25 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-63b6c2f3-14d2-4fb3-a9b8-7f288e81a3ed req-2ca5b6e1-1f5f-4fc0-94a5-8274b311197a service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:39:25 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-63b6c2f3-14d2-4fb3-a9b8-7f288e81a3ed req-2ca5b6e1-1f5f-4fc0-94a5-8274b311197a service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:39:25 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-63b6c2f3-14d2-4fb3-a9b8-7f288e81a3ed req-2ca5b6e1-1f5f-4fc0-94a5-8274b311197a service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:39:25 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-63b6c2f3-14d2-4fb3-a9b8-7f288e81a3ed req-2ca5b6e1-1f5f-4fc0-94a5-8274b311197a service nova] Creating event network-vif-plugged:103a0c68-ffc7-4460-836e-0de6c0272d84 for instance 1f6a693f-0a99-434f-871d-f535b71229b9 on user Apr 13 16:39:25 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [req-63b6c2f3-14d2-4fb3-a9b8-7f288e81a3ed req-2ca5b6e1-1f5f-4fc0-94a5-8274b311197a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044765 Apr 13 16:39:25 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 272/818] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:39:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:39:51 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_cell0:SELECT=4 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:39:51 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_api:SELECT=24,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:39:51 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_cell1:SELECT=2 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:39:51 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-17eb89fd-bd35-487b-bc0e-9c8995bd1d2d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:39:51 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-17eb89fd-bd35-487b-bc0e-9c8995bd1d2d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:39:51 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-17eb89fd-bd35-487b-bc0e-9c8995bd1d2d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:39:51 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-17eb89fd-bd35-487b-bc0e-9c8995bd1d2d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:39:51 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-17eb89fd-bd35-487b-bc0e-9c8995bd1d2d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:39:51 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-17eb89fd-bd35-487b-bc0e-9c8995bd1d2d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:39:51 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-17eb89fd-bd35-487b-bc0e-9c8995bd1d2d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:39:51 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-17eb89fd-bd35-487b-bc0e-9c8995bd1d2d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:39:51 user devstack@n-api.service[62053]: INFO nova.api.openstack.wsgi [None req-17eb89fd-bd35-487b-bc0e-9c8995bd1d2d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] HTTP exception thrown: Instance 235f827c-7116-48e9-84c5-0c9761c18e1e could not be found. Apr 13 16:39:51 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-17eb89fd-bd35-487b-bc0e-9c8995bd1d2d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Request method failure captured: Apr 13 16:39:51 user devstack@n-api.service[62053]: request: GET /compute/v2.1/servers/235f827c-7116-48e9-84c5-0c9761c18e1e HTTP/1.1 Apr 13 16:39:51 user devstack@n-api.service[62053]: Accept: application/json Apr 13 16:39:51 user devstack@n-api.service[62053]: Accept-Encoding: identity Apr 13 16:39:51 user devstack@n-api.service[62053]: Connection: close Apr 13 16:39:51 user devstack@n-api.service[62053]: Content-Length: 0 Apr 13 16:39:51 user devstack@n-api.service[62053]: Content-Type: application/json Apr 13 16:39:51 user devstack@n-api.service[62053]: Host: 10.0.0.210 Apr 13 16:39:51 user devstack@n-api.service[62053]: Openstack-System-Scope: None Apr 13 16:39:51 user devstack@n-api.service[62053]: User-Agent: python-urllib3/1.26.15 Apr 13 16:39:51 user devstack@n-api.service[62053]: X-Auth-Token: gAAAAABkOCu7MtWsOKSMJjfUQoU1oULuxX5_cxyqm3fiJ7uecNfGTxHfJGIzcsyuCKeTwX-UXiHsZPrgRPfRBnnspVLwGwCfG0xufWPhyTPeWFp1wJprkPGdV6PWcITd2zUKfAsRW_LPw8sefk-_NFDd_MYVeClml_YnSb-VpMEF_XYmDOZUCRg Apr 13 16:39:51 user devstack@n-api.service[62053]: X-Domain-Id: None Apr 13 16:39:51 user devstack@n-api.service[62053]: X-Domain-Name: None Apr 13 16:39:51 user devstack@n-api.service[62053]: X-Identity-Status: Confirmed Apr 13 16:39:51 user devstack@n-api.service[62053]: X-Is-Admin-Project: True Apr 13 16:39:51 user devstack@n-api.service[62053]: X-Openstack-Nova-Api-Version: 2.87 Apr 13 16:39:51 user devstack@n-api.service[62053]: X-Project-Domain-Id: default Apr 13 16:39:51 user devstack@n-api.service[62053]: X-Project-Domain-Name: Default Apr 13 16:39:51 user devstack@n-api.service[62053]: X-Project-Id: b2d09a74bf684a9fb1dd1e95d6c23f3c Apr 13 16:39:51 user devstack@n-api.service[62053]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-1960261099 Apr 13 16:39:51 user devstack@n-api.service[62053]: X-Role: reader,member Apr 13 16:39:51 user devstack@n-api.service[62053]: X-Roles: reader,member Apr 13 16:39:51 user devstack@n-api.service[62053]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b2d09a74bf684a9fb1dd1e95d6c23f3c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b2d09a74bf684a9fb1dd1e95d6c23f3c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b2d09a74bf684a9fb1dd1e95d6c23f3c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 13 16:39:51 user devstack@n-api.service[62053]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-1960261099 Apr 13 16:39:51 user devstack@n-api.service[62053]: X-Tenant-Id: b2d09a74bf684a9fb1dd1e95d6c23f3c Apr 13 16:39:51 user devstack@n-api.service[62053]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-1960261099 Apr 13 16:39:51 user devstack@n-api.service[62053]: X-User: tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member Apr 13 16:39:51 user devstack@n-api.service[62053]: X-User-Domain-Id: default Apr 13 16:39:51 user devstack@n-api.service[62053]: X-User-Domain-Name: Default Apr 13 16:39:51 user devstack@n-api.service[62053]: X-User-Id: e45a882dbafb4ea4976e4f45289eb2b8 Apr 13 16:39:51 user devstack@n-api.service[62053]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member Apr 13 16:39:51 user devstack@n-api.service[62053]: method: > Apr 13 16:39:51 user devstack@n-api.service[62053]: exception: Instance 235f827c-7116-48e9-84c5-0c9761c18e1e could not be found. Apr 13 16:39:51 user devstack@n-api.service[62053]: action_args: {'id': '235f827c-7116-48e9-84c5-0c9761c18e1e'} Apr 13 16:39:51 user devstack@n-api.service[62053]: {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 16:39:51 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:39:51 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 16:39:51 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 16:39:51 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 16:39:51 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 16:39:51 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 16:39:51 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 16:39:51 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 16:39:51 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 16:39:51 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 235f827c-7116-48e9-84c5-0c9761c18e1e could not be found. Apr 13 16:39:51 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:39:51 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:39:51 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:39:51 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:39:51 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 16:39:51 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 16:39:51 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 16:39:51 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 16:39:51 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 16:39:51 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 16:39:51 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 16:39:51 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 16:39:51 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 16:39:51 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 16:39:51 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 16:39:51 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 16:39:51 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 235f827c-7116-48e9-84c5-0c9761c18e1e could not be found. Apr 13 16:39:51 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:39:51 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:39:51 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:39:51 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:39:51 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 16:39:51 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 16:39:51 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 16:39:51 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 16:39:51 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 235f827c-7116-48e9-84c5-0c9761c18e1e could not be found. Apr 13 16:39:51 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:39:51 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-17eb89fd-bd35-487b-bc0e-9c8995bd1d2d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Returning 404 to user: Instance 235f827c-7116-48e9-84c5-0c9761c18e1e could not be found. {{(pid=62053) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 16:39:51 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-17eb89fd-bd35-487b-bc0e-9c8995bd1d2d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] 10.0.0.210 "GET /compute/v2.1/servers/235f827c-7116-48e9-84c5-0c9761c18e1e" status: 404 len: 111 microversion: 2.87 time: 0.130709 Apr 13 16:39:51 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 274/819] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 16:39:51 2023] GET /compute/v2.1/servers/235f827c-7116-48e9-84c5-0c9761c18e1e => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 13 16:39:51 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_cell0:SELECT=2 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:39:51 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_cell0:SELECT=6 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:39:51 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:39:51 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:39:51 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-bbb14a00-e67d-438f-901b-0ab20dfba5ae tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:39:51 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-bbb14a00-e67d-438f-901b-0ab20dfba5ae tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: f66553f5-5e1b-4f1d-8c5a-63bc340f7586] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:39:51 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-bbb14a00-e67d-438f-901b-0ab20dfba5ae tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:39:51 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-bbb14a00-e67d-438f-901b-0ab20dfba5ae tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:39:51 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-bbb14a00-e67d-438f-901b-0ab20dfba5ae tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:39:51 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-bbb14a00-e67d-438f-901b-0ab20dfba5ae tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:39:51 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-bbb14a00-e67d-438f-901b-0ab20dfba5ae tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:39:51 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-bbb14a00-e67d-438f-901b-0ab20dfba5ae tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:39:51 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-bbb14a00-e67d-438f-901b-0ab20dfba5ae tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: f66553f5-5e1b-4f1d-8c5a-63bc340f7586] Going to try to terminate instance {{(pid=62054) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 16:39:51 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_cell0:SELECT=2 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:39:51 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-bbb14a00-e67d-438f-901b-0ab20dfba5ae tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f66553f5-5e1b-4f1d-8c5a-63bc340f7586" status: 204 len: 0 microversion: 2.87 time: 0.146128 Apr 13 16:39:51 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 274/820] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 13 16:39:51 2023] DELETE /compute/v2.1/servers/f66553f5-5e1b-4f1d-8c5a-63bc340f7586 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 13 16:39:51 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_api:SELECT=17,nova_api:DELETE=1 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:39:51 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_cell1:SELECT=2 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:39:51 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-4dca75b3-32ee-4df7-9ff1-ba22d3f50bcf tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:39:51 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-4dca75b3-32ee-4df7-9ff1-ba22d3f50bcf tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: f66553f5-5e1b-4f1d-8c5a-63bc340f7586] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:39:51 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-4dca75b3-32ee-4df7-9ff1-ba22d3f50bcf tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:39:51 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-4dca75b3-32ee-4df7-9ff1-ba22d3f50bcf tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:39:51 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-4dca75b3-32ee-4df7-9ff1-ba22d3f50bcf tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:39:51 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-4dca75b3-32ee-4df7-9ff1-ba22d3f50bcf tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:39:51 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-4dca75b3-32ee-4df7-9ff1-ba22d3f50bcf tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:39:51 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-4dca75b3-32ee-4df7-9ff1-ba22d3f50bcf tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:39:51 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-9347a1e7-226a-48f5-82d1-d97d8651af6e req-a6be8187-4560-42c8-a054-e53592ed3bc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f66553f5-5e1b-4f1d-8c5a-63bc340f7586", "name": "network-vif-unplugged", "status": "completed", "tag": "27d05b76-8556-4365-9050-6bf871e85502"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:39:51 user devstack@n-api.service[62053]: DEBUG nova.policy [None req-4dca75b3-32ee-4df7-9ff1-ba22d3f50bcf tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45a882dbafb4ea4976e4f45289eb2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d09a74bf684a9fb1dd1e95d6c23f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62053) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:39:51 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-9347a1e7-226a-48f5-82d1-d97d8651af6e req-a6be8187-4560-42c8-a054-e53592ed3bc1 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:39:51 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-9347a1e7-226a-48f5-82d1-d97d8651af6e req-a6be8187-4560-42c8-a054-e53592ed3bc1 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:39:51 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-9347a1e7-226a-48f5-82d1-d97d8651af6e req-a6be8187-4560-42c8-a054-e53592ed3bc1 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:39:51 user devstack@n-api.service[62053]: DEBUG nova.policy [None req-4dca75b3-32ee-4df7-9ff1-ba22d3f50bcf tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e45a882dbafb4ea4976e4f45289eb2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d09a74bf684a9fb1dd1e95d6c23f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62053) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:39:51 user devstack@n-api.service[62053]: DEBUG nova.policy [None req-4dca75b3-32ee-4df7-9ff1-ba22d3f50bcf tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e45a882dbafb4ea4976e4f45289eb2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d09a74bf684a9fb1dd1e95d6c23f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62053) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:39:51 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-b6e33684-eeae-425e-bb26-331a99200706 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:39:51 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-b6e33684-eeae-425e-bb26-331a99200706 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 5ed800fe-577d-4624-898c-c7f40da77376] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:39:51 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-9347a1e7-226a-48f5-82d1-d97d8651af6e req-a6be8187-4560-42c8-a054-e53592ed3bc1 service nova] Creating event network-vif-unplugged:27d05b76-8556-4365-9050-6bf871e85502 for instance f66553f5-5e1b-4f1d-8c5a-63bc340f7586 on user Apr 13 16:39:51 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-4dca75b3-32ee-4df7-9ff1-ba22d3f50bcf tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f66553f5-5e1b-4f1d-8c5a-63bc340f7586" status: 200 len: 1697 microversion: 2.87 time: 0.270500 Apr 13 16:39:52 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 275/821] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 16:39:51 2023] GET /compute/v2.1/servers/f66553f5-5e1b-4f1d-8c5a-63bc340f7586 => generated 1697 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 16:39:52 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-b6e33684-eeae-425e-bb26-331a99200706 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:39:52 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-b6e33684-eeae-425e-bb26-331a99200706 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:39:52 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-b6e33684-eeae-425e-bb26-331a99200706 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:39:52 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-b6e33684-eeae-425e-bb26-331a99200706 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:39:52 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-b6e33684-eeae-425e-bb26-331a99200706 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:39:52 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-b6e33684-eeae-425e-bb26-331a99200706 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:39:52 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [req-9347a1e7-226a-48f5-82d1-d97d8651af6e req-a6be8187-4560-42c8-a054-e53592ed3bc1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041185 Apr 13 16:39:52 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 275/822] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:39:51 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:39:52 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-b6e33684-eeae-425e-bb26-331a99200706 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5ed800fe-577d-4624-898c-c7f40da77376/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.399524 Apr 13 16:39:52 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 273/823] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 13 16:39:51 2023] GET /compute/v2.1/servers/5ed800fe-577d-4624-898c-c7f40da77376/os-interface => generated 282 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:39:53 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-dfce92aa-bb15-451a-b177-c940e74f8d9e req-de9e9cea-7f5e-4c73-8b08-ac35a8ffa11a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ed800fe-577d-4624-898c-c7f40da77376", "tag": "09531419-c0ff-4d13-89bd-06caa28e019d"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:39:53 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-dfce92aa-bb15-451a-b177-c940e74f8d9e req-de9e9cea-7f5e-4c73-8b08-ac35a8ffa11a service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:39:53 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-dfce92aa-bb15-451a-b177-c940e74f8d9e req-de9e9cea-7f5e-4c73-8b08-ac35a8ffa11a service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:39:53 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-dfce92aa-bb15-451a-b177-c940e74f8d9e req-de9e9cea-7f5e-4c73-8b08-ac35a8ffa11a service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:39:53 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-dfce92aa-bb15-451a-b177-c940e74f8d9e req-de9e9cea-7f5e-4c73-8b08-ac35a8ffa11a service nova] Creating event network-changed:09531419-c0ff-4d13-89bd-06caa28e019d for instance 5ed800fe-577d-4624-898c-c7f40da77376 on user Apr 13 16:39:53 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [req-dfce92aa-bb15-451a-b177-c940e74f8d9e req-de9e9cea-7f5e-4c73-8b08-ac35a8ffa11a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054042 Apr 13 16:39:53 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 276/824] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:39:53 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:39:53 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-bfc0d012-d06d-4797-b835-85a85d14a279 req-f9ddca58-a8d8-42e3-a780-4f74a5071bb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f66553f5-5e1b-4f1d-8c5a-63bc340f7586", "name": "network-vif-deleted", "tag": "27d05b76-8556-4365-9050-6bf871e85502"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:39:53 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-bfc0d012-d06d-4797-b835-85a85d14a279 req-f9ddca58-a8d8-42e3-a780-4f74a5071bb2 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:39:53 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-bfc0d012-d06d-4797-b835-85a85d14a279 req-f9ddca58-a8d8-42e3-a780-4f74a5071bb2 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:39:53 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-bfc0d012-d06d-4797-b835-85a85d14a279 req-f9ddca58-a8d8-42e3-a780-4f74a5071bb2 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:39:53 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-bfc0d012-d06d-4797-b835-85a85d14a279 req-f9ddca58-a8d8-42e3-a780-4f74a5071bb2 service nova] Creating event network-vif-deleted:27d05b76-8556-4365-9050-6bf871e85502 for instance f66553f5-5e1b-4f1d-8c5a-63bc340f7586 on user Apr 13 16:39:53 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [req-bfc0d012-d06d-4797-b835-85a85d14a279 req-f9ddca58-a8d8-42e3-a780-4f74a5071bb2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029435 Apr 13 16:39:53 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 276/825] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:39:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:39:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [req-129026a1-7995-4a62-a1af-a8df1db11597 req-c16b8855-5071-484e-a181-21ba783edc2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f66553f5-5e1b-4f1d-8c5a-63bc340f7586", "name": "network-vif-plugged", "status": "completed", "tag": "27d05b76-8556-4365-9050-6bf871e85502"}]} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:39:54 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-129026a1-7995-4a62-a1af-a8df1db11597 req-c16b8855-5071-484e-a181-21ba783edc2d service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:39:54 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-129026a1-7995-4a62-a1af-a8df1db11597 req-c16b8855-5071-484e-a181-21ba783edc2d service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:39:54 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-129026a1-7995-4a62-a1af-a8df1db11597 req-c16b8855-5071-484e-a181-21ba783edc2d service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:39:54 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-129026a1-7995-4a62-a1af-a8df1db11597 req-c16b8855-5071-484e-a181-21ba783edc2d service nova] Creating event network-vif-plugged:27d05b76-8556-4365-9050-6bf871e85502 for instance f66553f5-5e1b-4f1d-8c5a-63bc340f7586 on user Apr 13 16:39:54 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [req-129026a1-7995-4a62-a1af-a8df1db11597 req-c16b8855-5071-484e-a181-21ba783edc2d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029969 Apr 13 16:39:54 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 274/826] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:39:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:39:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-e4513be8-ac39-45ca-a2a3-0cc889a53198 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-182216296", "imageRef": "", "flavorRef": "42", "networks": [{"uuid": "cf1fef97-9ef1-449f-a302-b38110024547"}], "security_groups": [{"name": "tempest-securitygroup--1787105472"}], "key_name": "tempest-keypair-1700037342", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "bebf46c7-444f-475a-9c3f-615d66556271", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:39:55 user devstack@n-api.service[62053]: DEBUG nova.network.neutron [None req-e4513be8-ac39-45ca-a2a3-0cc889a53198 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] validate_networks() for [('cf1fef97-9ef1-449f-a302-b38110024547', None, None, None, None, None)] {{(pid=62053) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 16:39:56 user devstack@n-api.service[62053]: DEBUG nova.virt.hardware [None req-e4513be8-ac39-45ca-a2a3-0cc889a53198 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Flavor limits 0:0:0 {{(pid=62053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 16:39:56 user devstack@n-api.service[62053]: DEBUG nova.virt.hardware [None req-e4513be8-ac39-45ca-a2a3-0cc889a53198 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Image limits 0:0:0 {{(pid=62053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 16:39:56 user devstack@n-api.service[62053]: DEBUG nova.virt.hardware [None req-e4513be8-ac39-45ca-a2a3-0cc889a53198 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Flavor pref 0:0:0 {{(pid=62053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 16:39:56 user devstack@n-api.service[62053]: DEBUG nova.virt.hardware [None req-e4513be8-ac39-45ca-a2a3-0cc889a53198 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Image pref 0:0:0 {{(pid=62053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 16:39:56 user devstack@n-api.service[62053]: DEBUG nova.virt.hardware [None req-e4513be8-ac39-45ca-a2a3-0cc889a53198 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 16:39:56 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-e4513be8-ac39-45ca-a2a3-0cc889a53198 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:39:56 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-e4513be8-ac39-45ca-a2a3-0cc889a53198 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:39:56 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-e4513be8-ac39-45ca-a2a3-0cc889a53198 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:39:56 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-e4513be8-ac39-45ca-a2a3-0cc889a53198 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:39:56 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-e4513be8-ac39-45ca-a2a3-0cc889a53198 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:39:56 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-e4513be8-ac39-45ca-a2a3-0cc889a53198 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:39:56 user devstack@n-api.service[62053]: DEBUG nova.quota [None req-e4513be8-ac39-45ca-a2a3-0cc889a53198 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Getting quotas for project 980559734a504574a83224deb7423c77. Resources: {'instances', 'cores', 'ram'} {{(pid=62053) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 16:39:56 user devstack@n-api.service[62053]: DEBUG nova.quota [None req-e4513be8-ac39-45ca-a2a3-0cc889a53198 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Getting quotas for user 1b3df1c5c5d441819bcef89ed6966815 and project 980559734a504574a83224deb7423c77. Resources: {'instances', 'cores', 'ram'} {{(pid=62053) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 16:39:56 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-e4513be8-ac39-45ca-a2a3-0cc889a53198 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Going to run 1 instances... {{(pid=62053) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 16:39:56 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-e4513be8-ac39-45ca-a2a3-0cc889a53198 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bebf46c7-444f-475a-9c3f-615d66556271',volume_size=None,volume_type=None)] {{(pid=62053) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 16:39:56 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-e4513be8-ac39-45ca-a2a3-0cc889a53198 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.753367 Apr 13 16:39:56 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 277/827] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 16:39:55 2023] POST /compute/v2.1/servers => generated 404 bytes in 755 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 16:39:56 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-1dcad770-a490-4eda-b8d1-8cd314c17ea0 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:39:56 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-1dcad770-a490-4eda-b8d1-8cd314c17ea0 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:39:56 user devstack@n-api.service[62054]: DEBUG nova.policy [None req-1dcad770-a490-4eda-b8d1-8cd314c17ea0 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b3df1c5c5d441819bcef89ed6966815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980559734a504574a83224deb7423c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62054) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:39:56 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-1dcad770-a490-4eda-b8d1-8cd314c17ea0 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7ae7d3d9-54f7-4c64-8bf6-08fa5c526687" status: 200 len: 1075 microversion: 2.1 time: 0.077313 Apr 13 16:39:56 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 277/828] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:39:56 2023] GET /compute/v2.1/servers/7ae7d3d9-54f7-4c64-8bf6-08fa5c526687 => generated 1075 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:39:58 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [req-87c16332-9778-4642-b285-8b5e5efe42ce req-dbb9ce5c-014b-4ea5-bee9-2cbf0fea5f67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ae7d3d9-54f7-4c64-8bf6-08fa5c526687", "tag": "f7ec2f7f-f505-44ed-b40d-7b91b2248cea"}]} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:39:58 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-87c16332-9778-4642-b285-8b5e5efe42ce req-dbb9ce5c-014b-4ea5-bee9-2cbf0fea5f67 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:39:58 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-87c16332-9778-4642-b285-8b5e5efe42ce req-dbb9ce5c-014b-4ea5-bee9-2cbf0fea5f67 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:39:58 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-87c16332-9778-4642-b285-8b5e5efe42ce req-dbb9ce5c-014b-4ea5-bee9-2cbf0fea5f67 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:39:58 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-87c16332-9778-4642-b285-8b5e5efe42ce req-dbb9ce5c-014b-4ea5-bee9-2cbf0fea5f67 service nova] Creating event network-changed:f7ec2f7f-f505-44ed-b40d-7b91b2248cea for instance 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687 on user Apr 13 16:39:58 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [req-87c16332-9778-4642-b285-8b5e5efe42ce req-dbb9ce5c-014b-4ea5-bee9-2cbf0fea5f67 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027560 Apr 13 16:39:58 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 275/829] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:39:58 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:40:04 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-a5a43f2f-8dde-4bc4-80b7-a72558c81429 req-fa4e20dc-ca59-498e-a543-7bf114bc6cdb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ae7d3d9-54f7-4c64-8bf6-08fa5c526687", "name": "network-vif-plugged", "status": "completed", "tag": "f7ec2f7f-f505-44ed-b40d-7b91b2248cea"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:40:04 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-a5a43f2f-8dde-4bc4-80b7-a72558c81429 req-fa4e20dc-ca59-498e-a543-7bf114bc6cdb service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:40:04 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-a5a43f2f-8dde-4bc4-80b7-a72558c81429 req-fa4e20dc-ca59-498e-a543-7bf114bc6cdb service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:40:04 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-a5a43f2f-8dde-4bc4-80b7-a72558c81429 req-fa4e20dc-ca59-498e-a543-7bf114bc6cdb service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:40:04 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-a5a43f2f-8dde-4bc4-80b7-a72558c81429 req-fa4e20dc-ca59-498e-a543-7bf114bc6cdb service nova] Creating event network-vif-plugged:f7ec2f7f-f505-44ed-b40d-7b91b2248cea for instance 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687 on user Apr 13 16:40:04 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [req-a5a43f2f-8dde-4bc4-80b7-a72558c81429 req-fa4e20dc-ca59-498e-a543-7bf114bc6cdb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033443 Apr 13 16:40:04 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 278/830] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:40:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:40:06 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-1f361583-1a52-4cc2-87b4-ab422265fea9 req-3b47f16c-d8cb-4fab-bf2c-c3dec3f03101 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ae7d3d9-54f7-4c64-8bf6-08fa5c526687", "name": "network-vif-plugged", "status": "completed", "tag": "f7ec2f7f-f505-44ed-b40d-7b91b2248cea"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:40:06 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:40:06 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:40:06 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_cell0:SELECT=2 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:40:06 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-1f361583-1a52-4cc2-87b4-ab422265fea9 req-3b47f16c-d8cb-4fab-bf2c-c3dec3f03101 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:40:06 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-1f361583-1a52-4cc2-87b4-ab422265fea9 req-3b47f16c-d8cb-4fab-bf2c-c3dec3f03101 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:40:06 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-1f361583-1a52-4cc2-87b4-ab422265fea9 req-3b47f16c-d8cb-4fab-bf2c-c3dec3f03101 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:40:06 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-1f361583-1a52-4cc2-87b4-ab422265fea9 req-3b47f16c-d8cb-4fab-bf2c-c3dec3f03101 service nova] Creating event network-vif-plugged:f7ec2f7f-f505-44ed-b40d-7b91b2248cea for instance 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687 on user Apr 13 16:40:06 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [req-1f361583-1a52-4cc2-87b4-ab422265fea9 req-3b47f16c-d8cb-4fab-bf2c-c3dec3f03101 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045834 Apr 13 16:40:06 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 278/831] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:40:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:40:07 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-dffdf96c-f8ac-4567-86d0-08c15e4d47bb tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:40:07 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-dffdf96c-f8ac-4567-86d0-08c15e4d47bb tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:40:07 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-dffdf96c-f8ac-4567-86d0-08c15e4d47bb tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:40:07 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-dffdf96c-f8ac-4567-86d0-08c15e4d47bb tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:40:07 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-dffdf96c-f8ac-4567-86d0-08c15e4d47bb tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:40:07 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-dffdf96c-f8ac-4567-86d0-08c15e4d47bb tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:40:07 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-dffdf96c-f8ac-4567-86d0-08c15e4d47bb tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:40:07 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-dffdf96c-f8ac-4567-86d0-08c15e4d47bb tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:40:07 user devstack@n-api.service[62055]: DEBUG nova.policy [None req-dffdf96c-f8ac-4567-86d0-08c15e4d47bb tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b4e972cd1049509fa899449961ab59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0653ab16660b46cea9c5af58ea0b1931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62055) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:40:07 user devstack@n-api.service[62055]: DEBUG nova.policy [None req-dffdf96c-f8ac-4567-86d0-08c15e4d47bb tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48b4e972cd1049509fa899449961ab59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0653ab16660b46cea9c5af58ea0b1931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62055) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:40:07 user devstack@n-api.service[62055]: DEBUG nova.policy [None req-dffdf96c-f8ac-4567-86d0-08c15e4d47bb tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48b4e972cd1049509fa899449961ab59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0653ab16660b46cea9c5af58ea0b1931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62055) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:40:07 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-dffdf96c-f8ac-4567-86d0-08c15e4d47bb tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1f6a693f-0a99-434f-871d-f535b71229b9" status: 200 len: 1586 microversion: 2.20 time: 0.155840 Apr 13 16:40:07 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 276/832] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 16:40:07 2023] GET /compute/v2.1/servers/1f6a693f-0a99-434f-871d-f535b71229b9 => generated 1586 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 16:40:42 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-6eee622a-5618-46eb-bec9-eecafdb48b68 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:40:42 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-6eee622a-5618-46eb-bec9-eecafdb48b68 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: f66553f5-5e1b-4f1d-8c5a-63bc340f7586] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:40:42 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_cell0:SELECT=2 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:40:42 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_cell0:SELECT=6 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:40:42 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=3 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:40:42 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_cell1:SELECT=14 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:40:42 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-6eee622a-5618-46eb-bec9-eecafdb48b68 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:40:42 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-6eee622a-5618-46eb-bec9-eecafdb48b68 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:40:42 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-6eee622a-5618-46eb-bec9-eecafdb48b68 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:40:42 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-6eee622a-5618-46eb-bec9-eecafdb48b68 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:40:42 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-6eee622a-5618-46eb-bec9-eecafdb48b68 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:40:42 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-6eee622a-5618-46eb-bec9-eecafdb48b68 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:40:42 user devstack@n-api.service[62053]: INFO nova.api.openstack.wsgi [None req-6eee622a-5618-46eb-bec9-eecafdb48b68 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] HTTP exception thrown: Instance f66553f5-5e1b-4f1d-8c5a-63bc340f7586 could not be found. Apr 13 16:40:42 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-6eee622a-5618-46eb-bec9-eecafdb48b68 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Request method failure captured: Apr 13 16:40:42 user devstack@n-api.service[62053]: request: GET /compute/v2.1/servers/f66553f5-5e1b-4f1d-8c5a-63bc340f7586 HTTP/1.1 Apr 13 16:40:42 user devstack@n-api.service[62053]: Accept: application/json Apr 13 16:40:42 user devstack@n-api.service[62053]: Accept-Encoding: identity Apr 13 16:40:42 user devstack@n-api.service[62053]: Connection: close Apr 13 16:40:42 user devstack@n-api.service[62053]: Content-Length: 0 Apr 13 16:40:42 user devstack@n-api.service[62053]: Content-Type: application/json Apr 13 16:40:42 user devstack@n-api.service[62053]: Host: 10.0.0.210 Apr 13 16:40:42 user devstack@n-api.service[62053]: Openstack-System-Scope: None Apr 13 16:40:42 user devstack@n-api.service[62053]: User-Agent: python-urllib3/1.26.15 Apr 13 16:40:42 user devstack@n-api.service[62053]: X-Auth-Token: gAAAAABkOCu7MtWsOKSMJjfUQoU1oULuxX5_cxyqm3fiJ7uecNfGTxHfJGIzcsyuCKeTwX-UXiHsZPrgRPfRBnnspVLwGwCfG0xufWPhyTPeWFp1wJprkPGdV6PWcITd2zUKfAsRW_LPw8sefk-_NFDd_MYVeClml_YnSb-VpMEF_XYmDOZUCRg Apr 13 16:40:42 user devstack@n-api.service[62053]: X-Domain-Id: None Apr 13 16:40:42 user devstack@n-api.service[62053]: X-Domain-Name: None Apr 13 16:40:42 user devstack@n-api.service[62053]: X-Identity-Status: Confirmed Apr 13 16:40:42 user devstack@n-api.service[62053]: X-Is-Admin-Project: True Apr 13 16:40:42 user devstack@n-api.service[62053]: X-Openstack-Nova-Api-Version: 2.87 Apr 13 16:40:42 user devstack@n-api.service[62053]: X-Project-Domain-Id: default Apr 13 16:40:42 user devstack@n-api.service[62053]: X-Project-Domain-Name: Default Apr 13 16:40:42 user devstack@n-api.service[62053]: X-Project-Id: b2d09a74bf684a9fb1dd1e95d6c23f3c Apr 13 16:40:42 user devstack@n-api.service[62053]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-1960261099 Apr 13 16:40:42 user devstack@n-api.service[62053]: X-Role: reader,member Apr 13 16:40:42 user devstack@n-api.service[62053]: X-Roles: reader,member Apr 13 16:40:42 user devstack@n-api.service[62053]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b2d09a74bf684a9fb1dd1e95d6c23f3c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b2d09a74bf684a9fb1dd1e95d6c23f3c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b2d09a74bf684a9fb1dd1e95d6c23f3c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 13 16:40:42 user devstack@n-api.service[62053]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-1960261099 Apr 13 16:40:42 user devstack@n-api.service[62053]: X-Tenant-Id: b2d09a74bf684a9fb1dd1e95d6c23f3c Apr 13 16:40:42 user devstack@n-api.service[62053]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-1960261099 Apr 13 16:40:42 user devstack@n-api.service[62053]: X-User: tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member Apr 13 16:40:42 user devstack@n-api.service[62053]: X-User-Domain-Id: default Apr 13 16:40:42 user devstack@n-api.service[62053]: X-User-Domain-Name: Default Apr 13 16:40:42 user devstack@n-api.service[62053]: X-User-Id: e45a882dbafb4ea4976e4f45289eb2b8 Apr 13 16:40:42 user devstack@n-api.service[62053]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member Apr 13 16:40:42 user devstack@n-api.service[62053]: method: > Apr 13 16:40:42 user devstack@n-api.service[62053]: exception: Instance f66553f5-5e1b-4f1d-8c5a-63bc340f7586 could not be found. Apr 13 16:40:42 user devstack@n-api.service[62053]: action_args: {'id': 'f66553f5-5e1b-4f1d-8c5a-63bc340f7586'} Apr 13 16:40:42 user devstack@n-api.service[62053]: {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 16:40:42 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:40:42 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 16:40:42 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 16:40:42 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 16:40:42 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 16:40:42 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 16:40:42 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 16:40:42 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 16:40:42 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 16:40:42 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f66553f5-5e1b-4f1d-8c5a-63bc340f7586 could not be found. Apr 13 16:40:42 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:40:42 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:40:42 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:40:42 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:40:42 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 16:40:42 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 16:40:42 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 16:40:42 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 16:40:42 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 16:40:42 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 16:40:42 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 16:40:42 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 16:40:42 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 16:40:42 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 16:40:42 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 16:40:42 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 16:40:42 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f66553f5-5e1b-4f1d-8c5a-63bc340f7586 could not be found. Apr 13 16:40:42 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:40:42 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:40:42 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:40:42 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:40:42 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 16:40:42 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 16:40:42 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 16:40:42 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 16:40:42 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f66553f5-5e1b-4f1d-8c5a-63bc340f7586 could not be found. Apr 13 16:40:42 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:40:42 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-6eee622a-5618-46eb-bec9-eecafdb48b68 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Returning 404 to user: Instance f66553f5-5e1b-4f1d-8c5a-63bc340f7586 could not be found. {{(pid=62053) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 16:40:42 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-6eee622a-5618-46eb-bec9-eecafdb48b68 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f66553f5-5e1b-4f1d-8c5a-63bc340f7586" status: 404 len: 111 microversion: 2.87 time: 0.040357 Apr 13 16:40:42 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 279/833] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 16:40:42 2023] GET /compute/v2.1/servers/f66553f5-5e1b-4f1d-8c5a-63bc340f7586 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 13 16:40:46 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_api:SELECT=2 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:40:46 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_cell1:SELECT=2 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:40:46 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-de5e09a4-dddc-47f2-9fa3-047c62d725f2 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:40:46 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-de5e09a4-dddc-47f2-9fa3-047c62d725f2 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:40:46 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-de5e09a4-dddc-47f2-9fa3-047c62d725f2 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:40:46 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-de5e09a4-dddc-47f2-9fa3-047c62d725f2 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:40:46 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-de5e09a4-dddc-47f2-9fa3-047c62d725f2 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:40:46 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-de5e09a4-dddc-47f2-9fa3-047c62d725f2 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:40:46 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-de5e09a4-dddc-47f2-9fa3-047c62d725f2 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:40:46 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-de5e09a4-dddc-47f2-9fa3-047c62d725f2 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:40:46 user devstack@n-api.service[62054]: DEBUG nova.policy [None req-de5e09a4-dddc-47f2-9fa3-047c62d725f2 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b3df1c5c5d441819bcef89ed6966815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980559734a504574a83224deb7423c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62054) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:40:46 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-de5e09a4-dddc-47f2-9fa3-047c62d725f2 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7ae7d3d9-54f7-4c64-8bf6-08fa5c526687" status: 200 len: 1429 microversion: 2.1 time: 0.265789 Apr 13 16:40:46 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 279/834] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:40:46 2023] GET /compute/v2.1/servers/7ae7d3d9-54f7-4c64-8bf6-08fa5c526687 => generated 1429 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:40:52 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_api:SELECT=8 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:40:52 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_cell1:SELECT=14 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:40:52 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-dce8a6c6-24db-46e7-821c-beefda666677 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-862659387", "imageRef": "708622a9-7465-4492-ade8-b827198f7e30", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:40:52 user devstack@n-api.service[62055]: DEBUG nova.network.neutron [None req-dce8a6c6-24db-46e7-821c-beefda666677 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] validate_networks() for [('2a5b69f1-fc5b-4c33-a9eb-12a4d9293500', None, None, None, None, None)] {{(pid=62055) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 16:40:53 user devstack@n-api.service[62055]: DEBUG nova.virt.hardware [None req-dce8a6c6-24db-46e7-821c-beefda666677 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Flavor limits 0:0:0 {{(pid=62055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 16:40:53 user devstack@n-api.service[62055]: DEBUG nova.virt.hardware [None req-dce8a6c6-24db-46e7-821c-beefda666677 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Image limits 0:0:0 {{(pid=62055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 16:40:53 user devstack@n-api.service[62055]: DEBUG nova.virt.hardware [None req-dce8a6c6-24db-46e7-821c-beefda666677 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Flavor pref 0:0:0 {{(pid=62055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 16:40:53 user devstack@n-api.service[62055]: DEBUG nova.virt.hardware [None req-dce8a6c6-24db-46e7-821c-beefda666677 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Image pref 0:0:0 {{(pid=62055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 16:40:53 user devstack@n-api.service[62055]: DEBUG nova.virt.hardware [None req-dce8a6c6-24db-46e7-821c-beefda666677 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 16:40:53 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-dce8a6c6-24db-46e7-821c-beefda666677 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:40:53 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-dce8a6c6-24db-46e7-821c-beefda666677 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:40:53 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-dce8a6c6-24db-46e7-821c-beefda666677 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:40:53 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-dce8a6c6-24db-46e7-821c-beefda666677 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:40:53 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-dce8a6c6-24db-46e7-821c-beefda666677 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:40:53 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-dce8a6c6-24db-46e7-821c-beefda666677 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:40:53 user devstack@n-api.service[62055]: DEBUG nova.quota [None req-dce8a6c6-24db-46e7-821c-beefda666677 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Getting quotas for project 846732ecb7e047128b4684972d3cd8c6. Resources: {'instances', 'cores', 'ram'} {{(pid=62055) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 16:40:53 user devstack@n-api.service[62055]: DEBUG nova.quota [None req-dce8a6c6-24db-46e7-821c-beefda666677 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Getting quotas for user 0c7f54723c494e05ada117353c0790cb and project 846732ecb7e047128b4684972d3cd8c6. Resources: {'instances', 'cores', 'ram'} {{(pid=62055) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 16:40:53 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-dce8a6c6-24db-46e7-821c-beefda666677 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Going to run 1 instances... {{(pid=62055) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 16:40:53 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-dce8a6c6-24db-46e7-821c-beefda666677 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='708622a9-7465-4492-ade8-b827198f7e30',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=62055) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 16:40:53 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-dce8a6c6-24db-46e7-821c-beefda666677 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 0.698268 Apr 13 16:40:53 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 277/835] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 16:40:52 2023] POST /compute/v2.1/servers => generated 381 bytes in 700 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 16:40:53 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-b3bb98cf-8ee4-424e-a7df-3355796ae65c tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:40:53 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-b3bb98cf-8ee4-424e-a7df-3355796ae65c tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:40:53 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_api:SELECT=2 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:40:53 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_cell1:SELECT=2 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:40:53 user devstack@n-api.service[62053]: DEBUG nova.policy [None req-b3bb98cf-8ee4-424e-a7df-3355796ae65c tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c7f54723c494e05ada117353c0790cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '846732ecb7e047128b4684972d3cd8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62053) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:40:53 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-b3bb98cf-8ee4-424e-a7df-3355796ae65c tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b2d55cdd-c89c-4c59-afe1-49a33225af22" status: 200 len: 1215 microversion: 2.1 time: 0.123794 Apr 13 16:40:53 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 280/836] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:40:53 2023] GET /compute/v2.1/servers/b2d55cdd-c89c-4c59-afe1-49a33225af22 => generated 1215 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:40:53 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-c592eb69-ccd6-4157-809c-6f29fe079b00 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-297516343", "imageRef": "708622a9-7465-4492-ade8-b827198f7e30", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:40:53 user devstack@n-api.service[62054]: DEBUG nova.network.neutron [None req-c592eb69-ccd6-4157-809c-6f29fe079b00 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] validate_networks() for [('2a5b69f1-fc5b-4c33-a9eb-12a4d9293500', None, None, None, None, None)] {{(pid=62054) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 16:40:54 user devstack@n-api.service[62054]: DEBUG nova.virt.hardware [None req-c592eb69-ccd6-4157-809c-6f29fe079b00 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Flavor limits 0:0:0 {{(pid=62054) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 16:40:54 user devstack@n-api.service[62054]: DEBUG nova.virt.hardware [None req-c592eb69-ccd6-4157-809c-6f29fe079b00 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Image limits 0:0:0 {{(pid=62054) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 16:40:54 user devstack@n-api.service[62054]: DEBUG nova.virt.hardware [None req-c592eb69-ccd6-4157-809c-6f29fe079b00 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Flavor pref 0:0:0 {{(pid=62054) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 16:40:54 user devstack@n-api.service[62054]: DEBUG nova.virt.hardware [None req-c592eb69-ccd6-4157-809c-6f29fe079b00 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Image pref 0:0:0 {{(pid=62054) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 16:40:54 user devstack@n-api.service[62054]: DEBUG nova.virt.hardware [None req-c592eb69-ccd6-4157-809c-6f29fe079b00 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62054) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 16:40:54 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-c592eb69-ccd6-4157-809c-6f29fe079b00 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:40:54 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-c592eb69-ccd6-4157-809c-6f29fe079b00 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:40:54 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-c592eb69-ccd6-4157-809c-6f29fe079b00 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:40:54 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-c592eb69-ccd6-4157-809c-6f29fe079b00 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:40:54 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-c592eb69-ccd6-4157-809c-6f29fe079b00 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:40:54 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-c592eb69-ccd6-4157-809c-6f29fe079b00 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:40:54 user devstack@n-api.service[62054]: DEBUG nova.quota [None req-c592eb69-ccd6-4157-809c-6f29fe079b00 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Getting quotas for project 846732ecb7e047128b4684972d3cd8c6. Resources: {'instances', 'cores', 'ram'} {{(pid=62054) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 16:40:54 user devstack@n-api.service[62054]: DEBUG nova.quota [None req-c592eb69-ccd6-4157-809c-6f29fe079b00 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Getting quotas for user 0c7f54723c494e05ada117353c0790cb and project 846732ecb7e047128b4684972d3cd8c6. Resources: {'instances', 'cores', 'ram'} {{(pid=62054) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 16:40:54 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-c592eb69-ccd6-4157-809c-6f29fe079b00 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Going to run 1 instances... {{(pid=62054) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 16:40:54 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-c592eb69-ccd6-4157-809c-6f29fe079b00 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: 3af23ff8-4e10-4fbf-a86e-bda842f084ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='708622a9-7465-4492-ade8-b827198f7e30',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=62054) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 16:40:54 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-c592eb69-ccd6-4157-809c-6f29fe079b00 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 1.042542 Apr 13 16:40:54 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 280/837] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 16:40:53 2023] POST /compute/v2.1/servers => generated 381 bytes in 1044 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 16:40:54 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-eead2f9e-e417-403a-af09-3aaf36434faf tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:40:54 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-eead2f9e-e417-403a-af09-3aaf36434faf tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: 3af23ff8-4e10-4fbf-a86e-bda842f084ff] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:40:54 user devstack@n-api.service[62055]: DEBUG nova.policy [None req-eead2f9e-e417-403a-af09-3aaf36434faf tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c7f54723c494e05ada117353c0790cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '846732ecb7e047128b4684972d3cd8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62055) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:40:54 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-eead2f9e-e417-403a-af09-3aaf36434faf tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3af23ff8-4e10-4fbf-a86e-bda842f084ff" status: 200 len: 1215 microversion: 2.1 time: 0.085065 Apr 13 16:40:54 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 278/838] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:40:54 2023] GET /compute/v2.1/servers/3af23ff8-4e10-4fbf-a86e-bda842f084ff => generated 1215 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:40:56 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-6fdeec37-0487-4d50-a7a2-b1c07ea138f9 req-2e01e843-1f31-4ebb-b2aa-6e0aeedd1205 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2d55cdd-c89c-4c59-afe1-49a33225af22", "tag": "31e1957f-9bd1-42ae-a2ac-954b49ca15f1"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:40:56 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-6fdeec37-0487-4d50-a7a2-b1c07ea138f9 req-2e01e843-1f31-4ebb-b2aa-6e0aeedd1205 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:40:56 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-6fdeec37-0487-4d50-a7a2-b1c07ea138f9 req-2e01e843-1f31-4ebb-b2aa-6e0aeedd1205 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:40:56 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-6fdeec37-0487-4d50-a7a2-b1c07ea138f9 req-2e01e843-1f31-4ebb-b2aa-6e0aeedd1205 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:40:56 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-6fdeec37-0487-4d50-a7a2-b1c07ea138f9 req-2e01e843-1f31-4ebb-b2aa-6e0aeedd1205 service nova] Creating event network-changed:31e1957f-9bd1-42ae-a2ac-954b49ca15f1 for instance b2d55cdd-c89c-4c59-afe1-49a33225af22 on user Apr 13 16:40:56 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [req-6fdeec37-0487-4d50-a7a2-b1c07ea138f9 req-2e01e843-1f31-4ebb-b2aa-6e0aeedd1205 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084627 Apr 13 16:40:56 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 281/839] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:40:56 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:40:58 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-19556248-8b76-4f7a-8724-f8eecdb047b9 req-e31b38c8-f152-40dd-b7a1-24160fa0ab52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3af23ff8-4e10-4fbf-a86e-bda842f084ff", "tag": "b22086e3-8769-494c-af86-228dba7b3638"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:40:58 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-19556248-8b76-4f7a-8724-f8eecdb047b9 req-e31b38c8-f152-40dd-b7a1-24160fa0ab52 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:40:58 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-19556248-8b76-4f7a-8724-f8eecdb047b9 req-e31b38c8-f152-40dd-b7a1-24160fa0ab52 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:40:58 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-19556248-8b76-4f7a-8724-f8eecdb047b9 req-e31b38c8-f152-40dd-b7a1-24160fa0ab52 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:40:58 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-19556248-8b76-4f7a-8724-f8eecdb047b9 req-e31b38c8-f152-40dd-b7a1-24160fa0ab52 service nova] Creating event network-changed:b22086e3-8769-494c-af86-228dba7b3638 for instance 3af23ff8-4e10-4fbf-a86e-bda842f084ff on user Apr 13 16:40:58 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [req-19556248-8b76-4f7a-8724-f8eecdb047b9 req-e31b38c8-f152-40dd-b7a1-24160fa0ab52 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031511 Apr 13 16:40:58 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 281/840] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:40:58 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:40:59 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [req-b2a94289-90b1-4ec1-86e5-0e1f26d96f2e req-c82fd167-f3cb-4c3e-850d-c20d25bd80ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2d55cdd-c89c-4c59-afe1-49a33225af22", "name": "network-vif-plugged", "status": "completed", "tag": "31e1957f-9bd1-42ae-a2ac-954b49ca15f1"}]} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:40:59 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-b2a94289-90b1-4ec1-86e5-0e1f26d96f2e req-c82fd167-f3cb-4c3e-850d-c20d25bd80ae service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:40:59 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-b2a94289-90b1-4ec1-86e5-0e1f26d96f2e req-c82fd167-f3cb-4c3e-850d-c20d25bd80ae service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:40:59 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-b2a94289-90b1-4ec1-86e5-0e1f26d96f2e req-c82fd167-f3cb-4c3e-850d-c20d25bd80ae service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:40:59 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-b2a94289-90b1-4ec1-86e5-0e1f26d96f2e req-c82fd167-f3cb-4c3e-850d-c20d25bd80ae service nova] Creating event network-vif-plugged:31e1957f-9bd1-42ae-a2ac-954b49ca15f1 for instance b2d55cdd-c89c-4c59-afe1-49a33225af22 on user Apr 13 16:40:59 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [req-b2a94289-90b1-4ec1-86e5-0e1f26d96f2e req-c82fd167-f3cb-4c3e-850d-c20d25bd80ae service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105869 Apr 13 16:40:59 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 279/841] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:40:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:41:00 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-f1200931-62d4-4465-b698-b5a3d563561c req-ea7cde2e-29d1-4ae3-ab0c-1396730edbc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3af23ff8-4e10-4fbf-a86e-bda842f084ff", "name": "network-vif-plugged", "status": "completed", "tag": "b22086e3-8769-494c-af86-228dba7b3638"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:41:00 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-f1200931-62d4-4465-b698-b5a3d563561c req-ea7cde2e-29d1-4ae3-ab0c-1396730edbc4 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:41:00 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-f1200931-62d4-4465-b698-b5a3d563561c req-ea7cde2e-29d1-4ae3-ab0c-1396730edbc4 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:41:00 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-f1200931-62d4-4465-b698-b5a3d563561c req-ea7cde2e-29d1-4ae3-ab0c-1396730edbc4 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:41:00 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-f1200931-62d4-4465-b698-b5a3d563561c req-ea7cde2e-29d1-4ae3-ab0c-1396730edbc4 service nova] Creating event network-vif-plugged:b22086e3-8769-494c-af86-228dba7b3638 for instance 3af23ff8-4e10-4fbf-a86e-bda842f084ff on user Apr 13 16:41:00 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [req-f1200931-62d4-4465-b698-b5a3d563561c req-ea7cde2e-29d1-4ae3-ab0c-1396730edbc4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046249 Apr 13 16:41:00 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 282/842] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:41:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 16:41:01 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-9ada2fcb-9532-4036-b16d-f45d4941118b req-c800ab84-65c1-4e7d-afba-a74e8272e132 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2d55cdd-c89c-4c59-afe1-49a33225af22", "name": "network-vif-plugged", "status": "completed", "tag": "31e1957f-9bd1-42ae-a2ac-954b49ca15f1"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:41:01 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-9ada2fcb-9532-4036-b16d-f45d4941118b req-c800ab84-65c1-4e7d-afba-a74e8272e132 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:41:01 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-9ada2fcb-9532-4036-b16d-f45d4941118b req-c800ab84-65c1-4e7d-afba-a74e8272e132 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:41:01 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-9ada2fcb-9532-4036-b16d-f45d4941118b req-c800ab84-65c1-4e7d-afba-a74e8272e132 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:41:01 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-9ada2fcb-9532-4036-b16d-f45d4941118b req-c800ab84-65c1-4e7d-afba-a74e8272e132 service nova] Creating event network-vif-plugged:31e1957f-9bd1-42ae-a2ac-954b49ca15f1 for instance b2d55cdd-c89c-4c59-afe1-49a33225af22 on user Apr 13 16:41:01 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [req-9ada2fcb-9532-4036-b16d-f45d4941118b req-c800ab84-65c1-4e7d-afba-a74e8272e132 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031777 Apr 13 16:41:01 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 282/843] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:41:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:41:02 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [req-ba198230-d03b-44c5-beb9-08764fc9e66c req-1d16fe24-4589-4258-9982-5f3e2f23ac73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3af23ff8-4e10-4fbf-a86e-bda842f084ff", "name": "network-vif-plugged", "status": "completed", "tag": "b22086e3-8769-494c-af86-228dba7b3638"}]} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:41:02 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-ba198230-d03b-44c5-beb9-08764fc9e66c req-1d16fe24-4589-4258-9982-5f3e2f23ac73 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:41:02 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-ba198230-d03b-44c5-beb9-08764fc9e66c req-1d16fe24-4589-4258-9982-5f3e2f23ac73 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:41:02 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-ba198230-d03b-44c5-beb9-08764fc9e66c req-1d16fe24-4589-4258-9982-5f3e2f23ac73 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:41:02 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-ba198230-d03b-44c5-beb9-08764fc9e66c req-1d16fe24-4589-4258-9982-5f3e2f23ac73 service nova] Creating event network-vif-plugged:b22086e3-8769-494c-af86-228dba7b3638 for instance 3af23ff8-4e10-4fbf-a86e-bda842f084ff on user Apr 13 16:41:02 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [req-ba198230-d03b-44c5-beb9-08764fc9e66c req-1d16fe24-4589-4258-9982-5f3e2f23ac73 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041770 Apr 13 16:41:02 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 280/844] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:41:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:41:08 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_cell0:SELECT=2 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:41:08 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-2923de0a-7830-4400-a425-8c0df4d17bb0 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:41:08 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-2923de0a-7830-4400-a425-8c0df4d17bb0 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:41:08 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-2923de0a-7830-4400-a425-8c0df4d17bb0 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:41:08 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-2923de0a-7830-4400-a425-8c0df4d17bb0 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:41:08 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-2923de0a-7830-4400-a425-8c0df4d17bb0 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:41:08 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-2923de0a-7830-4400-a425-8c0df4d17bb0 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:41:08 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-2923de0a-7830-4400-a425-8c0df4d17bb0 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:41:08 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-2923de0a-7830-4400-a425-8c0df4d17bb0 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:41:08 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-2923de0a-7830-4400-a425-8c0df4d17bb0 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1f6a693f-0a99-434f-871d-f535b71229b9/os-interface" status: 200 len: 282 microversion: 2.20 time: 0.090022 Apr 13 16:41:08 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 283/845] 10.0.0.210 () {64 vars in 1393 bytes} [Thu Apr 13 16:41:08 2023] GET /compute/v2.1/servers/1f6a693f-0a99-434f-871d-f535b71229b9/os-interface => generated 282 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 13 16:41:08 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_cell0:SELECT=2 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:41:08 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_cell0:SELECT=6 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:41:08 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-1e3f758b-e538-49ef-8ae1-6529204885d5 req-e688a226-d9d7-4512-99d6-7dce75c82ada service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f6a693f-0a99-434f-871d-f535b71229b9", "tag": "103a0c68-ffc7-4460-836e-0de6c0272d84"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:41:08 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-1e3f758b-e538-49ef-8ae1-6529204885d5 req-e688a226-d9d7-4512-99d6-7dce75c82ada service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:41:08 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-1e3f758b-e538-49ef-8ae1-6529204885d5 req-e688a226-d9d7-4512-99d6-7dce75c82ada service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:41:08 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-1e3f758b-e538-49ef-8ae1-6529204885d5 req-e688a226-d9d7-4512-99d6-7dce75c82ada service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:41:08 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-1e3f758b-e538-49ef-8ae1-6529204885d5 req-e688a226-d9d7-4512-99d6-7dce75c82ada service nova] Creating event network-changed:103a0c68-ffc7-4460-836e-0de6c0272d84 for instance 1f6a693f-0a99-434f-871d-f535b71229b9 on user Apr 13 16:41:08 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [req-1e3f758b-e538-49ef-8ae1-6529204885d5 req-e688a226-d9d7-4512-99d6-7dce75c82ada service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051317 Apr 13 16:41:08 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 283/846] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:41:08 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:41:08 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-ae224039-5794-4d56-9140-cb50fc909515 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:41:08 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-ae224039-5794-4d56-9140-cb50fc909515 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:41:08 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_cell0:SELECT=2 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:41:08 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_cell0:SELECT=8 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:41:08 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-ae224039-5794-4d56-9140-cb50fc909515 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:41:08 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-ae224039-5794-4d56-9140-cb50fc909515 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:41:08 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-ae224039-5794-4d56-9140-cb50fc909515 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:41:08 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-ae224039-5794-4d56-9140-cb50fc909515 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:41:08 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-ae224039-5794-4d56-9140-cb50fc909515 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:41:08 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-ae224039-5794-4d56-9140-cb50fc909515 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:41:08 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-ae224039-5794-4d56-9140-cb50fc909515 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1f6a693f-0a99-434f-871d-f535b71229b9/ips" status: 200 len: 110 microversion: 2.20 time: 0.046245 Apr 13 16:41:08 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 281/847] 10.0.0.210 () {64 vars in 1366 bytes} [Thu Apr 13 16:41:08 2023] GET /compute/v2.1/servers/1f6a693f-0a99-434f-871d-f535b71229b9/ips => generated 110 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 16:41:10 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-436c60d2-89b1-445a-bfa9-ca49cf0543ed tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:41:10 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-436c60d2-89b1-445a-bfa9-ca49cf0543ed tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:41:10 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-436c60d2-89b1-445a-bfa9-ca49cf0543ed tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:41:10 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-436c60d2-89b1-445a-bfa9-ca49cf0543ed tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:41:10 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-436c60d2-89b1-445a-bfa9-ca49cf0543ed tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:41:10 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-436c60d2-89b1-445a-bfa9-ca49cf0543ed tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:41:10 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-436c60d2-89b1-445a-bfa9-ca49cf0543ed tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:41:10 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-436c60d2-89b1-445a-bfa9-ca49cf0543ed tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:41:10 user devstack@n-api.service[62053]: DEBUG nova.objects.instance [None req-436c60d2-89b1-445a-bfa9-ca49cf0543ed tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lazy-loading 'flavor' on Instance uuid 1f6a693f-0a99-434f-871d-f535b71229b9 {{(pid=62053) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 16:41:11 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-436c60d2-89b1-445a-bfa9-ca49cf0543ed tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] 10.0.0.210 "POST /compute/v2.1/servers/1f6a693f-0a99-434f-871d-f535b71229b9/action" status: 202 len: 0 microversion: 2.20 time: 0.893890 Apr 13 16:41:11 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 284/848] 10.0.0.210 () {66 vars in 1396 bytes} [Thu Apr 13 16:41:10 2023] POST /compute/v2.1/servers/1f6a693f-0a99-434f-871d-f535b71229b9/action => generated 0 bytes in 896 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 13 16:41:11 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-d35990c4-cb43-4f09-8d4d-b81cbbb8640f tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:41:11 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-d35990c4-cb43-4f09-8d4d-b81cbbb8640f tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:41:11 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-d35990c4-cb43-4f09-8d4d-b81cbbb8640f tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:41:11 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-d35990c4-cb43-4f09-8d4d-b81cbbb8640f tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:41:11 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-d35990c4-cb43-4f09-8d4d-b81cbbb8640f tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:41:11 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-d35990c4-cb43-4f09-8d4d-b81cbbb8640f tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:41:11 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-d35990c4-cb43-4f09-8d4d-b81cbbb8640f tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:41:11 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-d35990c4-cb43-4f09-8d4d-b81cbbb8640f tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:41:11 user devstack@n-api.service[62054]: DEBUG nova.policy [None req-d35990c4-cb43-4f09-8d4d-b81cbbb8640f tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b4e972cd1049509fa899449961ab59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0653ab16660b46cea9c5af58ea0b1931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62054) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:41:11 user devstack@n-api.service[62054]: DEBUG nova.policy [None req-d35990c4-cb43-4f09-8d4d-b81cbbb8640f tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48b4e972cd1049509fa899449961ab59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0653ab16660b46cea9c5af58ea0b1931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62054) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:41:11 user devstack@n-api.service[62054]: DEBUG nova.policy [None req-d35990c4-cb43-4f09-8d4d-b81cbbb8640f tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48b4e972cd1049509fa899449961ab59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0653ab16660b46cea9c5af58ea0b1931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62054) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:41:11 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-d35990c4-cb43-4f09-8d4d-b81cbbb8640f tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1f6a693f-0a99-434f-871d-f535b71229b9" status: 200 len: 1711 microversion: 2.20 time: 0.196887 Apr 13 16:41:11 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 284/849] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 16:41:11 2023] GET /compute/v2.1/servers/1f6a693f-0a99-434f-871d-f535b71229b9 => generated 1711 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 16:41:11 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [req-ed3f85c0-2768-4535-895f-4c6c01a05e54 req-05801a80-a91c-4cfa-8a43-59d210efff3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f6a693f-0a99-434f-871d-f535b71229b9", "name": "network-vif-unplugged", "status": "completed", "tag": "103a0c68-ffc7-4460-836e-0de6c0272d84"}]} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:41:11 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-ed3f85c0-2768-4535-895f-4c6c01a05e54 req-05801a80-a91c-4cfa-8a43-59d210efff3f service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:41:11 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-ed3f85c0-2768-4535-895f-4c6c01a05e54 req-05801a80-a91c-4cfa-8a43-59d210efff3f service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:41:11 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-ed3f85c0-2768-4535-895f-4c6c01a05e54 req-05801a80-a91c-4cfa-8a43-59d210efff3f service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:41:11 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-ed3f85c0-2768-4535-895f-4c6c01a05e54 req-05801a80-a91c-4cfa-8a43-59d210efff3f service nova] Creating event network-vif-unplugged:103a0c68-ffc7-4460-836e-0de6c0272d84 for instance 1f6a693f-0a99-434f-871d-f535b71229b9 on user Apr 13 16:41:11 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [req-ed3f85c0-2768-4535-895f-4c6c01a05e54 req-05801a80-a91c-4cfa-8a43-59d210efff3f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030101 Apr 13 16:41:11 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 282/850] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:41:11 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:41:13 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-44bc59b5-30e5-4aea-bb16-2bc553b3fef5 req-85a83c3a-02b3-498a-a322-f0fa9e4f30c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f6a693f-0a99-434f-871d-f535b71229b9", "name": "network-vif-plugged", "status": "completed", "tag": "103a0c68-ffc7-4460-836e-0de6c0272d84"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:41:13 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-44bc59b5-30e5-4aea-bb16-2bc553b3fef5 req-85a83c3a-02b3-498a-a322-f0fa9e4f30c2 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:41:13 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-44bc59b5-30e5-4aea-bb16-2bc553b3fef5 req-85a83c3a-02b3-498a-a322-f0fa9e4f30c2 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:41:13 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-44bc59b5-30e5-4aea-bb16-2bc553b3fef5 req-85a83c3a-02b3-498a-a322-f0fa9e4f30c2 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:41:13 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-44bc59b5-30e5-4aea-bb16-2bc553b3fef5 req-85a83c3a-02b3-498a-a322-f0fa9e4f30c2 service nova] Creating event network-vif-plugged:103a0c68-ffc7-4460-836e-0de6c0272d84 for instance 1f6a693f-0a99-434f-871d-f535b71229b9 on user Apr 13 16:41:13 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [req-44bc59b5-30e5-4aea-bb16-2bc553b3fef5 req-85a83c3a-02b3-498a-a322-f0fa9e4f30c2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035795 Apr 13 16:41:13 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 285/851] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:41:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:41:16 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-5a9d47fd-03e6-41f6-8bdb-d8d9eb39ac6d req-67930121-0741-431c-bf1b-d77c3e35d6e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f6a693f-0a99-434f-871d-f535b71229b9", "tag": "103a0c68-ffc7-4460-836e-0de6c0272d84"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:41:16 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-5a9d47fd-03e6-41f6-8bdb-d8d9eb39ac6d req-67930121-0741-431c-bf1b-d77c3e35d6e9 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:41:16 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-5a9d47fd-03e6-41f6-8bdb-d8d9eb39ac6d req-67930121-0741-431c-bf1b-d77c3e35d6e9 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:41:16 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-5a9d47fd-03e6-41f6-8bdb-d8d9eb39ac6d req-67930121-0741-431c-bf1b-d77c3e35d6e9 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:41:16 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-5a9d47fd-03e6-41f6-8bdb-d8d9eb39ac6d req-67930121-0741-431c-bf1b-d77c3e35d6e9 service nova] Creating event network-changed:103a0c68-ffc7-4460-836e-0de6c0272d84 for instance 1f6a693f-0a99-434f-871d-f535b71229b9 on user Apr 13 16:41:16 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [req-5a9d47fd-03e6-41f6-8bdb-d8d9eb39ac6d req-67930121-0741-431c-bf1b-d77c3e35d6e9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028915 Apr 13 16:41:16 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 285/852] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:41:16 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:41:44 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=3 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:41:44 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_cell1:SELECT=12 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:41:44 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-cc52971d-8ca2-4a10-b397-ef00ad9dc17b tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:41:44 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-cc52971d-8ca2-4a10-b397-ef00ad9dc17b tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: 3af23ff8-4e10-4fbf-a86e-bda842f084ff] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:41:44 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-cc52971d-8ca2-4a10-b397-ef00ad9dc17b tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:41:44 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-cc52971d-8ca2-4a10-b397-ef00ad9dc17b tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:41:44 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-cc52971d-8ca2-4a10-b397-ef00ad9dc17b tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:41:44 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-cc52971d-8ca2-4a10-b397-ef00ad9dc17b tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:41:44 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-cc52971d-8ca2-4a10-b397-ef00ad9dc17b tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:41:44 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-cc52971d-8ca2-4a10-b397-ef00ad9dc17b tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:41:44 user devstack@n-api.service[62055]: DEBUG nova.policy [None req-cc52971d-8ca2-4a10-b397-ef00ad9dc17b tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c7f54723c494e05ada117353c0790cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '846732ecb7e047128b4684972d3cd8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62055) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:41:44 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-cc52971d-8ca2-4a10-b397-ef00ad9dc17b tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3af23ff8-4e10-4fbf-a86e-bda842f084ff" status: 200 len: 1504 microversion: 2.1 time: 0.171472 Apr 13 16:41:44 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 283/853] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:41:44 2023] GET /compute/v2.1/servers/3af23ff8-4e10-4fbf-a86e-bda842f084ff => generated 1504 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:41:46 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_api:SELECT=14 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:41:46 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:41:46 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-d01ccd5c-a9c9-4f89-8039-6504357d0306 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:41:46 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-d01ccd5c-a9c9-4f89-8039-6504357d0306 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:41:46 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-d01ccd5c-a9c9-4f89-8039-6504357d0306 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:41:46 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-d01ccd5c-a9c9-4f89-8039-6504357d0306 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:41:46 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-d01ccd5c-a9c9-4f89-8039-6504357d0306 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:41:46 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-d01ccd5c-a9c9-4f89-8039-6504357d0306 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:41:46 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-d01ccd5c-a9c9-4f89-8039-6504357d0306 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:41:46 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-d01ccd5c-a9c9-4f89-8039-6504357d0306 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:41:47 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-d01ccd5c-a9c9-4f89-8039-6504357d0306 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7ae7d3d9-54f7-4c64-8bf6-08fa5c526687/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.107957 Apr 13 16:41:47 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 286/854] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 13 16:41:46 2023] GET /compute/v2.1/servers/7ae7d3d9-54f7-4c64-8bf6-08fa5c526687/os-interface => generated 283 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:41:47 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=3 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:41:47 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_cell1:SELECT=22 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:41:47 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-1f52b2b7-e3ca-4d00-9aa3-f1d23464e2a7 req-15ce18ce-7078-4aae-aad6-b0f19f312294 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ed800fe-577d-4624-898c-c7f40da77376", "tag": "09531419-c0ff-4d13-89bd-06caa28e019d"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:41:47 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-1f52b2b7-e3ca-4d00-9aa3-f1d23464e2a7 req-15ce18ce-7078-4aae-aad6-b0f19f312294 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:41:47 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-1f52b2b7-e3ca-4d00-9aa3-f1d23464e2a7 req-15ce18ce-7078-4aae-aad6-b0f19f312294 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:41:47 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-1f52b2b7-e3ca-4d00-9aa3-f1d23464e2a7 req-15ce18ce-7078-4aae-aad6-b0f19f312294 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:41:47 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-1f52b2b7-e3ca-4d00-9aa3-f1d23464e2a7 req-15ce18ce-7078-4aae-aad6-b0f19f312294 service nova] Creating event network-changed:09531419-c0ff-4d13-89bd-06caa28e019d for instance 5ed800fe-577d-4624-898c-c7f40da77376 on user Apr 13 16:41:47 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-c0ce8e9c-515e-4220-88a4-93dfdcdf02e7 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:41:47 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-c0ce8e9c-515e-4220-88a4-93dfdcdf02e7 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:41:47 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [req-1f52b2b7-e3ca-4d00-9aa3-f1d23464e2a7 req-15ce18ce-7078-4aae-aad6-b0f19f312294 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034645 Apr 13 16:41:47 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 286/855] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:41:47 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:41:47 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-c0ce8e9c-515e-4220-88a4-93dfdcdf02e7 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:41:47 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-c0ce8e9c-515e-4220-88a4-93dfdcdf02e7 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:41:47 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-c0ce8e9c-515e-4220-88a4-93dfdcdf02e7 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:41:47 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-c0ce8e9c-515e-4220-88a4-93dfdcdf02e7 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:41:47 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-c0ce8e9c-515e-4220-88a4-93dfdcdf02e7 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:41:47 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-c0ce8e9c-515e-4220-88a4-93dfdcdf02e7 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:41:47 user devstack@n-api.service[62055]: DEBUG nova.policy [None req-c0ce8e9c-515e-4220-88a4-93dfdcdf02e7 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b3df1c5c5d441819bcef89ed6966815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980559734a504574a83224deb7423c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62055) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:41:47 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-c0ce8e9c-515e-4220-88a4-93dfdcdf02e7 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7ae7d3d9-54f7-4c64-8bf6-08fa5c526687" status: 200 len: 1429 microversion: 2.1 time: 0.151139 Apr 13 16:41:47 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 284/856] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:41:47 2023] GET /compute/v2.1/servers/7ae7d3d9-54f7-4c64-8bf6-08fa5c526687 => generated 1429 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:41:47 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "84"}} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:41:47 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:41:47 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:41:47 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:41:47 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:41:47 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:41:47 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:41:47 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:41:48 user devstack@n-api.service[62053]: DEBUG nova.policy [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '1b3df1c5c5d441819bcef89ed6966815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980559734a504574a83224deb7423c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62053) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:41:48 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Old instance type m1.nano, new instance type m1.micro {{(pid=62053) resize /opt/stack/nova/nova/compute/api.py:4223}} Apr 13 16:41:48 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:41:48 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:41:48 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:41:48 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:41:48 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:41:48 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:41:48 user devstack@n-api.service[62053]: DEBUG nova.quota [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Getting quotas for project 980559734a504574a83224deb7423c77. Resources: {'cores', 'ram'} {{(pid=62053) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 16:41:48 user devstack@n-api.service[62053]: DEBUG nova.quota [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Getting quotas for user 1b3df1c5c5d441819bcef89ed6966815 and project 980559734a504574a83224deb7423c77. Resources: {'cores', 'ram'} {{(pid=62053) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 16:41:48 user devstack@n-api.service[62053]: DEBUG nova.virt.hardware [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Flavor limits 0:0:0 {{(pid=62053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 16:41:48 user devstack@n-api.service[62053]: DEBUG nova.virt.hardware [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Image limits 0:0:0 {{(pid=62053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 16:41:48 user devstack@n-api.service[62053]: DEBUG nova.virt.hardware [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Flavor pref 0:0:0 {{(pid=62053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 16:41:48 user devstack@n-api.service[62053]: DEBUG nova.virt.hardware [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Image pref 0:0:0 {{(pid=62053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 16:41:48 user devstack@n-api.service[62053]: DEBUG nova.virt.hardware [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 16:41:48 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] 10.0.0.210 "POST /compute/v2.1/servers/7ae7d3d9-54f7-4c64-8bf6-08fa5c526687/action" status: 202 len: 0 microversion: 2.1 time: 0.406960 Apr 13 16:41:48 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 287/857] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 16:41:47 2023] POST /compute/v2.1/servers/7ae7d3d9-54f7-4c64-8bf6-08fa5c526687/action => generated 0 bytes in 409 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 16:41:48 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-b2e85b0f-ceb9-4611-aab7-902b0b219249 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:41:48 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-b2e85b0f-ceb9-4611-aab7-902b0b219249 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:41:48 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-b2e85b0f-ceb9-4611-aab7-902b0b219249 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:41:48 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-b2e85b0f-ceb9-4611-aab7-902b0b219249 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:41:48 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-b2e85b0f-ceb9-4611-aab7-902b0b219249 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:41:48 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-b2e85b0f-ceb9-4611-aab7-902b0b219249 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:41:48 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-b2e85b0f-ceb9-4611-aab7-902b0b219249 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:41:48 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-b2e85b0f-ceb9-4611-aab7-902b0b219249 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:41:48 user devstack@n-api.service[62054]: DEBUG nova.policy [None req-b2e85b0f-ceb9-4611-aab7-902b0b219249 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b3df1c5c5d441819bcef89ed6966815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980559734a504574a83224deb7423c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62054) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:41:48 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-b2e85b0f-ceb9-4611-aab7-902b0b219249 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7ae7d3d9-54f7-4c64-8bf6-08fa5c526687" status: 200 len: 1438 microversion: 2.1 time: 0.195615 Apr 13 16:41:48 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 287/858] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:41:48 2023] GET /compute/v2.1/servers/7ae7d3d9-54f7-4c64-8bf6-08fa5c526687 => generated 1438 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:41:49 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [req-e829f5da-018d-40e2-a9e1-e073388ffc43 req-4cab42f8-f379-4250-bd89-40c48098f545 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ae7d3d9-54f7-4c64-8bf6-08fa5c526687", "tag": "f7ec2f7f-f505-44ed-b40d-7b91b2248cea"}]} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:41:49 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-e829f5da-018d-40e2-a9e1-e073388ffc43 req-4cab42f8-f379-4250-bd89-40c48098f545 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:41:49 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-e829f5da-018d-40e2-a9e1-e073388ffc43 req-4cab42f8-f379-4250-bd89-40c48098f545 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:41:49 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-e829f5da-018d-40e2-a9e1-e073388ffc43 req-4cab42f8-f379-4250-bd89-40c48098f545 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:41:49 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-e829f5da-018d-40e2-a9e1-e073388ffc43 req-4cab42f8-f379-4250-bd89-40c48098f545 service nova] Creating event network-changed:f7ec2f7f-f505-44ed-b40d-7b91b2248cea for instance 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687 on user Apr 13 16:41:49 user devstack@n-api.service[62055]: DEBUG nova.compute.api [req-e829f5da-018d-40e2-a9e1-e073388ffc43 req-4cab42f8-f379-4250-bd89-40c48098f545 service nova] Instance 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=62055) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 13 16:41:49 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [req-e829f5da-018d-40e2-a9e1-e073388ffc43 req-4cab42f8-f379-4250-bd89-40c48098f545 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036466 Apr 13 16:41:49 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 285/859] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:41:49 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:41:50 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-0d4e5df9-4d5b-4c3c-a3da-dd57fe6f9f05 req-39760b5f-9a26-4eef-879f-cacd0b76f046 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ae7d3d9-54f7-4c64-8bf6-08fa5c526687", "name": "network-vif-unplugged", "status": "completed", "tag": "f7ec2f7f-f505-44ed-b40d-7b91b2248cea"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:41:50 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-0d4e5df9-4d5b-4c3c-a3da-dd57fe6f9f05 req-39760b5f-9a26-4eef-879f-cacd0b76f046 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:41:50 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-0d4e5df9-4d5b-4c3c-a3da-dd57fe6f9f05 req-39760b5f-9a26-4eef-879f-cacd0b76f046 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:41:50 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-0d4e5df9-4d5b-4c3c-a3da-dd57fe6f9f05 req-39760b5f-9a26-4eef-879f-cacd0b76f046 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:41:50 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-0d4e5df9-4d5b-4c3c-a3da-dd57fe6f9f05 req-39760b5f-9a26-4eef-879f-cacd0b76f046 service nova] Creating event network-vif-unplugged:f7ec2f7f-f505-44ed-b40d-7b91b2248cea for instance 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687 on user Apr 13 16:41:50 user devstack@n-api.service[62053]: DEBUG nova.compute.api [req-0d4e5df9-4d5b-4c3c-a3da-dd57fe6f9f05 req-39760b5f-9a26-4eef-879f-cacd0b76f046 service nova] Instance 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=62053) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 13 16:41:50 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [req-0d4e5df9-4d5b-4c3c-a3da-dd57fe6f9f05 req-39760b5f-9a26-4eef-879f-cacd0b76f046 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047173 Apr 13 16:41:50 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 288/860] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:41:50 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:41:52 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-fab76706-bed1-4e78-b490-c0218e44ff67 req-ce997434-4e71-4f11-aaf1-01816f210cf0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ae7d3d9-54f7-4c64-8bf6-08fa5c526687", "name": "network-vif-plugged", "status": "completed", "tag": "f7ec2f7f-f505-44ed-b40d-7b91b2248cea"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:41:52 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-fab76706-bed1-4e78-b490-c0218e44ff67 req-ce997434-4e71-4f11-aaf1-01816f210cf0 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:41:52 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-fab76706-bed1-4e78-b490-c0218e44ff67 req-ce997434-4e71-4f11-aaf1-01816f210cf0 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:41:52 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-fab76706-bed1-4e78-b490-c0218e44ff67 req-ce997434-4e71-4f11-aaf1-01816f210cf0 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:41:52 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-fab76706-bed1-4e78-b490-c0218e44ff67 req-ce997434-4e71-4f11-aaf1-01816f210cf0 service nova] Creating event network-vif-plugged:f7ec2f7f-f505-44ed-b40d-7b91b2248cea for instance 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687 on user Apr 13 16:41:52 user devstack@n-api.service[62054]: DEBUG nova.compute.api [req-fab76706-bed1-4e78-b490-c0218e44ff67 req-ce997434-4e71-4f11-aaf1-01816f210cf0 service nova] Instance 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=62054) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 13 16:41:52 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [req-fab76706-bed1-4e78-b490-c0218e44ff67 req-ce997434-4e71-4f11-aaf1-01816f210cf0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038865 Apr 13 16:41:52 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 288/861] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:41:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:42:00 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_api:SELECT=6 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:42:00 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_cell1:SELECT=16 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:42:00 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [req-ee7254a5-b8f3-497a-89da-806265541af4 req-81e09609-e13f-47b3-a7a2-4f06f180d4bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ae7d3d9-54f7-4c64-8bf6-08fa5c526687", "name": "network-vif-plugged", "status": "completed", "tag": "f7ec2f7f-f505-44ed-b40d-7b91b2248cea"}]} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:42:00 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-ee7254a5-b8f3-497a-89da-806265541af4 req-81e09609-e13f-47b3-a7a2-4f06f180d4bf service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:42:00 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-ee7254a5-b8f3-497a-89da-806265541af4 req-81e09609-e13f-47b3-a7a2-4f06f180d4bf service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:42:00 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-ee7254a5-b8f3-497a-89da-806265541af4 req-81e09609-e13f-47b3-a7a2-4f06f180d4bf service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:42:00 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-ee7254a5-b8f3-497a-89da-806265541af4 req-81e09609-e13f-47b3-a7a2-4f06f180d4bf service nova] Creating event network-vif-plugged:f7ec2f7f-f505-44ed-b40d-7b91b2248cea for instance 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687 on user Apr 13 16:42:00 user devstack@n-api.service[62055]: DEBUG nova.compute.api [req-ee7254a5-b8f3-497a-89da-806265541af4 req-81e09609-e13f-47b3-a7a2-4f06f180d4bf service nova] Instance 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=62055) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 13 16:42:00 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [req-ee7254a5-b8f3-497a-89da-806265541af4 req-81e09609-e13f-47b3-a7a2-4f06f180d4bf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080925 Apr 13 16:42:00 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 286/862] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:42:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:42:01 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-4258b311-0f1d-425b-804a-86e15674f009 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:42:01 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-4258b311-0f1d-425b-804a-86e15674f009 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:42:01 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_cell0:SELECT=3 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:42:01 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_api:SELECT=18 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:42:01 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:42:01 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-4258b311-0f1d-425b-804a-86e15674f009 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:42:01 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-4258b311-0f1d-425b-804a-86e15674f009 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:42:01 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-4258b311-0f1d-425b-804a-86e15674f009 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:42:01 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-4258b311-0f1d-425b-804a-86e15674f009 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:42:01 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-4258b311-0f1d-425b-804a-86e15674f009 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:42:01 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-4258b311-0f1d-425b-804a-86e15674f009 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:42:01 user devstack@n-api.service[62053]: DEBUG nova.policy [None req-4258b311-0f1d-425b-804a-86e15674f009 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b4e972cd1049509fa899449961ab59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0653ab16660b46cea9c5af58ea0b1931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62053) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:42:01 user devstack@n-api.service[62053]: DEBUG nova.policy [None req-4258b311-0f1d-425b-804a-86e15674f009 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48b4e972cd1049509fa899449961ab59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0653ab16660b46cea9c5af58ea0b1931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62053) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:42:01 user devstack@n-api.service[62053]: DEBUG nova.policy [None req-4258b311-0f1d-425b-804a-86e15674f009 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48b4e972cd1049509fa899449961ab59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0653ab16660b46cea9c5af58ea0b1931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62053) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:42:01 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-4258b311-0f1d-425b-804a-86e15674f009 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1f6a693f-0a99-434f-871d-f535b71229b9" status: 200 len: 1652 microversion: 2.20 time: 0.164681 Apr 13 16:42:01 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 289/863] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 16:42:01 2023] GET /compute/v2.1/servers/1f6a693f-0a99-434f-871d-f535b71229b9 => generated 1652 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 16:42:02 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_api:SELECT=6 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:42:02 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_cell1:SELECT=12 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:42:02 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-0b356f5d-410e-4dac-bcdb-2b5895159777 req-9a390334-563f-4752-aef4-3bb30bd93b9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ae7d3d9-54f7-4c64-8bf6-08fa5c526687", "name": "network-vif-plugged", "status": "completed", "tag": "f7ec2f7f-f505-44ed-b40d-7b91b2248cea"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:42:02 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-0b356f5d-410e-4dac-bcdb-2b5895159777 req-9a390334-563f-4752-aef4-3bb30bd93b9b service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:42:02 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-0b356f5d-410e-4dac-bcdb-2b5895159777 req-9a390334-563f-4752-aef4-3bb30bd93b9b service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:42:02 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-0b356f5d-410e-4dac-bcdb-2b5895159777 req-9a390334-563f-4752-aef4-3bb30bd93b9b service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:42:02 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-0b356f5d-410e-4dac-bcdb-2b5895159777 req-9a390334-563f-4752-aef4-3bb30bd93b9b service nova] Creating event network-vif-plugged:f7ec2f7f-f505-44ed-b40d-7b91b2248cea for instance 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687 on user Apr 13 16:42:02 user devstack@n-api.service[62054]: DEBUG nova.compute.api [req-0b356f5d-410e-4dac-bcdb-2b5895159777 req-9a390334-563f-4752-aef4-3bb30bd93b9b service nova] Instance 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=62054) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 13 16:42:02 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [req-0b356f5d-410e-4dac-bcdb-2b5895159777 req-9a390334-563f-4752-aef4-3bb30bd93b9b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044317 Apr 13 16:42:02 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 289/864] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:42:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:42:38 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_api:SELECT=2 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:42:38 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_cell1:SELECT=4 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:42:38 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-5e1a839d-9988-4d91-9a98-8ae12e0f75a7 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:42:38 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-5e1a839d-9988-4d91-9a98-8ae12e0f75a7 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:42:38 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-5e1a839d-9988-4d91-9a98-8ae12e0f75a7 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:42:38 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-5e1a839d-9988-4d91-9a98-8ae12e0f75a7 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:42:38 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-5e1a839d-9988-4d91-9a98-8ae12e0f75a7 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:42:38 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-5e1a839d-9988-4d91-9a98-8ae12e0f75a7 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:42:38 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-5e1a839d-9988-4d91-9a98-8ae12e0f75a7 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:42:38 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-5e1a839d-9988-4d91-9a98-8ae12e0f75a7 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:42:38 user devstack@n-api.service[62055]: DEBUG nova.policy [None req-5e1a839d-9988-4d91-9a98-8ae12e0f75a7 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b3df1c5c5d441819bcef89ed6966815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980559734a504574a83224deb7423c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62055) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:42:38 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-5e1a839d-9988-4d91-9a98-8ae12e0f75a7 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7ae7d3d9-54f7-4c64-8bf6-08fa5c526687" status: 200 len: 1556 microversion: 2.1 time: 0.173443 Apr 13 16:42:38 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 287/865] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:42:38 2023] GET /compute/v2.1/servers/7ae7d3d9-54f7-4c64-8bf6-08fa5c526687 => generated 1556 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:42:44 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-6c862c76-8963-4133-b42b-433cf3ec8a8e tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:42:44 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-6c862c76-8963-4133-b42b-433cf3ec8a8e tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: 3af23ff8-4e10-4fbf-a86e-bda842f084ff] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:42:44 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_api:SELECT=2 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:42:44 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_cell1:SELECT=6 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:42:44 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-6c862c76-8963-4133-b42b-433cf3ec8a8e tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:42:44 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-6c862c76-8963-4133-b42b-433cf3ec8a8e tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:42:44 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-6c862c76-8963-4133-b42b-433cf3ec8a8e tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:42:44 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-6c862c76-8963-4133-b42b-433cf3ec8a8e tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:42:44 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-6c862c76-8963-4133-b42b-433cf3ec8a8e tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:42:44 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-6c862c76-8963-4133-b42b-433cf3ec8a8e tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:42:44 user devstack@n-api.service[62053]: DEBUG nova.objects.instance [None req-6c862c76-8963-4133-b42b-433cf3ec8a8e tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lazy-loading 'flavor' on Instance uuid 3af23ff8-4e10-4fbf-a86e-bda842f084ff {{(pid=62053) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 16:42:44 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-6c862c76-8963-4133-b42b-433cf3ec8a8e tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] 10.0.0.210 "POST /compute/v2.1/servers/3af23ff8-4e10-4fbf-a86e-bda842f084ff/action" status: 200 len: 32 microversion: 2.1 time: 0.108574 Apr 13 16:42:44 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 290/866] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 16:42:44 2023] POST /compute/v2.1/servers/3af23ff8-4e10-4fbf-a86e-bda842f084ff/action => generated 32 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 16:42:44 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_api:SELECT=2 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:42:44 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_cell1:SELECT=4 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:42:44 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-1a7c4e3e-577d-436c-8804-25acc4088aa2 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:42:44 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-1a7c4e3e-577d-436c-8804-25acc4088aa2 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: 3af23ff8-4e10-4fbf-a86e-bda842f084ff] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:42:44 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-1a7c4e3e-577d-436c-8804-25acc4088aa2 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:42:44 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-1a7c4e3e-577d-436c-8804-25acc4088aa2 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:42:44 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-1a7c4e3e-577d-436c-8804-25acc4088aa2 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:42:44 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-1a7c4e3e-577d-436c-8804-25acc4088aa2 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:42:44 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-1a7c4e3e-577d-436c-8804-25acc4088aa2 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:42:44 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-1a7c4e3e-577d-436c-8804-25acc4088aa2 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:42:44 user devstack@n-api.service[62054]: DEBUG nova.policy [None req-1a7c4e3e-577d-436c-8804-25acc4088aa2 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c7f54723c494e05ada117353c0790cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '846732ecb7e047128b4684972d3cd8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62054) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:42:44 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-1a7c4e3e-577d-436c-8804-25acc4088aa2 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3af23ff8-4e10-4fbf-a86e-bda842f084ff" status: 200 len: 1510 microversion: 2.1 time: 0.154354 Apr 13 16:42:44 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 290/867] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:42:44 2023] GET /compute/v2.1/servers/3af23ff8-4e10-4fbf-a86e-bda842f084ff => generated 1510 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:42:45 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [req-21df2e4c-876d-4ff0-a654-dc22bd1a4cf2 req-ff65329d-73ae-42ca-8ec7-2bb3de87c532 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3af23ff8-4e10-4fbf-a86e-bda842f084ff", "name": "network-vif-unplugged", "status": "completed", "tag": "b22086e3-8769-494c-af86-228dba7b3638"}]} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:42:45 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-21df2e4c-876d-4ff0-a654-dc22bd1a4cf2 req-ff65329d-73ae-42ca-8ec7-2bb3de87c532 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:42:45 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-21df2e4c-876d-4ff0-a654-dc22bd1a4cf2 req-ff65329d-73ae-42ca-8ec7-2bb3de87c532 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:42:45 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-21df2e4c-876d-4ff0-a654-dc22bd1a4cf2 req-ff65329d-73ae-42ca-8ec7-2bb3de87c532 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:42:45 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-21df2e4c-876d-4ff0-a654-dc22bd1a4cf2 req-ff65329d-73ae-42ca-8ec7-2bb3de87c532 service nova] Creating event network-vif-unplugged:b22086e3-8769-494c-af86-228dba7b3638 for instance 3af23ff8-4e10-4fbf-a86e-bda842f084ff on user Apr 13 16:42:45 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [req-21df2e4c-876d-4ff0-a654-dc22bd1a4cf2 req-ff65329d-73ae-42ca-8ec7-2bb3de87c532 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.097853 Apr 13 16:42:45 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 288/868] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:42:45 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:42:47 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-b8c40b63-f1ca-4f9c-8b96-9428f98c98e0 req-0faed5cd-7689-4f3c-9f25-3c0f0ca2245b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3af23ff8-4e10-4fbf-a86e-bda842f084ff", "name": "network-vif-plugged", "status": "completed", "tag": "b22086e3-8769-494c-af86-228dba7b3638"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:42:47 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-b8c40b63-f1ca-4f9c-8b96-9428f98c98e0 req-0faed5cd-7689-4f3c-9f25-3c0f0ca2245b service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:42:47 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-b8c40b63-f1ca-4f9c-8b96-9428f98c98e0 req-0faed5cd-7689-4f3c-9f25-3c0f0ca2245b service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:42:47 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-b8c40b63-f1ca-4f9c-8b96-9428f98c98e0 req-0faed5cd-7689-4f3c-9f25-3c0f0ca2245b service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:42:47 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-b8c40b63-f1ca-4f9c-8b96-9428f98c98e0 req-0faed5cd-7689-4f3c-9f25-3c0f0ca2245b service nova] Creating event network-vif-plugged:b22086e3-8769-494c-af86-228dba7b3638 for instance 3af23ff8-4e10-4fbf-a86e-bda842f084ff on user Apr 13 16:42:47 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [req-b8c40b63-f1ca-4f9c-8b96-9428f98c98e0 req-0faed5cd-7689-4f3c-9f25-3c0f0ca2245b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043982 Apr 13 16:42:47 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 291/869] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:42:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:42:49 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-ed7259f0-cc25-4918-88a9-7b1fdbe71751 req-88a4f5d6-68ba-4f66-83c3-bfc96d11a6f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3af23ff8-4e10-4fbf-a86e-bda842f084ff", "name": "network-vif-plugged", "status": "completed", "tag": "b22086e3-8769-494c-af86-228dba7b3638"}, {"server_uuid": "3af23ff8-4e10-4fbf-a86e-bda842f084ff", "name": "network-vif-plugged", "status": "completed", "tag": "b22086e3-8769-494c-af86-228dba7b3638"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:42:49 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-ed7259f0-cc25-4918-88a9-7b1fdbe71751 req-88a4f5d6-68ba-4f66-83c3-bfc96d11a6f5 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:42:49 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-ed7259f0-cc25-4918-88a9-7b1fdbe71751 req-88a4f5d6-68ba-4f66-83c3-bfc96d11a6f5 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:42:49 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-ed7259f0-cc25-4918-88a9-7b1fdbe71751 req-88a4f5d6-68ba-4f66-83c3-bfc96d11a6f5 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:42:49 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-ed7259f0-cc25-4918-88a9-7b1fdbe71751 req-88a4f5d6-68ba-4f66-83c3-bfc96d11a6f5 service nova] Creating event network-vif-plugged:b22086e3-8769-494c-af86-228dba7b3638 for instance 3af23ff8-4e10-4fbf-a86e-bda842f084ff on user Apr 13 16:42:49 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-ed7259f0-cc25-4918-88a9-7b1fdbe71751 req-88a4f5d6-68ba-4f66-83c3-bfc96d11a6f5 service nova] Creating event network-vif-plugged:b22086e3-8769-494c-af86-228dba7b3638 for instance 3af23ff8-4e10-4fbf-a86e-bda842f084ff on user Apr 13 16:42:49 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [req-ed7259f0-cc25-4918-88a9-7b1fdbe71751 req-88a4f5d6-68ba-4f66-83c3-bfc96d11a6f5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.050625 Apr 13 16:42:49 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 291/870] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:42:49 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:43:01 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_api:SELECT=4 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:43:01 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_cell1:SELECT=8 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:43:01 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-00e08e25-897f-4320-bce2-9487514a9212 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e928ff18-7a8f-4f9d-8c9f-8339661f9d2d"}} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:43:01 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-00e08e25-897f-4320-bce2-9487514a9212 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:43:01 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-00e08e25-897f-4320-bce2-9487514a9212 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:43:01 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-00e08e25-897f-4320-bce2-9487514a9212 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:43:01 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-00e08e25-897f-4320-bce2-9487514a9212 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:43:01 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-00e08e25-897f-4320-bce2-9487514a9212 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:43:01 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-00e08e25-897f-4320-bce2-9487514a9212 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:43:01 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-00e08e25-897f-4320-bce2-9487514a9212 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:43:02 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-00e08e25-897f-4320-bce2-9487514a9212 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] 10.0.0.210 "POST /compute/v2.1/servers/1f6a693f-0a99-434f-871d-f535b71229b9/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.463012 Apr 13 16:43:02 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 289/871] 10.0.0.210 () {66 vars in 1441 bytes} [Thu Apr 13 16:43:01 2023] POST /compute/v2.1/servers/1f6a693f-0a99-434f-871d-f535b71229b9/os-volume_attachments => generated 188 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 16:43:02 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-a0e20608-f143-4803-a9b5-5c00ce784d16 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:43:02 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-a0e20608-f143-4803-a9b5-5c00ce784d16 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:43:02 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_api:SELECT=4 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:43:02 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:43:02 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-a0e20608-f143-4803-a9b5-5c00ce784d16 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:43:02 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-a0e20608-f143-4803-a9b5-5c00ce784d16 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:43:02 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-a0e20608-f143-4803-a9b5-5c00ce784d16 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:43:02 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-a0e20608-f143-4803-a9b5-5c00ce784d16 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:43:02 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-a0e20608-f143-4803-a9b5-5c00ce784d16 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:43:02 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-a0e20608-f143-4803-a9b5-5c00ce784d16 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:43:02 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-a0e20608-f143-4803-a9b5-5c00ce784d16 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1f6a693f-0a99-434f-871d-f535b71229b9/os-volume_attachments/e928ff18-7a8f-4f9d-8c9f-8339661f9d2d" status: 202 len: 0 microversion: 2.20 time: 0.278774 Apr 13 16:43:02 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 292/872] 10.0.0.210 () {64 vars in 1534 bytes} [Thu Apr 13 16:43:02 2023] DELETE /compute/v2.1/servers/1f6a693f-0a99-434f-871d-f535b71229b9/os-volume_attachments/e928ff18-7a8f-4f9d-8c9f-8339661f9d2d => generated 0 bytes in 280 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 13 16:43:02 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_api:SELECT=4 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:43:02 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_cell1:SELECT=8 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:43:02 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-6348272b-4031-482d-8d50-de9374f80de9 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:43:02 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-6348272b-4031-482d-8d50-de9374f80de9 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:43:02 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-6348272b-4031-482d-8d50-de9374f80de9 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:43:02 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-6348272b-4031-482d-8d50-de9374f80de9 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:43:02 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-6348272b-4031-482d-8d50-de9374f80de9 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:43:02 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-6348272b-4031-482d-8d50-de9374f80de9 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:43:02 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-6348272b-4031-482d-8d50-de9374f80de9 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:43:02 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-6348272b-4031-482d-8d50-de9374f80de9 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:43:02 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-6348272b-4031-482d-8d50-de9374f80de9 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=62054) unshelve /opt/stack/nova/nova/compute/api.py:4596}} Apr 13 16:43:02 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-6348272b-4031-482d-8d50-de9374f80de9 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] 10.0.0.210 "POST /compute/v2.1/servers/1f6a693f-0a99-434f-871d-f535b71229b9/action" status: 202 len: 0 microversion: 2.20 time: 0.133756 Apr 13 16:43:02 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 292/873] 10.0.0.210 () {66 vars in 1396 bytes} [Thu Apr 13 16:43:02 2023] POST /compute/v2.1/servers/1f6a693f-0a99-434f-871d-f535b71229b9/action => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 13 16:43:02 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-14d0dbc0-fb73-45ab-9e54-e31fc3cf7254 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:43:02 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-14d0dbc0-fb73-45ab-9e54-e31fc3cf7254 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:43:02 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-14d0dbc0-fb73-45ab-9e54-e31fc3cf7254 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:43:02 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-14d0dbc0-fb73-45ab-9e54-e31fc3cf7254 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:43:02 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-14d0dbc0-fb73-45ab-9e54-e31fc3cf7254 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:43:02 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-14d0dbc0-fb73-45ab-9e54-e31fc3cf7254 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:43:02 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-14d0dbc0-fb73-45ab-9e54-e31fc3cf7254 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:43:02 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-14d0dbc0-fb73-45ab-9e54-e31fc3cf7254 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:43:02 user devstack@n-api.service[62055]: DEBUG nova.policy [None req-14d0dbc0-fb73-45ab-9e54-e31fc3cf7254 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b4e972cd1049509fa899449961ab59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0653ab16660b46cea9c5af58ea0b1931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62055) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:43:02 user devstack@n-api.service[62055]: DEBUG nova.policy [None req-14d0dbc0-fb73-45ab-9e54-e31fc3cf7254 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48b4e972cd1049509fa899449961ab59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0653ab16660b46cea9c5af58ea0b1931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62055) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:43:02 user devstack@n-api.service[62055]: DEBUG nova.policy [None req-14d0dbc0-fb73-45ab-9e54-e31fc3cf7254 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48b4e972cd1049509fa899449961ab59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0653ab16660b46cea9c5af58ea0b1931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62055) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:43:02 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-14d0dbc0-fb73-45ab-9e54-e31fc3cf7254 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1f6a693f-0a99-434f-871d-f535b71229b9" status: 200 len: 1660 microversion: 2.20 time: 0.154145 Apr 13 16:43:02 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 290/874] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 16:43:02 2023] GET /compute/v2.1/servers/1f6a693f-0a99-434f-871d-f535b71229b9 => generated 1660 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 16:43:05 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-6e8c115f-a33c-4a1a-93ba-035d40af04a9 req-ee5168ac-4f31-4c05-9c79-148b33f4737f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f6a693f-0a99-434f-871d-f535b71229b9", "tag": "103a0c68-ffc7-4460-836e-0de6c0272d84"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:43:05 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-6e8c115f-a33c-4a1a-93ba-035d40af04a9 req-ee5168ac-4f31-4c05-9c79-148b33f4737f service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:43:05 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-6e8c115f-a33c-4a1a-93ba-035d40af04a9 req-ee5168ac-4f31-4c05-9c79-148b33f4737f service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:43:05 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-6e8c115f-a33c-4a1a-93ba-035d40af04a9 req-ee5168ac-4f31-4c05-9c79-148b33f4737f service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:43:05 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-6e8c115f-a33c-4a1a-93ba-035d40af04a9 req-ee5168ac-4f31-4c05-9c79-148b33f4737f service nova] Creating event network-changed:103a0c68-ffc7-4460-836e-0de6c0272d84 for instance 1f6a693f-0a99-434f-871d-f535b71229b9 on user Apr 13 16:43:05 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [req-6e8c115f-a33c-4a1a-93ba-035d40af04a9 req-ee5168ac-4f31-4c05-9c79-148b33f4737f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030092 Apr 13 16:43:05 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 293/875] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:43:05 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:43:10 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-d414927d-50b5-4060-9a52-de147f4d75e7 req-40292293-bd09-4b33-85ed-11dd6e55ff14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f6a693f-0a99-434f-871d-f535b71229b9", "name": "network-vif-plugged", "status": "completed", "tag": "103a0c68-ffc7-4460-836e-0de6c0272d84"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:43:10 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-d414927d-50b5-4060-9a52-de147f4d75e7 req-40292293-bd09-4b33-85ed-11dd6e55ff14 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:43:10 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-d414927d-50b5-4060-9a52-de147f4d75e7 req-40292293-bd09-4b33-85ed-11dd6e55ff14 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:43:10 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-d414927d-50b5-4060-9a52-de147f4d75e7 req-40292293-bd09-4b33-85ed-11dd6e55ff14 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:43:11 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-d414927d-50b5-4060-9a52-de147f4d75e7 req-40292293-bd09-4b33-85ed-11dd6e55ff14 service nova] Creating event network-vif-plugged:103a0c68-ffc7-4460-836e-0de6c0272d84 for instance 1f6a693f-0a99-434f-871d-f535b71229b9 on user Apr 13 16:43:11 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [req-d414927d-50b5-4060-9a52-de147f4d75e7 req-40292293-bd09-4b33-85ed-11dd6e55ff14 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041849 Apr 13 16:43:11 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 293/876] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:43:10 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:43:13 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [req-213790d4-8705-4868-b13a-1e5e5ac1852b req-dca7cda3-a0a0-4f10-a57d-510736d0f06f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f6a693f-0a99-434f-871d-f535b71229b9", "name": "network-vif-plugged", "status": "completed", "tag": "103a0c68-ffc7-4460-836e-0de6c0272d84"}]} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:43:13 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_api:SELECT=4 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:43:13 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_cell1:SELECT=21,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:43:13 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-213790d4-8705-4868-b13a-1e5e5ac1852b req-dca7cda3-a0a0-4f10-a57d-510736d0f06f service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:43:13 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-213790d4-8705-4868-b13a-1e5e5ac1852b req-dca7cda3-a0a0-4f10-a57d-510736d0f06f service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:43:13 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-213790d4-8705-4868-b13a-1e5e5ac1852b req-dca7cda3-a0a0-4f10-a57d-510736d0f06f service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:43:13 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-213790d4-8705-4868-b13a-1e5e5ac1852b req-dca7cda3-a0a0-4f10-a57d-510736d0f06f service nova] Creating event network-vif-plugged:103a0c68-ffc7-4460-836e-0de6c0272d84 for instance 1f6a693f-0a99-434f-871d-f535b71229b9 on user Apr 13 16:43:13 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [req-213790d4-8705-4868-b13a-1e5e5ac1852b req-dca7cda3-a0a0-4f10-a57d-510736d0f06f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037184 Apr 13 16:43:13 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 291/877] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:43:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:43:35 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-3d3e253e-4839-4ef9-bd11-1bf9e7dbe468 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:43:35 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-3d3e253e-4839-4ef9-bd11-1bf9e7dbe468 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: 3af23ff8-4e10-4fbf-a86e-bda842f084ff] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:43:35 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_api:SELECT=4 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:43:35 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_cell1:SELECT=17,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:43:35 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-3d3e253e-4839-4ef9-bd11-1bf9e7dbe468 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:43:35 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-3d3e253e-4839-4ef9-bd11-1bf9e7dbe468 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:43:35 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-3d3e253e-4839-4ef9-bd11-1bf9e7dbe468 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:43:35 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-3d3e253e-4839-4ef9-bd11-1bf9e7dbe468 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:43:35 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-3d3e253e-4839-4ef9-bd11-1bf9e7dbe468 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:43:35 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-3d3e253e-4839-4ef9-bd11-1bf9e7dbe468 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:43:35 user devstack@n-api.service[62053]: DEBUG nova.policy [None req-3d3e253e-4839-4ef9-bd11-1bf9e7dbe468 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c7f54723c494e05ada117353c0790cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '846732ecb7e047128b4684972d3cd8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62053) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:43:35 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-3d3e253e-4839-4ef9-bd11-1bf9e7dbe468 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3af23ff8-4e10-4fbf-a86e-bda842f084ff" status: 200 len: 1490 microversion: 2.1 time: 0.149157 Apr 13 16:43:35 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 294/878] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:43:35 2023] GET /compute/v2.1/servers/3af23ff8-4e10-4fbf-a86e-bda842f084ff => generated 1490 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:43:38 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_api:SELECT=8,nova_api:UPDATE=1 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:43:38 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:43:38 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-52acf467-479c-454a-9dac-71c166283c8f tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:43:38 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-52acf467-479c-454a-9dac-71c166283c8f tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:43:38 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-52acf467-479c-454a-9dac-71c166283c8f tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:43:38 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-52acf467-479c-454a-9dac-71c166283c8f tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:43:38 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-52acf467-479c-454a-9dac-71c166283c8f tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:43:38 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-52acf467-479c-454a-9dac-71c166283c8f tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:43:38 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-52acf467-479c-454a-9dac-71c166283c8f tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:43:38 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-52acf467-479c-454a-9dac-71c166283c8f tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:43:38 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-52acf467-479c-454a-9dac-71c166283c8f tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] 10.0.0.210 "POST /compute/v2.1/servers/7ae7d3d9-54f7-4c64-8bf6-08fa5c526687/action" status: 204 len: 0 microversion: 2.1 time: 0.077970 Apr 13 16:43:38 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 294/879] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 16:43:38 2023] POST /compute/v2.1/servers/7ae7d3d9-54f7-4c64-8bf6-08fa5c526687/action => generated 0 bytes in 80 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 16:43:38 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_api:SELECT=2 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:43:38 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_cell1:SELECT=2 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:43:39 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-32122ac1-b465-4e5b-8744-91d6a1993171 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:43:39 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-32122ac1-b465-4e5b-8744-91d6a1993171 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:43:39 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-32122ac1-b465-4e5b-8744-91d6a1993171 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:43:39 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-32122ac1-b465-4e5b-8744-91d6a1993171 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:43:39 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-32122ac1-b465-4e5b-8744-91d6a1993171 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:43:39 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-32122ac1-b465-4e5b-8744-91d6a1993171 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:43:39 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-32122ac1-b465-4e5b-8744-91d6a1993171 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:43:39 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-32122ac1-b465-4e5b-8744-91d6a1993171 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:43:39 user devstack@n-api.service[62055]: DEBUG nova.policy [None req-32122ac1-b465-4e5b-8744-91d6a1993171 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b3df1c5c5d441819bcef89ed6966815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980559734a504574a83224deb7423c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62055) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:43:39 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-32122ac1-b465-4e5b-8744-91d6a1993171 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7ae7d3d9-54f7-4c64-8bf6-08fa5c526687" status: 200 len: 1556 microversion: 2.1 time: 0.177037 Apr 13 16:43:39 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 292/880] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:43:38 2023] GET /compute/v2.1/servers/7ae7d3d9-54f7-4c64-8bf6-08fa5c526687 => generated 1556 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:43:53 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-8537826a-1e74-48d1-b0cf-f7cf04dfeebe tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:43:53 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-8537826a-1e74-48d1-b0cf-f7cf04dfeebe tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:43:53 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_api:SELECT=2 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:43:53 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_cell1:SELECT=6 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:43:53 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-8537826a-1e74-48d1-b0cf-f7cf04dfeebe tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:43:53 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-8537826a-1e74-48d1-b0cf-f7cf04dfeebe tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:43:53 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-8537826a-1e74-48d1-b0cf-f7cf04dfeebe tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:43:53 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-8537826a-1e74-48d1-b0cf-f7cf04dfeebe tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:43:53 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-8537826a-1e74-48d1-b0cf-f7cf04dfeebe tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:43:53 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-8537826a-1e74-48d1-b0cf-f7cf04dfeebe tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:43:53 user devstack@n-api.service[62053]: DEBUG nova.policy [None req-8537826a-1e74-48d1-b0cf-f7cf04dfeebe tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b4e972cd1049509fa899449961ab59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0653ab16660b46cea9c5af58ea0b1931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62053) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:43:53 user devstack@n-api.service[62053]: DEBUG nova.policy [None req-8537826a-1e74-48d1-b0cf-f7cf04dfeebe tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48b4e972cd1049509fa899449961ab59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0653ab16660b46cea9c5af58ea0b1931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62053) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:43:53 user devstack@n-api.service[62053]: DEBUG nova.policy [None req-8537826a-1e74-48d1-b0cf-f7cf04dfeebe tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48b4e972cd1049509fa899449961ab59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0653ab16660b46cea9c5af58ea0b1931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62053) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:43:53 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-8537826a-1e74-48d1-b0cf-f7cf04dfeebe tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1f6a693f-0a99-434f-871d-f535b71229b9" status: 200 len: 1705 microversion: 2.20 time: 0.150758 Apr 13 16:43:53 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 295/881] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 16:43:53 2023] GET /compute/v2.1/servers/1f6a693f-0a99-434f-871d-f535b71229b9 => generated 1705 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 16:44:29 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-6b857e90-0b4b-44de-8ae8-8959ea8293f9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:44:29 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-6b857e90-0b4b-44de-8ae8-8959ea8293f9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:44:29 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_api:SELECT=2 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:44:29 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:44:29 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-6b857e90-0b4b-44de-8ae8-8959ea8293f9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:44:29 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-6b857e90-0b4b-44de-8ae8-8959ea8293f9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:44:29 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-6b857e90-0b4b-44de-8ae8-8959ea8293f9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:44:29 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-6b857e90-0b4b-44de-8ae8-8959ea8293f9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:44:29 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-6b857e90-0b4b-44de-8ae8-8959ea8293f9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:44:29 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-6b857e90-0b4b-44de-8ae8-8959ea8293f9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:44:29 user devstack@n-api.service[62054]: DEBUG nova.policy [None req-6b857e90-0b4b-44de-8ae8-8959ea8293f9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b3df1c5c5d441819bcef89ed6966815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980559734a504574a83224deb7423c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62054) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:44:29 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-6b857e90-0b4b-44de-8ae8-8959ea8293f9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7ae7d3d9-54f7-4c64-8bf6-08fa5c526687" status: 200 len: 1548 microversion: 2.1 time: 0.168302 Apr 13 16:44:29 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 295/882] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:44:29 2023] GET /compute/v2.1/servers/7ae7d3d9-54f7-4c64-8bf6-08fa5c526687 => generated 1548 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:44:35 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-d905dfc0-be57-47f6-94e9-9add0103983d tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:44:35 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-d905dfc0-be57-47f6-94e9-9add0103983d tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:44:35 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_api:SELECT=2 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:44:35 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_cell1:SELECT=6 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:44:35 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-d905dfc0-be57-47f6-94e9-9add0103983d tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:44:35 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-d905dfc0-be57-47f6-94e9-9add0103983d tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:44:35 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-d905dfc0-be57-47f6-94e9-9add0103983d tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:44:35 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-d905dfc0-be57-47f6-94e9-9add0103983d tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:44:35 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-d905dfc0-be57-47f6-94e9-9add0103983d tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:44:35 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-d905dfc0-be57-47f6-94e9-9add0103983d tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:44:35 user devstack@n-api.service[62055]: DEBUG nova.policy [None req-d905dfc0-be57-47f6-94e9-9add0103983d tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c7f54723c494e05ada117353c0790cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '846732ecb7e047128b4684972d3cd8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62055) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:44:35 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-d905dfc0-be57-47f6-94e9-9add0103983d tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b2d55cdd-c89c-4c59-afe1-49a33225af22" status: 200 len: 1504 microversion: 2.1 time: 0.147288 Apr 13 16:44:35 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 293/883] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:44:35 2023] GET /compute/v2.1/servers/b2d55cdd-c89c-4c59-afe1-49a33225af22 => generated 1504 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:44:53 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_api:SELECT=2 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:44:53 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_cell1:SELECT=6 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:44:53 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-72a19856-acf1-41db-a43f-ee69338c1d86 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:44:53 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-72a19856-acf1-41db-a43f-ee69338c1d86 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:44:53 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-72a19856-acf1-41db-a43f-ee69338c1d86 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:44:53 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-72a19856-acf1-41db-a43f-ee69338c1d86 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:44:53 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-72a19856-acf1-41db-a43f-ee69338c1d86 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:44:53 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-72a19856-acf1-41db-a43f-ee69338c1d86 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:44:53 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-72a19856-acf1-41db-a43f-ee69338c1d86 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:44:53 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-72a19856-acf1-41db-a43f-ee69338c1d86 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:44:53 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-72a19856-acf1-41db-a43f-ee69338c1d86 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1f6a693f-0a99-434f-871d-f535b71229b9/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.049278 Apr 13 16:44:53 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 296/884] 10.0.0.210 () {64 vars in 1420 bytes} [Thu Apr 13 16:44:53 2023] GET /compute/v2.1/servers/1f6a693f-0a99-434f-871d-f535b71229b9/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:44:53 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-7dbb1275-cde4-4fa0-b44e-e575fa499d57 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:44:53 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-7dbb1275-cde4-4fa0-b44e-e575fa499d57 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:44:53 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_api:SELECT=2 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:44:53 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_cell1:SELECT=6 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:44:53 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-7dbb1275-cde4-4fa0-b44e-e575fa499d57 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:44:53 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-7dbb1275-cde4-4fa0-b44e-e575fa499d57 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:44:53 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-7dbb1275-cde4-4fa0-b44e-e575fa499d57 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:44:53 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-7dbb1275-cde4-4fa0-b44e-e575fa499d57 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:44:53 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-7dbb1275-cde4-4fa0-b44e-e575fa499d57 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:44:53 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-7dbb1275-cde4-4fa0-b44e-e575fa499d57 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:44:53 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-7dbb1275-cde4-4fa0-b44e-e575fa499d57 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Going to try to terminate instance {{(pid=62054) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 16:44:53 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-7dbb1275-cde4-4fa0-b44e-e575fa499d57 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1f6a693f-0a99-434f-871d-f535b71229b9" status: 204 len: 0 microversion: 2.20 time: 0.125950 Apr 13 16:44:53 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 296/885] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 13 16:44:53 2023] DELETE /compute/v2.1/servers/1f6a693f-0a99-434f-871d-f535b71229b9 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Apr 13 16:44:53 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-9abd1fd2-e2cf-4800-8354-8fb19ac8349d tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:44:53 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-9abd1fd2-e2cf-4800-8354-8fb19ac8349d tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:44:53 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_api:SELECT=2 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:44:53 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_cell1:SELECT=6 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:44:53 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-9abd1fd2-e2cf-4800-8354-8fb19ac8349d tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:44:53 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-9abd1fd2-e2cf-4800-8354-8fb19ac8349d tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:44:53 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-9abd1fd2-e2cf-4800-8354-8fb19ac8349d tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:44:53 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-9abd1fd2-e2cf-4800-8354-8fb19ac8349d tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:44:53 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-9abd1fd2-e2cf-4800-8354-8fb19ac8349d tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:44:53 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-9abd1fd2-e2cf-4800-8354-8fb19ac8349d tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:44:53 user devstack@n-api.service[62055]: DEBUG nova.policy [None req-9abd1fd2-e2cf-4800-8354-8fb19ac8349d tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b4e972cd1049509fa899449961ab59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0653ab16660b46cea9c5af58ea0b1931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62055) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:44:53 user devstack@n-api.service[62055]: DEBUG nova.policy [None req-9abd1fd2-e2cf-4800-8354-8fb19ac8349d tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48b4e972cd1049509fa899449961ab59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0653ab16660b46cea9c5af58ea0b1931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62055) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:44:53 user devstack@n-api.service[62055]: DEBUG nova.policy [None req-9abd1fd2-e2cf-4800-8354-8fb19ac8349d tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48b4e972cd1049509fa899449961ab59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0653ab16660b46cea9c5af58ea0b1931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62055) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:44:53 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-9abd1fd2-e2cf-4800-8354-8fb19ac8349d tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1f6a693f-0a99-434f-871d-f535b71229b9" status: 200 len: 1711 microversion: 2.20 time: 0.186332 Apr 13 16:44:53 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 294/886] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 16:44:53 2023] GET /compute/v2.1/servers/1f6a693f-0a99-434f-871d-f535b71229b9 => generated 1711 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 16:44:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-8655fdfc-73ac-4325-9348-fc8903becb31 req-c72c4ebb-e9bb-4697-9002-89cd1633b3d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f6a693f-0a99-434f-871d-f535b71229b9", "name": "network-vif-unplugged", "status": "completed", "tag": "103a0c68-ffc7-4460-836e-0de6c0272d84"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:44:54 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-8655fdfc-73ac-4325-9348-fc8903becb31 req-c72c4ebb-e9bb-4697-9002-89cd1633b3d1 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:44:54 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-8655fdfc-73ac-4325-9348-fc8903becb31 req-c72c4ebb-e9bb-4697-9002-89cd1633b3d1 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:44:54 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-8655fdfc-73ac-4325-9348-fc8903becb31 req-c72c4ebb-e9bb-4697-9002-89cd1633b3d1 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:44:54 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-8655fdfc-73ac-4325-9348-fc8903becb31 req-c72c4ebb-e9bb-4697-9002-89cd1633b3d1 service nova] Creating event network-vif-unplugged:103a0c68-ffc7-4460-836e-0de6c0272d84 for instance 1f6a693f-0a99-434f-871d-f535b71229b9 on user Apr 13 16:44:54 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [req-8655fdfc-73ac-4325-9348-fc8903becb31 req-c72c4ebb-e9bb-4697-9002-89cd1633b3d1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029623 Apr 13 16:44:54 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 297/887] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:44:54 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:44:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-c95f360c-5acd-4353-9fe0-43c5af58b3cc req-98bcf040-237b-4c41-9f56-a180ee7ce36b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f6a693f-0a99-434f-871d-f535b71229b9", "name": "network-vif-deleted", "tag": "103a0c68-ffc7-4460-836e-0de6c0272d84"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:44:55 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-c95f360c-5acd-4353-9fe0-43c5af58b3cc req-98bcf040-237b-4c41-9f56-a180ee7ce36b service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:44:55 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-c95f360c-5acd-4353-9fe0-43c5af58b3cc req-98bcf040-237b-4c41-9f56-a180ee7ce36b service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:44:55 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-c95f360c-5acd-4353-9fe0-43c5af58b3cc req-98bcf040-237b-4c41-9f56-a180ee7ce36b service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:44:55 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-c95f360c-5acd-4353-9fe0-43c5af58b3cc req-98bcf040-237b-4c41-9f56-a180ee7ce36b service nova] Creating event network-vif-deleted:103a0c68-ffc7-4460-836e-0de6c0272d84 for instance 1f6a693f-0a99-434f-871d-f535b71229b9 on user Apr 13 16:44:55 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [req-c95f360c-5acd-4353-9fe0-43c5af58b3cc req-98bcf040-237b-4c41-9f56-a180ee7ce36b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031457 Apr 13 16:44:55 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 297/888] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:44:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:44:56 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [req-f80fe9a7-a385-49d5-8ad7-d3e3932ffe6c req-ef9703f8-dbd2-49e2-8ae5-5bf92ed85f9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f6a693f-0a99-434f-871d-f535b71229b9", "name": "network-vif-plugged", "status": "completed", "tag": "103a0c68-ffc7-4460-836e-0de6c0272d84"}]} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:44:56 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-f80fe9a7-a385-49d5-8ad7-d3e3932ffe6c req-ef9703f8-dbd2-49e2-8ae5-5bf92ed85f9a service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:44:56 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-f80fe9a7-a385-49d5-8ad7-d3e3932ffe6c req-ef9703f8-dbd2-49e2-8ae5-5bf92ed85f9a service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:44:56 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-f80fe9a7-a385-49d5-8ad7-d3e3932ffe6c req-ef9703f8-dbd2-49e2-8ae5-5bf92ed85f9a service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:44:56 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-f80fe9a7-a385-49d5-8ad7-d3e3932ffe6c req-ef9703f8-dbd2-49e2-8ae5-5bf92ed85f9a service nova] Creating event network-vif-plugged:103a0c68-ffc7-4460-836e-0de6c0272d84 for instance 1f6a693f-0a99-434f-871d-f535b71229b9 on user Apr 13 16:44:56 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [req-f80fe9a7-a385-49d5-8ad7-d3e3932ffe6c req-ef9703f8-dbd2-49e2-8ae5-5bf92ed85f9a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032454 Apr 13 16:44:56 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 295/889] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:44:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:45:29 user devstack@n-api.service[62053]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f769d44c-a0ce-4038-a872-8a5b800691cd] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 13 16:45:29 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_api:SELECT=4 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:45:29 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_cell1:SELECT=8 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:45:29 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-5f9d8c05-a0e9-4719-a9e3-4f168f8f66b8 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:45:29 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-5f9d8c05-a0e9-4719-a9e3-4f168f8f66b8 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:45:29 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-5f9d8c05-a0e9-4719-a9e3-4f168f8f66b8 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:45:29 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-5f9d8c05-a0e9-4719-a9e3-4f168f8f66b8 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:45:29 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-5f9d8c05-a0e9-4719-a9e3-4f168f8f66b8 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:45:29 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-5f9d8c05-a0e9-4719-a9e3-4f168f8f66b8 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:45:29 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-5f9d8c05-a0e9-4719-a9e3-4f168f8f66b8 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:45:29 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-5f9d8c05-a0e9-4719-a9e3-4f168f8f66b8 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:45:29 user devstack@n-api.service[62053]: DEBUG nova.policy [None req-5f9d8c05-a0e9-4719-a9e3-4f168f8f66b8 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b3df1c5c5d441819bcef89ed6966815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980559734a504574a83224deb7423c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62053) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:45:29 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-5f9d8c05-a0e9-4719-a9e3-4f168f8f66b8 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7ae7d3d9-54f7-4c64-8bf6-08fa5c526687" status: 200 len: 1548 microversion: 2.1 time: 0.329249 Apr 13 16:45:29 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 298/890] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:45:29 2023] GET /compute/v2.1/servers/7ae7d3d9-54f7-4c64-8bf6-08fa5c526687 => generated 1548 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:45:29 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:45:29 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:45:29 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-0eb6f62e-7b2c-44bb-becb-778c91e6a51d tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:45:29 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-0eb6f62e-7b2c-44bb-becb-778c91e6a51d tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:45:29 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-0eb6f62e-7b2c-44bb-becb-778c91e6a51d tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:45:29 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-0eb6f62e-7b2c-44bb-becb-778c91e6a51d tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:45:29 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-0eb6f62e-7b2c-44bb-becb-778c91e6a51d tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:45:29 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-0eb6f62e-7b2c-44bb-becb-778c91e6a51d tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:45:29 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-0eb6f62e-7b2c-44bb-becb-778c91e6a51d tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:45:29 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-0eb6f62e-7b2c-44bb-becb-778c91e6a51d tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:45:30 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-0eb6f62e-7b2c-44bb-becb-778c91e6a51d tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] 10.0.0.210 "POST /compute/v2.1/servers/7ae7d3d9-54f7-4c64-8bf6-08fa5c526687/action" status: 200 len: 28416 microversion: 2.1 time: 0.272041 Apr 13 16:45:30 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 298/891] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 16:45:29 2023] POST /compute/v2.1/servers/7ae7d3d9-54f7-4c64-8bf6-08fa5c526687/action => generated 28416 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 16:45:30 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-973d5592-5877-4e23-9cbe-372b70cd82fb tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:45:30 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-973d5592-5877-4e23-9cbe-372b70cd82fb tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 5ed800fe-577d-4624-898c-c7f40da77376] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:45:30 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_api:SELECT=4 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:45:30 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_cell1:SELECT=8 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:45:30 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-973d5592-5877-4e23-9cbe-372b70cd82fb tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:45:30 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-973d5592-5877-4e23-9cbe-372b70cd82fb tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:45:30 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-973d5592-5877-4e23-9cbe-372b70cd82fb tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:45:30 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-973d5592-5877-4e23-9cbe-372b70cd82fb tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:45:30 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-973d5592-5877-4e23-9cbe-372b70cd82fb tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:45:30 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-973d5592-5877-4e23-9cbe-372b70cd82fb tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:45:30 user devstack@n-api.service[62055]: DEBUG nova.policy [None req-973d5592-5877-4e23-9cbe-372b70cd82fb tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b3df1c5c5d441819bcef89ed6966815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980559734a504574a83224deb7423c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62055) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:45:30 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-973d5592-5877-4e23-9cbe-372b70cd82fb tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5ed800fe-577d-4624-898c-c7f40da77376" status: 200 len: 1539 microversion: 2.1 time: 0.253197 Apr 13 16:45:30 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 296/892] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:45:30 2023] GET /compute/v2.1/servers/5ed800fe-577d-4624-898c-c7f40da77376 => generated 1539 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:45:36 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-a845e1b9-93fa-4e9e-a2dd-0ef7c1bc9381 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:45:36 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-a845e1b9-93fa-4e9e-a2dd-0ef7c1bc9381 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:45:36 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-a845e1b9-93fa-4e9e-a2dd-0ef7c1bc9381 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:45:36 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-a845e1b9-93fa-4e9e-a2dd-0ef7c1bc9381 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:45:36 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-a845e1b9-93fa-4e9e-a2dd-0ef7c1bc9381 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:45:36 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-a845e1b9-93fa-4e9e-a2dd-0ef7c1bc9381 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:45:36 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-a845e1b9-93fa-4e9e-a2dd-0ef7c1bc9381 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:45:36 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-a845e1b9-93fa-4e9e-a2dd-0ef7c1bc9381 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:45:36 user devstack@n-api.service[62053]: INFO oslo.messaging._drivers.impl_rabbit [-] [f769d44c-a0ce-4038-a872-8a5b800691cd] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 43548. Apr 13 16:45:36 user devstack@n-api.service[62053]: DEBUG nova.objects.instance [None req-a845e1b9-93fa-4e9e-a2dd-0ef7c1bc9381 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lazy-loading 'flavor' on Instance uuid b2d55cdd-c89c-4c59-afe1-49a33225af22 {{(pid=62053) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 16:45:37 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-a845e1b9-93fa-4e9e-a2dd-0ef7c1bc9381 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] 10.0.0.210 "POST /compute/v2.1/servers/b2d55cdd-c89c-4c59-afe1-49a33225af22/action" status: 200 len: 32 microversion: 2.1 time: 0.123676 Apr 13 16:45:37 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 299/893] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 16:45:36 2023] POST /compute/v2.1/servers/b2d55cdd-c89c-4c59-afe1-49a33225af22/action => generated 32 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 16:45:37 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-64632dd0-d522-40b2-815b-b7ff80bb6953 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:45:37 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-64632dd0-d522-40b2-815b-b7ff80bb6953 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:45:37 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-64632dd0-d522-40b2-815b-b7ff80bb6953 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:45:37 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-64632dd0-d522-40b2-815b-b7ff80bb6953 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:45:37 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-64632dd0-d522-40b2-815b-b7ff80bb6953 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:45:37 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-64632dd0-d522-40b2-815b-b7ff80bb6953 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:45:37 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-64632dd0-d522-40b2-815b-b7ff80bb6953 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:45:37 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-64632dd0-d522-40b2-815b-b7ff80bb6953 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:45:37 user devstack@n-api.service[62054]: DEBUG nova.policy [None req-64632dd0-d522-40b2-815b-b7ff80bb6953 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c7f54723c494e05ada117353c0790cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '846732ecb7e047128b4684972d3cd8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62054) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:45:37 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-64632dd0-d522-40b2-815b-b7ff80bb6953 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b2d55cdd-c89c-4c59-afe1-49a33225af22" status: 200 len: 1510 microversion: 2.1 time: 0.162400 Apr 13 16:45:37 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 299/894] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:45:37 2023] GET /compute/v2.1/servers/b2d55cdd-c89c-4c59-afe1-49a33225af22 => generated 1510 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:45:37 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [req-fa0fa526-2007-4d1d-9971-b541d28c16dc req-aceeeb52-4080-4474-b937-4508173216c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2d55cdd-c89c-4c59-afe1-49a33225af22", "name": "network-vif-unplugged", "status": "completed", "tag": "31e1957f-9bd1-42ae-a2ac-954b49ca15f1"}]} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:45:37 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-fa0fa526-2007-4d1d-9971-b541d28c16dc req-aceeeb52-4080-4474-b937-4508173216c9 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:45:37 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-fa0fa526-2007-4d1d-9971-b541d28c16dc req-aceeeb52-4080-4474-b937-4508173216c9 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:45:37 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-fa0fa526-2007-4d1d-9971-b541d28c16dc req-aceeeb52-4080-4474-b937-4508173216c9 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:45:38 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-fa0fa526-2007-4d1d-9971-b541d28c16dc req-aceeeb52-4080-4474-b937-4508173216c9 service nova] Creating event network-vif-unplugged:31e1957f-9bd1-42ae-a2ac-954b49ca15f1 for instance b2d55cdd-c89c-4c59-afe1-49a33225af22 on user Apr 13 16:45:38 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [req-fa0fa526-2007-4d1d-9971-b541d28c16dc req-aceeeb52-4080-4474-b937-4508173216c9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.320022 Apr 13 16:45:38 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 297/895] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:45:37 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:45:40 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-762ec402-0720-4cc5-8448-bcec934e3007 req-6e615e31-1f46-49ae-a05d-2d15ca76947d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2d55cdd-c89c-4c59-afe1-49a33225af22", "name": "network-vif-plugged", "status": "completed", "tag": "31e1957f-9bd1-42ae-a2ac-954b49ca15f1"}, {"server_uuid": "b2d55cdd-c89c-4c59-afe1-49a33225af22", "name": "network-vif-plugged", "status": "completed", "tag": "31e1957f-9bd1-42ae-a2ac-954b49ca15f1"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:45:40 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-762ec402-0720-4cc5-8448-bcec934e3007 req-6e615e31-1f46-49ae-a05d-2d15ca76947d service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:45:40 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-762ec402-0720-4cc5-8448-bcec934e3007 req-6e615e31-1f46-49ae-a05d-2d15ca76947d service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:45:40 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-762ec402-0720-4cc5-8448-bcec934e3007 req-6e615e31-1f46-49ae-a05d-2d15ca76947d service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:45:40 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-762ec402-0720-4cc5-8448-bcec934e3007 req-6e615e31-1f46-49ae-a05d-2d15ca76947d service nova] Creating event network-vif-plugged:31e1957f-9bd1-42ae-a2ac-954b49ca15f1 for instance b2d55cdd-c89c-4c59-afe1-49a33225af22 on user Apr 13 16:45:40 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-762ec402-0720-4cc5-8448-bcec934e3007 req-6e615e31-1f46-49ae-a05d-2d15ca76947d service nova] Creating event network-vif-plugged:31e1957f-9bd1-42ae-a2ac-954b49ca15f1 for instance b2d55cdd-c89c-4c59-afe1-49a33225af22 on user Apr 13 16:45:40 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [req-762ec402-0720-4cc5-8448-bcec934e3007 req-6e615e31-1f46-49ae-a05d-2d15ca76947d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.032561 Apr 13 16:45:40 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 300/896] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:45:40 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:45:42 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-8ac6dffe-068c-4405-969d-bbd559d96f21 req-288ee0c1-87a1-48ac-8bdd-e397b00aaa2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2d55cdd-c89c-4c59-afe1-49a33225af22", "name": "network-vif-plugged", "status": "completed", "tag": "31e1957f-9bd1-42ae-a2ac-954b49ca15f1"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:45:42 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-8ac6dffe-068c-4405-969d-bbd559d96f21 req-288ee0c1-87a1-48ac-8bdd-e397b00aaa2f service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:45:42 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-8ac6dffe-068c-4405-969d-bbd559d96f21 req-288ee0c1-87a1-48ac-8bdd-e397b00aaa2f service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:45:42 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-8ac6dffe-068c-4405-969d-bbd559d96f21 req-288ee0c1-87a1-48ac-8bdd-e397b00aaa2f service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:45:42 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-8ac6dffe-068c-4405-969d-bbd559d96f21 req-288ee0c1-87a1-48ac-8bdd-e397b00aaa2f service nova] Creating event network-vif-plugged:31e1957f-9bd1-42ae-a2ac-954b49ca15f1 for instance b2d55cdd-c89c-4c59-afe1-49a33225af22 on user Apr 13 16:45:42 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [req-8ac6dffe-068c-4405-969d-bbd559d96f21 req-288ee0c1-87a1-48ac-8bdd-e397b00aaa2f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030286 Apr 13 16:45:42 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 300/897] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:45:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:45:44 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-11eefb80-db60-4965-9396-14b7244802ab tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:45:44 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-11eefb80-db60-4965-9396-14b7244802ab tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:45:44 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-11eefb80-db60-4965-9396-14b7244802ab tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:45:44 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-11eefb80-db60-4965-9396-14b7244802ab tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:45:44 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-11eefb80-db60-4965-9396-14b7244802ab tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:45:44 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-11eefb80-db60-4965-9396-14b7244802ab tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:45:44 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-11eefb80-db60-4965-9396-14b7244802ab tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:45:44 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-11eefb80-db60-4965-9396-14b7244802ab tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:45:44 user devstack@n-api.service[62055]: INFO nova.api.openstack.wsgi [None req-11eefb80-db60-4965-9396-14b7244802ab tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] HTTP exception thrown: Instance 1f6a693f-0a99-434f-871d-f535b71229b9 could not be found. Apr 13 16:45:44 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-11eefb80-db60-4965-9396-14b7244802ab tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Request method failure captured: Apr 13 16:45:44 user devstack@n-api.service[62055]: request: GET /compute/v2.1/servers/1f6a693f-0a99-434f-871d-f535b71229b9 HTTP/1.1 Apr 13 16:45:44 user devstack@n-api.service[62055]: Accept: application/json Apr 13 16:45:44 user devstack@n-api.service[62055]: Accept-Encoding: identity Apr 13 16:45:44 user devstack@n-api.service[62055]: Connection: close Apr 13 16:45:44 user devstack@n-api.service[62055]: Content-Length: 0 Apr 13 16:45:44 user devstack@n-api.service[62055]: Content-Type: application/json Apr 13 16:45:44 user devstack@n-api.service[62055]: Host: 10.0.0.210 Apr 13 16:45:44 user devstack@n-api.service[62055]: Openstack-System-Scope: None Apr 13 16:45:44 user devstack@n-api.service[62055]: User-Agent: python-urllib3/1.26.15 Apr 13 16:45:44 user devstack@n-api.service[62055]: X-Auth-Token: gAAAAABkOC53SZVmZKVketXQGuAVMMknMJdjznVoSSXYAbi3nZlDismOo6vWp1c3OJZOcAv9afVjCXo02Tx5ciDsWKJuJjC1cDN2EFLBuhORZXJ1uO1rD0SviIsoKAVCcdR2S2_fQZO6PmY5eU-ufy22hb3YYguF4rd7O3sgiUpAQcm9s01OX4U Apr 13 16:45:44 user devstack@n-api.service[62055]: X-Domain-Id: None Apr 13 16:45:44 user devstack@n-api.service[62055]: X-Domain-Name: None Apr 13 16:45:44 user devstack@n-api.service[62055]: X-Identity-Status: Confirmed Apr 13 16:45:44 user devstack@n-api.service[62055]: X-Is-Admin-Project: True Apr 13 16:45:44 user devstack@n-api.service[62055]: X-Openstack-Nova-Api-Version: 2.20 Apr 13 16:45:44 user devstack@n-api.service[62055]: X-Project-Domain-Id: default Apr 13 16:45:44 user devstack@n-api.service[62055]: X-Project-Domain-Name: Default Apr 13 16:45:44 user devstack@n-api.service[62055]: X-Project-Id: 0653ab16660b46cea9c5af58ea0b1931 Apr 13 16:45:44 user devstack@n-api.service[62055]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1310775310 Apr 13 16:45:44 user devstack@n-api.service[62055]: X-Role: reader,member Apr 13 16:45:44 user devstack@n-api.service[62055]: X-Roles: reader,member Apr 13 16:45:44 user devstack@n-api.service[62055]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0653ab16660b46cea9c5af58ea0b1931"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0653ab16660b46cea9c5af58ea0b1931"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0653ab16660b46cea9c5af58ea0b1931"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 13 16:45:44 user devstack@n-api.service[62055]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1310775310 Apr 13 16:45:44 user devstack@n-api.service[62055]: X-Tenant-Id: 0653ab16660b46cea9c5af58ea0b1931 Apr 13 16:45:44 user devstack@n-api.service[62055]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1310775310 Apr 13 16:45:44 user devstack@n-api.service[62055]: X-User: tempest-AttachVolumeShelveTestJSON-1310775310-project-member Apr 13 16:45:44 user devstack@n-api.service[62055]: X-User-Domain-Id: default Apr 13 16:45:44 user devstack@n-api.service[62055]: X-User-Domain-Name: Default Apr 13 16:45:44 user devstack@n-api.service[62055]: X-User-Id: 48b4e972cd1049509fa899449961ab59 Apr 13 16:45:44 user devstack@n-api.service[62055]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1310775310-project-member Apr 13 16:45:44 user devstack@n-api.service[62055]: method: > Apr 13 16:45:44 user devstack@n-api.service[62055]: exception: Instance 1f6a693f-0a99-434f-871d-f535b71229b9 could not be found. Apr 13 16:45:44 user devstack@n-api.service[62055]: action_args: {'id': '1f6a693f-0a99-434f-871d-f535b71229b9'} Apr 13 16:45:44 user devstack@n-api.service[62055]: {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 16:45:44 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:45:44 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 16:45:44 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 16:45:44 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 16:45:44 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 16:45:44 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 16:45:44 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 16:45:44 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 16:45:44 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 16:45:44 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f6a693f-0a99-434f-871d-f535b71229b9 could not be found. Apr 13 16:45:44 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:45:44 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:45:44 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:45:44 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:45:44 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 16:45:44 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 16:45:44 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 16:45:44 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 16:45:44 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 16:45:44 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 16:45:44 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 16:45:44 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 16:45:44 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 16:45:44 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 16:45:44 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 16:45:44 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 16:45:44 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f6a693f-0a99-434f-871d-f535b71229b9 could not be found. Apr 13 16:45:44 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:45:44 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:45:44 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:45:44 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:45:44 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 16:45:44 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 16:45:44 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 16:45:44 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 16:45:44 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f6a693f-0a99-434f-871d-f535b71229b9 could not be found. Apr 13 16:45:44 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:45:44 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-11eefb80-db60-4965-9396-14b7244802ab tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Returning 404 to user: Instance 1f6a693f-0a99-434f-871d-f535b71229b9 could not be found. {{(pid=62055) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 16:45:44 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-11eefb80-db60-4965-9396-14b7244802ab tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1f6a693f-0a99-434f-871d-f535b71229b9" status: 404 len: 111 microversion: 2.20 time: 0.058432 Apr 13 16:45:44 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 298/898] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 16:45:43 2023] GET /compute/v2.1/servers/1f6a693f-0a99-434f-871d-f535b71229b9 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 13 16:45:44 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-f548b9cb-4c1d-4a26-9199-82d450c6fca8 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Calling method '.version_select at 0x7f96e4977ac0>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:45:44 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-f548b9cb-4c1d-4a26-9199-82d450c6fca8 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-707123723" status: 204 len: 0 microversion: 2.20 time: 0.026788 Apr 13 16:45:44 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 301/899] 10.0.0.210 () {64 vars in 1336 bytes} [Thu Apr 13 16:45:44 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-707123723 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 13 16:45:46 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-189a8726-6ffb-46da-b4ef-cd04f718d9c9 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:45:46 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-189a8726-6ffb-46da-b4ef-cd04f718d9c9 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:45:46 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-189a8726-6ffb-46da-b4ef-cd04f718d9c9 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:45:46 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-189a8726-6ffb-46da-b4ef-cd04f718d9c9 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:45:46 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-189a8726-6ffb-46da-b4ef-cd04f718d9c9 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:45:46 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-189a8726-6ffb-46da-b4ef-cd04f718d9c9 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:45:46 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-189a8726-6ffb-46da-b4ef-cd04f718d9c9 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:45:46 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-189a8726-6ffb-46da-b4ef-cd04f718d9c9 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:45:47 user devstack@n-api.service[62054]: INFO nova.api.openstack.wsgi [None req-189a8726-6ffb-46da-b4ef-cd04f718d9c9 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] HTTP exception thrown: Instance 1f6a693f-0a99-434f-871d-f535b71229b9 could not be found. Apr 13 16:45:47 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-189a8726-6ffb-46da-b4ef-cd04f718d9c9 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Request method failure captured: Apr 13 16:45:47 user devstack@n-api.service[62054]: request: DELETE /compute/v2.1/servers/1f6a693f-0a99-434f-871d-f535b71229b9 HTTP/1.1 Apr 13 16:45:47 user devstack@n-api.service[62054]: Accept: application/json Apr 13 16:45:47 user devstack@n-api.service[62054]: Accept-Encoding: identity Apr 13 16:45:47 user devstack@n-api.service[62054]: Connection: close Apr 13 16:45:47 user devstack@n-api.service[62054]: Content-Length: 0 Apr 13 16:45:47 user devstack@n-api.service[62054]: Content-Type: application/json Apr 13 16:45:47 user devstack@n-api.service[62054]: Host: 10.0.0.210 Apr 13 16:45:47 user devstack@n-api.service[62054]: Openstack-System-Scope: None Apr 13 16:45:47 user devstack@n-api.service[62054]: User-Agent: python-urllib3/1.26.15 Apr 13 16:45:47 user devstack@n-api.service[62054]: X-Auth-Token: gAAAAABkOC53SZVmZKVketXQGuAVMMknMJdjznVoSSXYAbi3nZlDismOo6vWp1c3OJZOcAv9afVjCXo02Tx5ciDsWKJuJjC1cDN2EFLBuhORZXJ1uO1rD0SviIsoKAVCcdR2S2_fQZO6PmY5eU-ufy22hb3YYguF4rd7O3sgiUpAQcm9s01OX4U Apr 13 16:45:47 user devstack@n-api.service[62054]: X-Domain-Id: None Apr 13 16:45:47 user devstack@n-api.service[62054]: X-Domain-Name: None Apr 13 16:45:47 user devstack@n-api.service[62054]: X-Identity-Status: Confirmed Apr 13 16:45:47 user devstack@n-api.service[62054]: X-Is-Admin-Project: True Apr 13 16:45:47 user devstack@n-api.service[62054]: X-Openstack-Nova-Api-Version: 2.20 Apr 13 16:45:47 user devstack@n-api.service[62054]: X-Project-Domain-Id: default Apr 13 16:45:47 user devstack@n-api.service[62054]: X-Project-Domain-Name: Default Apr 13 16:45:47 user devstack@n-api.service[62054]: X-Project-Id: 0653ab16660b46cea9c5af58ea0b1931 Apr 13 16:45:47 user devstack@n-api.service[62054]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1310775310 Apr 13 16:45:47 user devstack@n-api.service[62054]: X-Role: reader,member Apr 13 16:45:47 user devstack@n-api.service[62054]: X-Roles: reader,member Apr 13 16:45:47 user devstack@n-api.service[62054]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0653ab16660b46cea9c5af58ea0b1931"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0653ab16660b46cea9c5af58ea0b1931"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0653ab16660b46cea9c5af58ea0b1931"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 13 16:45:47 user devstack@n-api.service[62054]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1310775310 Apr 13 16:45:47 user devstack@n-api.service[62054]: X-Tenant-Id: 0653ab16660b46cea9c5af58ea0b1931 Apr 13 16:45:47 user devstack@n-api.service[62054]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1310775310 Apr 13 16:45:47 user devstack@n-api.service[62054]: X-User: tempest-AttachVolumeShelveTestJSON-1310775310-project-member Apr 13 16:45:47 user devstack@n-api.service[62054]: X-User-Domain-Id: default Apr 13 16:45:47 user devstack@n-api.service[62054]: X-User-Domain-Name: Default Apr 13 16:45:47 user devstack@n-api.service[62054]: X-User-Id: 48b4e972cd1049509fa899449961ab59 Apr 13 16:45:47 user devstack@n-api.service[62054]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1310775310-project-member Apr 13 16:45:47 user devstack@n-api.service[62054]: method: > Apr 13 16:45:47 user devstack@n-api.service[62054]: exception: Instance 1f6a693f-0a99-434f-871d-f535b71229b9 could not be found. Apr 13 16:45:47 user devstack@n-api.service[62054]: action_args: {'id': '1f6a693f-0a99-434f-871d-f535b71229b9'} Apr 13 16:45:47 user devstack@n-api.service[62054]: {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 16:45:47 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:45:47 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 16:45:47 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 16:45:47 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 16:45:47 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 16:45:47 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 16:45:47 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 16:45:47 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 16:45:47 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 16:45:47 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f6a693f-0a99-434f-871d-f535b71229b9 could not be found. Apr 13 16:45:47 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:45:47 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:45:47 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:45:47 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:45:47 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 16:45:47 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 16:45:47 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 16:45:47 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 16:45:47 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 16:45:47 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 16:45:47 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 16:45:47 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 16:45:47 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 16:45:47 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 16:45:47 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 16:45:47 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 16:45:47 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 16:45:47 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 16:45:47 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f6a693f-0a99-434f-871d-f535b71229b9 could not be found. Apr 13 16:45:47 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:45:47 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:45:47 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:45:47 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:45:47 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 16:45:47 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 16:45:47 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 16:45:47 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 16:45:47 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f6a693f-0a99-434f-871d-f535b71229b9 could not be found. Apr 13 16:45:47 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:45:47 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-189a8726-6ffb-46da-b4ef-cd04f718d9c9 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Returning 404 to user: Instance 1f6a693f-0a99-434f-871d-f535b71229b9 could not be found. {{(pid=62054) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 16:45:47 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-189a8726-6ffb-46da-b4ef-cd04f718d9c9 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1f6a693f-0a99-434f-871d-f535b71229b9" status: 404 len: 111 microversion: 2.20 time: 0.038607 Apr 13 16:45:47 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 301/900] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 13 16:45:46 2023] DELETE /compute/v2.1/servers/1f6a693f-0a99-434f-871d-f535b71229b9 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 13 16:45:47 user devstack@n-api.service[62055]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1f6f28ed-4fbb-48ba-87c1-2347dda4f253] AMQP server on 10.0.0.210:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 13 16:45:47 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-60a6d877-75b3-4308-9d40-001cb8b5e94c tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:45:47 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-60a6d877-75b3-4308-9d40-001cb8b5e94c tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:45:47 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-60a6d877-75b3-4308-9d40-001cb8b5e94c tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:45:47 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-60a6d877-75b3-4308-9d40-001cb8b5e94c tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:45:47 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-60a6d877-75b3-4308-9d40-001cb8b5e94c tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:45:47 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-60a6d877-75b3-4308-9d40-001cb8b5e94c tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:45:47 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-60a6d877-75b3-4308-9d40-001cb8b5e94c tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:45:47 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-60a6d877-75b3-4308-9d40-001cb8b5e94c tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:45:47 user devstack@n-api.service[62055]: INFO nova.api.openstack.wsgi [None req-60a6d877-75b3-4308-9d40-001cb8b5e94c tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] HTTP exception thrown: Instance 1f6a693f-0a99-434f-871d-f535b71229b9 could not be found. Apr 13 16:45:47 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-60a6d877-75b3-4308-9d40-001cb8b5e94c tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Request method failure captured: Apr 13 16:45:47 user devstack@n-api.service[62055]: request: GET /compute/v2.1/servers/1f6a693f-0a99-434f-871d-f535b71229b9 HTTP/1.1 Apr 13 16:45:47 user devstack@n-api.service[62055]: Accept: application/json Apr 13 16:45:47 user devstack@n-api.service[62055]: Accept-Encoding: identity Apr 13 16:45:47 user devstack@n-api.service[62055]: Connection: close Apr 13 16:45:47 user devstack@n-api.service[62055]: Content-Length: 0 Apr 13 16:45:47 user devstack@n-api.service[62055]: Content-Type: application/json Apr 13 16:45:47 user devstack@n-api.service[62055]: Host: 10.0.0.210 Apr 13 16:45:47 user devstack@n-api.service[62055]: Openstack-System-Scope: None Apr 13 16:45:47 user devstack@n-api.service[62055]: User-Agent: python-urllib3/1.26.15 Apr 13 16:45:47 user devstack@n-api.service[62055]: X-Auth-Token: gAAAAABkOC53SZVmZKVketXQGuAVMMknMJdjznVoSSXYAbi3nZlDismOo6vWp1c3OJZOcAv9afVjCXo02Tx5ciDsWKJuJjC1cDN2EFLBuhORZXJ1uO1rD0SviIsoKAVCcdR2S2_fQZO6PmY5eU-ufy22hb3YYguF4rd7O3sgiUpAQcm9s01OX4U Apr 13 16:45:47 user devstack@n-api.service[62055]: X-Domain-Id: None Apr 13 16:45:47 user devstack@n-api.service[62055]: X-Domain-Name: None Apr 13 16:45:47 user devstack@n-api.service[62055]: X-Identity-Status: Confirmed Apr 13 16:45:47 user devstack@n-api.service[62055]: X-Is-Admin-Project: True Apr 13 16:45:47 user devstack@n-api.service[62055]: X-Openstack-Nova-Api-Version: 2.20 Apr 13 16:45:47 user devstack@n-api.service[62055]: X-Project-Domain-Id: default Apr 13 16:45:47 user devstack@n-api.service[62055]: X-Project-Domain-Name: Default Apr 13 16:45:47 user devstack@n-api.service[62055]: X-Project-Id: 0653ab16660b46cea9c5af58ea0b1931 Apr 13 16:45:47 user devstack@n-api.service[62055]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1310775310 Apr 13 16:45:47 user devstack@n-api.service[62055]: X-Role: reader,member Apr 13 16:45:47 user devstack@n-api.service[62055]: X-Roles: reader,member Apr 13 16:45:47 user devstack@n-api.service[62055]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0653ab16660b46cea9c5af58ea0b1931"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0653ab16660b46cea9c5af58ea0b1931"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0653ab16660b46cea9c5af58ea0b1931"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 13 16:45:47 user devstack@n-api.service[62055]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1310775310 Apr 13 16:45:47 user devstack@n-api.service[62055]: X-Tenant-Id: 0653ab16660b46cea9c5af58ea0b1931 Apr 13 16:45:47 user devstack@n-api.service[62055]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1310775310 Apr 13 16:45:47 user devstack@n-api.service[62055]: X-User: tempest-AttachVolumeShelveTestJSON-1310775310-project-member Apr 13 16:45:47 user devstack@n-api.service[62055]: X-User-Domain-Id: default Apr 13 16:45:47 user devstack@n-api.service[62055]: X-User-Domain-Name: Default Apr 13 16:45:47 user devstack@n-api.service[62055]: X-User-Id: 48b4e972cd1049509fa899449961ab59 Apr 13 16:45:47 user devstack@n-api.service[62055]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1310775310-project-member Apr 13 16:45:47 user devstack@n-api.service[62055]: method: > Apr 13 16:45:47 user devstack@n-api.service[62055]: exception: Instance 1f6a693f-0a99-434f-871d-f535b71229b9 could not be found. Apr 13 16:45:47 user devstack@n-api.service[62055]: action_args: {'id': '1f6a693f-0a99-434f-871d-f535b71229b9'} Apr 13 16:45:47 user devstack@n-api.service[62055]: {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 16:45:47 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:45:47 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 16:45:47 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 16:45:47 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 16:45:47 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 16:45:47 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 16:45:47 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 16:45:47 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 16:45:47 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 16:45:47 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f6a693f-0a99-434f-871d-f535b71229b9 could not be found. Apr 13 16:45:47 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:45:47 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:45:47 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:45:47 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:45:47 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 16:45:47 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 16:45:47 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 16:45:47 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 16:45:47 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 16:45:47 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 16:45:47 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 16:45:47 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 16:45:47 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 16:45:47 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 16:45:47 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 16:45:47 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 16:45:47 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f6a693f-0a99-434f-871d-f535b71229b9 could not be found. Apr 13 16:45:47 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:45:47 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:45:47 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:45:47 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:45:47 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 16:45:47 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 16:45:47 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 16:45:47 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 16:45:47 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f6a693f-0a99-434f-871d-f535b71229b9 could not be found. Apr 13 16:45:47 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:45:47 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-60a6d877-75b3-4308-9d40-001cb8b5e94c tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Returning 404 to user: Instance 1f6a693f-0a99-434f-871d-f535b71229b9 could not be found. {{(pid=62055) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 16:45:47 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-60a6d877-75b3-4308-9d40-001cb8b5e94c tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1f6a693f-0a99-434f-871d-f535b71229b9" status: 404 len: 111 microversion: 2.20 time: 0.039804 Apr 13 16:45:47 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 299/901] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 16:45:47 2023] GET /compute/v2.1/servers/1f6a693f-0a99-434f-871d-f535b71229b9 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 13 16:45:49 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-6e6ac5c8-6886-4c25-b87a-7f7d60e4df84 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:45:49 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-6e6ac5c8-6886-4c25-b87a-7f7d60e4df84 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:45:49 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-6e6ac5c8-6886-4c25-b87a-7f7d60e4df84 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:45:49 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-6e6ac5c8-6886-4c25-b87a-7f7d60e4df84 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:45:49 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-6e6ac5c8-6886-4c25-b87a-7f7d60e4df84 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:45:49 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-6e6ac5c8-6886-4c25-b87a-7f7d60e4df84 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:45:49 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-6e6ac5c8-6886-4c25-b87a-7f7d60e4df84 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:45:49 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-6e6ac5c8-6886-4c25-b87a-7f7d60e4df84 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:45:49 user devstack@n-api.service[62053]: INFO nova.api.openstack.wsgi [None req-6e6ac5c8-6886-4c25-b87a-7f7d60e4df84 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] HTTP exception thrown: Instance 35b23303-e373-4f35-b7ee-76e6815073ce could not be found. Apr 13 16:45:49 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-6e6ac5c8-6886-4c25-b87a-7f7d60e4df84 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Request method failure captured: Apr 13 16:45:49 user devstack@n-api.service[62053]: request: DELETE /compute/v2.1/servers/35b23303-e373-4f35-b7ee-76e6815073ce HTTP/1.1 Apr 13 16:45:49 user devstack@n-api.service[62053]: Accept: application/json Apr 13 16:45:49 user devstack@n-api.service[62053]: Accept-Encoding: identity Apr 13 16:45:49 user devstack@n-api.service[62053]: Connection: close Apr 13 16:45:49 user devstack@n-api.service[62053]: Content-Length: 0 Apr 13 16:45:49 user devstack@n-api.service[62053]: Content-Type: application/json Apr 13 16:45:49 user devstack@n-api.service[62053]: Host: 10.0.0.210 Apr 13 16:45:49 user devstack@n-api.service[62053]: Openstack-System-Scope: None Apr 13 16:45:49 user devstack@n-api.service[62053]: User-Agent: python-urllib3/1.26.15 Apr 13 16:45:49 user devstack@n-api.service[62053]: X-Auth-Token: gAAAAABkOC53SZVmZKVketXQGuAVMMknMJdjznVoSSXYAbi3nZlDismOo6vWp1c3OJZOcAv9afVjCXo02Tx5ciDsWKJuJjC1cDN2EFLBuhORZXJ1uO1rD0SviIsoKAVCcdR2S2_fQZO6PmY5eU-ufy22hb3YYguF4rd7O3sgiUpAQcm9s01OX4U Apr 13 16:45:49 user devstack@n-api.service[62053]: X-Domain-Id: None Apr 13 16:45:49 user devstack@n-api.service[62053]: X-Domain-Name: None Apr 13 16:45:49 user devstack@n-api.service[62053]: X-Identity-Status: Confirmed Apr 13 16:45:49 user devstack@n-api.service[62053]: X-Is-Admin-Project: True Apr 13 16:45:49 user devstack@n-api.service[62053]: X-Openstack-Nova-Api-Version: 2.20 Apr 13 16:45:49 user devstack@n-api.service[62053]: X-Project-Domain-Id: default Apr 13 16:45:49 user devstack@n-api.service[62053]: X-Project-Domain-Name: Default Apr 13 16:45:49 user devstack@n-api.service[62053]: X-Project-Id: 0653ab16660b46cea9c5af58ea0b1931 Apr 13 16:45:49 user devstack@n-api.service[62053]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1310775310 Apr 13 16:45:49 user devstack@n-api.service[62053]: X-Role: reader,member Apr 13 16:45:49 user devstack@n-api.service[62053]: X-Roles: reader,member Apr 13 16:45:49 user devstack@n-api.service[62053]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0653ab16660b46cea9c5af58ea0b1931"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0653ab16660b46cea9c5af58ea0b1931"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0653ab16660b46cea9c5af58ea0b1931"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 13 16:45:49 user devstack@n-api.service[62053]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1310775310 Apr 13 16:45:49 user devstack@n-api.service[62053]: X-Tenant-Id: 0653ab16660b46cea9c5af58ea0b1931 Apr 13 16:45:49 user devstack@n-api.service[62053]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1310775310 Apr 13 16:45:49 user devstack@n-api.service[62053]: X-User: tempest-AttachVolumeShelveTestJSON-1310775310-project-member Apr 13 16:45:49 user devstack@n-api.service[62053]: X-User-Domain-Id: default Apr 13 16:45:49 user devstack@n-api.service[62053]: X-User-Domain-Name: Default Apr 13 16:45:49 user devstack@n-api.service[62053]: X-User-Id: 48b4e972cd1049509fa899449961ab59 Apr 13 16:45:49 user devstack@n-api.service[62053]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1310775310-project-member Apr 13 16:45:49 user devstack@n-api.service[62053]: method: > Apr 13 16:45:49 user devstack@n-api.service[62053]: exception: Instance 35b23303-e373-4f35-b7ee-76e6815073ce could not be found. Apr 13 16:45:49 user devstack@n-api.service[62053]: action_args: {'id': '35b23303-e373-4f35-b7ee-76e6815073ce'} Apr 13 16:45:49 user devstack@n-api.service[62053]: {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 16:45:49 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:45:49 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 16:45:49 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 16:45:49 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 16:45:49 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 16:45:49 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 16:45:49 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 16:45:49 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 16:45:49 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 16:45:49 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35b23303-e373-4f35-b7ee-76e6815073ce could not be found. Apr 13 16:45:49 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:45:49 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:45:49 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:45:49 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:45:49 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 16:45:49 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 16:45:49 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 16:45:49 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 16:45:49 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 16:45:49 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 16:45:49 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 16:45:49 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 16:45:49 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 16:45:49 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 16:45:49 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 16:45:49 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 16:45:49 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 16:45:49 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 16:45:49 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35b23303-e373-4f35-b7ee-76e6815073ce could not be found. Apr 13 16:45:49 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:45:49 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:45:49 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:45:49 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:45:49 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 16:45:49 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 16:45:49 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 16:45:49 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 16:45:49 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35b23303-e373-4f35-b7ee-76e6815073ce could not be found. Apr 13 16:45:49 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:45:49 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-6e6ac5c8-6886-4c25-b87a-7f7d60e4df84 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Returning 404 to user: Instance 35b23303-e373-4f35-b7ee-76e6815073ce could not be found. {{(pid=62053) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 16:45:49 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-6e6ac5c8-6886-4c25-b87a-7f7d60e4df84 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/35b23303-e373-4f35-b7ee-76e6815073ce" status: 404 len: 111 microversion: 2.20 time: 0.039880 Apr 13 16:45:49 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 302/902] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 13 16:45:49 2023] DELETE /compute/v2.1/servers/35b23303-e373-4f35-b7ee-76e6815073ce => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Apr 13 16:45:49 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-97376728-0646-4f67-9bfe-b2bd17c3bb62 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:45:49 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-97376728-0646-4f67-9bfe-b2bd17c3bb62 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:45:49 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-97376728-0646-4f67-9bfe-b2bd17c3bb62 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:45:49 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-97376728-0646-4f67-9bfe-b2bd17c3bb62 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:45:49 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-97376728-0646-4f67-9bfe-b2bd17c3bb62 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:45:49 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-97376728-0646-4f67-9bfe-b2bd17c3bb62 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:45:49 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-97376728-0646-4f67-9bfe-b2bd17c3bb62 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:45:49 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-97376728-0646-4f67-9bfe-b2bd17c3bb62 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:45:49 user devstack@n-api.service[62054]: INFO nova.api.openstack.wsgi [None req-97376728-0646-4f67-9bfe-b2bd17c3bb62 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] HTTP exception thrown: Instance 35b23303-e373-4f35-b7ee-76e6815073ce could not be found. Apr 13 16:45:49 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-97376728-0646-4f67-9bfe-b2bd17c3bb62 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Request method failure captured: Apr 13 16:45:49 user devstack@n-api.service[62054]: request: GET /compute/v2.1/servers/35b23303-e373-4f35-b7ee-76e6815073ce HTTP/1.1 Apr 13 16:45:49 user devstack@n-api.service[62054]: Accept: application/json Apr 13 16:45:49 user devstack@n-api.service[62054]: Accept-Encoding: identity Apr 13 16:45:49 user devstack@n-api.service[62054]: Connection: close Apr 13 16:45:49 user devstack@n-api.service[62054]: Content-Length: 0 Apr 13 16:45:49 user devstack@n-api.service[62054]: Content-Type: application/json Apr 13 16:45:49 user devstack@n-api.service[62054]: Host: 10.0.0.210 Apr 13 16:45:49 user devstack@n-api.service[62054]: Openstack-System-Scope: None Apr 13 16:45:49 user devstack@n-api.service[62054]: User-Agent: python-urllib3/1.26.15 Apr 13 16:45:49 user devstack@n-api.service[62054]: X-Auth-Token: gAAAAABkOC53SZVmZKVketXQGuAVMMknMJdjznVoSSXYAbi3nZlDismOo6vWp1c3OJZOcAv9afVjCXo02Tx5ciDsWKJuJjC1cDN2EFLBuhORZXJ1uO1rD0SviIsoKAVCcdR2S2_fQZO6PmY5eU-ufy22hb3YYguF4rd7O3sgiUpAQcm9s01OX4U Apr 13 16:45:49 user devstack@n-api.service[62054]: X-Domain-Id: None Apr 13 16:45:49 user devstack@n-api.service[62054]: X-Domain-Name: None Apr 13 16:45:49 user devstack@n-api.service[62054]: X-Identity-Status: Confirmed Apr 13 16:45:49 user devstack@n-api.service[62054]: X-Is-Admin-Project: True Apr 13 16:45:49 user devstack@n-api.service[62054]: X-Openstack-Nova-Api-Version: 2.20 Apr 13 16:45:49 user devstack@n-api.service[62054]: X-Project-Domain-Id: default Apr 13 16:45:49 user devstack@n-api.service[62054]: X-Project-Domain-Name: Default Apr 13 16:45:49 user devstack@n-api.service[62054]: X-Project-Id: 0653ab16660b46cea9c5af58ea0b1931 Apr 13 16:45:49 user devstack@n-api.service[62054]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1310775310 Apr 13 16:45:49 user devstack@n-api.service[62054]: X-Role: reader,member Apr 13 16:45:49 user devstack@n-api.service[62054]: X-Roles: reader,member Apr 13 16:45:49 user devstack@n-api.service[62054]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0653ab16660b46cea9c5af58ea0b1931"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0653ab16660b46cea9c5af58ea0b1931"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0653ab16660b46cea9c5af58ea0b1931"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 13 16:45:49 user devstack@n-api.service[62054]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1310775310 Apr 13 16:45:49 user devstack@n-api.service[62054]: X-Tenant-Id: 0653ab16660b46cea9c5af58ea0b1931 Apr 13 16:45:49 user devstack@n-api.service[62054]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1310775310 Apr 13 16:45:49 user devstack@n-api.service[62054]: X-User: tempest-AttachVolumeShelveTestJSON-1310775310-project-member Apr 13 16:45:49 user devstack@n-api.service[62054]: X-User-Domain-Id: default Apr 13 16:45:49 user devstack@n-api.service[62054]: X-User-Domain-Name: Default Apr 13 16:45:49 user devstack@n-api.service[62054]: X-User-Id: 48b4e972cd1049509fa899449961ab59 Apr 13 16:45:49 user devstack@n-api.service[62054]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1310775310-project-member Apr 13 16:45:49 user devstack@n-api.service[62054]: method: > Apr 13 16:45:49 user devstack@n-api.service[62054]: exception: Instance 35b23303-e373-4f35-b7ee-76e6815073ce could not be found. Apr 13 16:45:49 user devstack@n-api.service[62054]: action_args: {'id': '35b23303-e373-4f35-b7ee-76e6815073ce'} Apr 13 16:45:49 user devstack@n-api.service[62054]: {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 16:45:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:45:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 16:45:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 16:45:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 16:45:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 16:45:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 16:45:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 16:45:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 16:45:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 16:45:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35b23303-e373-4f35-b7ee-76e6815073ce could not be found. Apr 13 16:45:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:45:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:45:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:45:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:45:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 16:45:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 16:45:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 16:45:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 16:45:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 16:45:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 16:45:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 16:45:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 16:45:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 16:45:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 16:45:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 16:45:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 16:45:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35b23303-e373-4f35-b7ee-76e6815073ce could not be found. Apr 13 16:45:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:45:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:45:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:45:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:45:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 16:45:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 16:45:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 16:45:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 16:45:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35b23303-e373-4f35-b7ee-76e6815073ce could not be found. Apr 13 16:45:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:45:49 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-97376728-0646-4f67-9bfe-b2bd17c3bb62 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Returning 404 to user: Instance 35b23303-e373-4f35-b7ee-76e6815073ce could not be found. {{(pid=62054) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 16:45:49 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-97376728-0646-4f67-9bfe-b2bd17c3bb62 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] 10.0.0.210 "GET /compute/v2.1/servers/35b23303-e373-4f35-b7ee-76e6815073ce" status: 404 len: 111 microversion: 2.20 time: 0.028994 Apr 13 16:45:49 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 302/903] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 16:45:49 2023] GET /compute/v2.1/servers/35b23303-e373-4f35-b7ee-76e6815073ce => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 13 16:46:08 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_api:SELECT=8 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:46:08 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_cell1:SELECT=12 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:46:08 user devstack@n-api.service[62055]: INFO oslo.messaging._drivers.impl_rabbit [-] [1f6f28ed-4fbb-48ba-87c1-2347dda4f253] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 57558. Apr 13 16:46:08 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-435c7bd8-4e7b-4a66-b456-66a245bc1703 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-134291337", "imageRef": "708622a9-7465-4492-ade8-b827198f7e30", "flavorRef": "42", "networks": [{"uuid": "282f8956-6789-4c49-8b11-a2cc18f673a9"}]}} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:46:08 user devstack@n-api.service[62055]: DEBUG nova.network.neutron [None req-435c7bd8-4e7b-4a66-b456-66a245bc1703 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] validate_networks() for [('282f8956-6789-4c49-8b11-a2cc18f673a9', None, None, None, None, None)] {{(pid=62055) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 16:46:09 user devstack@n-api.service[62055]: DEBUG nova.virt.hardware [None req-435c7bd8-4e7b-4a66-b456-66a245bc1703 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] Flavor limits 0:0:0 {{(pid=62055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 16:46:09 user devstack@n-api.service[62055]: DEBUG nova.virt.hardware [None req-435c7bd8-4e7b-4a66-b456-66a245bc1703 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] Image limits 0:0:0 {{(pid=62055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 16:46:09 user devstack@n-api.service[62055]: DEBUG nova.virt.hardware [None req-435c7bd8-4e7b-4a66-b456-66a245bc1703 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] Flavor pref 0:0:0 {{(pid=62055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 16:46:09 user devstack@n-api.service[62055]: DEBUG nova.virt.hardware [None req-435c7bd8-4e7b-4a66-b456-66a245bc1703 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] Image pref 0:0:0 {{(pid=62055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 16:46:09 user devstack@n-api.service[62055]: DEBUG nova.virt.hardware [None req-435c7bd8-4e7b-4a66-b456-66a245bc1703 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 16:46:09 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-435c7bd8-4e7b-4a66-b456-66a245bc1703 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:46:09 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-435c7bd8-4e7b-4a66-b456-66a245bc1703 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:46:09 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-435c7bd8-4e7b-4a66-b456-66a245bc1703 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:46:09 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-435c7bd8-4e7b-4a66-b456-66a245bc1703 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:46:09 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-435c7bd8-4e7b-4a66-b456-66a245bc1703 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:46:09 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-435c7bd8-4e7b-4a66-b456-66a245bc1703 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:46:09 user devstack@n-api.service[62055]: DEBUG nova.quota [None req-435c7bd8-4e7b-4a66-b456-66a245bc1703 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] Getting quotas for project c0bb7653df574769941cf284c6a63154. Resources: {'instances', 'cores', 'ram'} {{(pid=62055) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 16:46:09 user devstack@n-api.service[62055]: DEBUG nova.quota [None req-435c7bd8-4e7b-4a66-b456-66a245bc1703 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] Getting quotas for user 623668858bee4d308f31f4facd600fb1 and project c0bb7653df574769941cf284c6a63154. Resources: {'instances', 'cores', 'ram'} {{(pid=62055) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 16:46:09 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-435c7bd8-4e7b-4a66-b456-66a245bc1703 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] Going to run 1 instances... {{(pid=62055) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 16:46:09 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-435c7bd8-4e7b-4a66-b456-66a245bc1703 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] [instance: 6e4776e8-d528-4110-90a3-daf4d1df0171] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='708622a9-7465-4492-ade8-b827198f7e30',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=62055) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 16:46:09 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-435c7bd8-4e7b-4a66-b456-66a245bc1703 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 1.274947 Apr 13 16:46:09 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 300/904] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 16:46:08 2023] POST /compute/v2.1/servers => generated 378 bytes in 1277 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 16:46:09 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-48f7b2c7-2ef2-4c06-95e2-1235ae8694f9 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:46:09 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-48f7b2c7-2ef2-4c06-95e2-1235ae8694f9 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] [instance: 6e4776e8-d528-4110-90a3-daf4d1df0171] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:46:09 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_api:SELECT=11,nova_api:DELETE=1 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:46:09 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:46:10 user devstack@n-api.service[62053]: DEBUG nova.policy [None req-48f7b2c7-2ef2-4c06-95e2-1235ae8694f9 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '623668858bee4d308f31f4facd600fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0bb7653df574769941cf284c6a63154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62053) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:46:10 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-48f7b2c7-2ef2-4c06-95e2-1235ae8694f9 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6e4776e8-d528-4110-90a3-daf4d1df0171" status: 200 len: 1207 microversion: 2.1 time: 0.326226 Apr 13 16:46:10 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 303/905] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:46:09 2023] GET /compute/v2.1/servers/6e4776e8-d528-4110-90a3-daf4d1df0171 => generated 1207 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:46:12 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_api:SELECT=10 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:46:12 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_cell1:SELECT=16 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:46:12 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-e026e985-1af5-4dc7-b677-a6f225618859 req-4d6114cb-d9d0-4249-8870-e4dc05e1ddf4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e4776e8-d528-4110-90a3-daf4d1df0171", "tag": "e4d1a1bf-cfc0-43cb-a0a2-db01fe4fd0e7"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:46:12 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-e026e985-1af5-4dc7-b677-a6f225618859 req-4d6114cb-d9d0-4249-8870-e4dc05e1ddf4 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:46:12 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-e026e985-1af5-4dc7-b677-a6f225618859 req-4d6114cb-d9d0-4249-8870-e4dc05e1ddf4 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:46:12 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-e026e985-1af5-4dc7-b677-a6f225618859 req-4d6114cb-d9d0-4249-8870-e4dc05e1ddf4 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:46:12 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-e026e985-1af5-4dc7-b677-a6f225618859 req-4d6114cb-d9d0-4249-8870-e4dc05e1ddf4 service nova] Creating event network-changed:e4d1a1bf-cfc0-43cb-a0a2-db01fe4fd0e7 for instance 6e4776e8-d528-4110-90a3-daf4d1df0171 on user Apr 13 16:46:12 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [req-e026e985-1af5-4dc7-b677-a6f225618859 req-4d6114cb-d9d0-4249-8870-e4dc05e1ddf4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091394 Apr 13 16:46:12 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 303/906] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:46:12 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:46:14 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [req-d61a4ae1-8807-4d1f-aa9a-5061a1ce40f1 req-e386759a-43d9-423f-a115-7e6d2e94a055 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e4776e8-d528-4110-90a3-daf4d1df0171", "name": "network-vif-plugged", "status": "completed", "tag": "e4d1a1bf-cfc0-43cb-a0a2-db01fe4fd0e7"}]} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:46:14 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-d61a4ae1-8807-4d1f-aa9a-5061a1ce40f1 req-e386759a-43d9-423f-a115-7e6d2e94a055 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:46:14 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-d61a4ae1-8807-4d1f-aa9a-5061a1ce40f1 req-e386759a-43d9-423f-a115-7e6d2e94a055 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:46:14 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-d61a4ae1-8807-4d1f-aa9a-5061a1ce40f1 req-e386759a-43d9-423f-a115-7e6d2e94a055 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:46:14 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-d61a4ae1-8807-4d1f-aa9a-5061a1ce40f1 req-e386759a-43d9-423f-a115-7e6d2e94a055 service nova] Creating event network-vif-plugged:e4d1a1bf-cfc0-43cb-a0a2-db01fe4fd0e7 for instance 6e4776e8-d528-4110-90a3-daf4d1df0171 on user Apr 13 16:46:14 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [req-d61a4ae1-8807-4d1f-aa9a-5061a1ce40f1 req-e386759a-43d9-423f-a115-7e6d2e94a055 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094295 Apr 13 16:46:14 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 301/907] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:46:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:46:16 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-38677630-82a9-4700-9e75-1d6ffeab84f0 req-da587bf3-49ca-421e-a5c2-50676a0247a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e4776e8-d528-4110-90a3-daf4d1df0171", "name": "network-vif-plugged", "status": "completed", "tag": "e4d1a1bf-cfc0-43cb-a0a2-db01fe4fd0e7"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:46:16 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-38677630-82a9-4700-9e75-1d6ffeab84f0 req-da587bf3-49ca-421e-a5c2-50676a0247a0 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:46:16 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-38677630-82a9-4700-9e75-1d6ffeab84f0 req-da587bf3-49ca-421e-a5c2-50676a0247a0 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:46:16 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-38677630-82a9-4700-9e75-1d6ffeab84f0 req-da587bf3-49ca-421e-a5c2-50676a0247a0 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:46:16 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-38677630-82a9-4700-9e75-1d6ffeab84f0 req-da587bf3-49ca-421e-a5c2-50676a0247a0 service nova] Creating event network-vif-plugged:e4d1a1bf-cfc0-43cb-a0a2-db01fe4fd0e7 for instance 6e4776e8-d528-4110-90a3-daf4d1df0171 on user Apr 13 16:46:16 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [req-38677630-82a9-4700-9e75-1d6ffeab84f0 req-da587bf3-49ca-421e-a5c2-50676a0247a0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051794 Apr 13 16:46:16 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 304/908] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:46:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:46:27 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_api:SELECT=2 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:46:27 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_cell1:SELECT=2 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:46:27 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-e7497836-eedf-4044-b5d6-91143ff7717e tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:46:27 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-e7497836-eedf-4044-b5d6-91143ff7717e tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:46:27 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-e7497836-eedf-4044-b5d6-91143ff7717e tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:46:27 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-e7497836-eedf-4044-b5d6-91143ff7717e tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:46:27 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-e7497836-eedf-4044-b5d6-91143ff7717e tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:46:27 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-e7497836-eedf-4044-b5d6-91143ff7717e tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:46:27 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-e7497836-eedf-4044-b5d6-91143ff7717e tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:46:27 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-e7497836-eedf-4044-b5d6-91143ff7717e tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:46:27 user devstack@n-api.service[62054]: DEBUG nova.policy [None req-e7497836-eedf-4044-b5d6-91143ff7717e tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c7f54723c494e05ada117353c0790cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '846732ecb7e047128b4684972d3cd8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62054) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:46:27 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-e7497836-eedf-4044-b5d6-91143ff7717e tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b2d55cdd-c89c-4c59-afe1-49a33225af22" status: 200 len: 1490 microversion: 2.1 time: 0.315794 Apr 13 16:46:27 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 304/909] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:46:27 2023] GET /compute/v2.1/servers/b2d55cdd-c89c-4c59-afe1-49a33225af22 => generated 1490 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:46:30 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_cell0:SELECT=2 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:46:30 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_cell0:SELECT=6 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:46:30 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=3 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:46:30 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_cell1:SELECT=4 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:46:30 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-3eca2445-8b26-45a3-b67e-92a13c22ba96 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:46:30 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-3eca2445-8b26-45a3-b67e-92a13c22ba96 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:46:30 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-3eca2445-8b26-45a3-b67e-92a13c22ba96 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:46:30 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-3eca2445-8b26-45a3-b67e-92a13c22ba96 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:46:30 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-3eca2445-8b26-45a3-b67e-92a13c22ba96 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:46:30 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-3eca2445-8b26-45a3-b67e-92a13c22ba96 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:46:30 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-3eca2445-8b26-45a3-b67e-92a13c22ba96 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:46:30 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-3eca2445-8b26-45a3-b67e-92a13c22ba96 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:46:30 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-3eca2445-8b26-45a3-b67e-92a13c22ba96 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Going to try to terminate instance {{(pid=62055) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 16:46:30 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-3eca2445-8b26-45a3-b67e-92a13c22ba96 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/7ae7d3d9-54f7-4c64-8bf6-08fa5c526687" status: 204 len: 0 microversion: 2.1 time: 0.408387 Apr 13 16:46:30 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 302/910] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 16:46:30 2023] DELETE /compute/v2.1/servers/7ae7d3d9-54f7-4c64-8bf6-08fa5c526687 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 16:46:30 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_cell0:SELECT=2 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:46:30 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_api:SELECT=6 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:46:30 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_cell1:SELECT=2 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:46:30 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-b84bf1f2-56e0-4a7a-aa7c-163a3a78b66b tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:46:30 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-b84bf1f2-56e0-4a7a-aa7c-163a3a78b66b tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:46:30 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-b84bf1f2-56e0-4a7a-aa7c-163a3a78b66b tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:46:30 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-b84bf1f2-56e0-4a7a-aa7c-163a3a78b66b tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:46:30 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-b84bf1f2-56e0-4a7a-aa7c-163a3a78b66b tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:46:30 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-b84bf1f2-56e0-4a7a-aa7c-163a3a78b66b tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:46:30 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-b84bf1f2-56e0-4a7a-aa7c-163a3a78b66b tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:46:30 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-b84bf1f2-56e0-4a7a-aa7c-163a3a78b66b tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:46:31 user devstack@n-api.service[62053]: DEBUG nova.policy [None req-b84bf1f2-56e0-4a7a-aa7c-163a3a78b66b tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b3df1c5c5d441819bcef89ed6966815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980559734a504574a83224deb7423c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62053) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:46:31 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-b84bf1f2-56e0-4a7a-aa7c-163a3a78b66b tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7ae7d3d9-54f7-4c64-8bf6-08fa5c526687" status: 200 len: 1554 microversion: 2.1 time: 0.256977 Apr 13 16:46:31 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 305/911] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:46:30 2023] GET /compute/v2.1/servers/7ae7d3d9-54f7-4c64-8bf6-08fa5c526687 => generated 1554 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:46:31 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-2c149d45-fc0a-4b7b-9b76-8d9240e6c9be req-47db9538-67d2-4f46-bbc6-d9de34621a11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ae7d3d9-54f7-4c64-8bf6-08fa5c526687", "name": "network-vif-unplugged", "status": "completed", "tag": "f7ec2f7f-f505-44ed-b40d-7b91b2248cea"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:46:31 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-2c149d45-fc0a-4b7b-9b76-8d9240e6c9be req-47db9538-67d2-4f46-bbc6-d9de34621a11 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:46:31 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-2c149d45-fc0a-4b7b-9b76-8d9240e6c9be req-47db9538-67d2-4f46-bbc6-d9de34621a11 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:46:31 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-2c149d45-fc0a-4b7b-9b76-8d9240e6c9be req-47db9538-67d2-4f46-bbc6-d9de34621a11 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:46:31 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-2c149d45-fc0a-4b7b-9b76-8d9240e6c9be req-47db9538-67d2-4f46-bbc6-d9de34621a11 service nova] Creating event network-vif-unplugged:f7ec2f7f-f505-44ed-b40d-7b91b2248cea for instance 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687 on user Apr 13 16:46:31 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [req-2c149d45-fc0a-4b7b-9b76-8d9240e6c9be req-47db9538-67d2-4f46-bbc6-d9de34621a11 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049565 Apr 13 16:46:31 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 305/912] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:46:31 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:46:33 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [req-aa833fd4-3a72-4b06-bf73-87f658f8498f req-592e2ee6-a23b-4148-a409-4d5bb4f6e8dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ae7d3d9-54f7-4c64-8bf6-08fa5c526687", "name": "network-vif-deleted", "tag": "f7ec2f7f-f505-44ed-b40d-7b91b2248cea"}]} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:46:33 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-aa833fd4-3a72-4b06-bf73-87f658f8498f req-592e2ee6-a23b-4148-a409-4d5bb4f6e8dd service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:46:33 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-aa833fd4-3a72-4b06-bf73-87f658f8498f req-592e2ee6-a23b-4148-a409-4d5bb4f6e8dd service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:46:33 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-aa833fd4-3a72-4b06-bf73-87f658f8498f req-592e2ee6-a23b-4148-a409-4d5bb4f6e8dd service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:46:33 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-aa833fd4-3a72-4b06-bf73-87f658f8498f req-592e2ee6-a23b-4148-a409-4d5bb4f6e8dd service nova] Creating event network-vif-deleted:f7ec2f7f-f505-44ed-b40d-7b91b2248cea for instance 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687 on user Apr 13 16:46:33 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [req-aa833fd4-3a72-4b06-bf73-87f658f8498f req-592e2ee6-a23b-4148-a409-4d5bb4f6e8dd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034102 Apr 13 16:46:33 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 303/913] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:46:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:46:33 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-00019b7f-5176-44f9-9810-3df5265c2d83 req-0d8e2dae-06b0-484e-950d-4e0b996b60ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ae7d3d9-54f7-4c64-8bf6-08fa5c526687", "name": "network-vif-plugged", "status": "completed", "tag": "f7ec2f7f-f505-44ed-b40d-7b91b2248cea"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:46:33 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-00019b7f-5176-44f9-9810-3df5265c2d83 req-0d8e2dae-06b0-484e-950d-4e0b996b60ec service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:46:33 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-00019b7f-5176-44f9-9810-3df5265c2d83 req-0d8e2dae-06b0-484e-950d-4e0b996b60ec service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:46:33 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-00019b7f-5176-44f9-9810-3df5265c2d83 req-0d8e2dae-06b0-484e-950d-4e0b996b60ec service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:46:33 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-00019b7f-5176-44f9-9810-3df5265c2d83 req-0d8e2dae-06b0-484e-950d-4e0b996b60ec service nova] Creating event network-vif-plugged:f7ec2f7f-f505-44ed-b40d-7b91b2248cea for instance 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687 on user Apr 13 16:46:33 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [req-00019b7f-5176-44f9-9810-3df5265c2d83 req-0d8e2dae-06b0-484e-950d-4e0b996b60ec service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031793 Apr 13 16:46:33 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 306/914] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:46:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:47:00 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_api:SELECT=4 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:47:00 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_cell1:SELECT=8 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:47:00 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-fdd30d70-b9f6-4fa3-a0d8-41bc1467dfee tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:47:00 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-fdd30d70-b9f6-4fa3-a0d8-41bc1467dfee tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] [instance: 6e4776e8-d528-4110-90a3-daf4d1df0171] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:47:00 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-fdd30d70-b9f6-4fa3-a0d8-41bc1467dfee tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:47:00 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-fdd30d70-b9f6-4fa3-a0d8-41bc1467dfee tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:47:00 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-fdd30d70-b9f6-4fa3-a0d8-41bc1467dfee tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:47:00 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-fdd30d70-b9f6-4fa3-a0d8-41bc1467dfee tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:47:00 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-fdd30d70-b9f6-4fa3-a0d8-41bc1467dfee tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:47:00 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-fdd30d70-b9f6-4fa3-a0d8-41bc1467dfee tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:47:00 user devstack@n-api.service[62054]: DEBUG nova.policy [None req-fdd30d70-b9f6-4fa3-a0d8-41bc1467dfee tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '623668858bee4d308f31f4facd600fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0bb7653df574769941cf284c6a63154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62054) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:47:00 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-fdd30d70-b9f6-4fa3-a0d8-41bc1467dfee tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6e4776e8-d528-4110-90a3-daf4d1df0171" status: 200 len: 1486 microversion: 2.1 time: 0.224257 Apr 13 16:47:00 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 306/915] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:47:00 2023] GET /compute/v2.1/servers/6e4776e8-d528-4110-90a3-daf4d1df0171 => generated 1486 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:47:21 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:47:21 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:47:21 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-736c0e25-0c73-41a3-941d-3ed8c856fe15 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:47:21 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-736c0e25-0c73-41a3-941d-3ed8c856fe15 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:47:21 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-736c0e25-0c73-41a3-941d-3ed8c856fe15 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:47:21 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-736c0e25-0c73-41a3-941d-3ed8c856fe15 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:47:21 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-736c0e25-0c73-41a3-941d-3ed8c856fe15 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:47:21 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-736c0e25-0c73-41a3-941d-3ed8c856fe15 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:47:21 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-736c0e25-0c73-41a3-941d-3ed8c856fe15 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:47:21 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-736c0e25-0c73-41a3-941d-3ed8c856fe15 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:47:21 user devstack@n-api.service[62055]: INFO nova.api.openstack.wsgi [None req-736c0e25-0c73-41a3-941d-3ed8c856fe15 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] HTTP exception thrown: Instance 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687 could not be found. Apr 13 16:47:21 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-736c0e25-0c73-41a3-941d-3ed8c856fe15 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Request method failure captured: Apr 13 16:47:21 user devstack@n-api.service[62055]: request: GET /compute/v2.1/servers/7ae7d3d9-54f7-4c64-8bf6-08fa5c526687 HTTP/1.1 Apr 13 16:47:21 user devstack@n-api.service[62055]: Accept: application/json Apr 13 16:47:21 user devstack@n-api.service[62055]: Accept-Encoding: identity Apr 13 16:47:21 user devstack@n-api.service[62055]: Connection: close Apr 13 16:47:21 user devstack@n-api.service[62055]: Content-Length: 0 Apr 13 16:47:21 user devstack@n-api.service[62055]: Content-Type: application/json Apr 13 16:47:21 user devstack@n-api.service[62055]: Host: 10.0.0.210 Apr 13 16:47:21 user devstack@n-api.service[62055]: Openstack-System-Scope: None Apr 13 16:47:21 user devstack@n-api.service[62055]: User-Agent: python-urllib3/1.26.15 Apr 13 16:47:21 user devstack@n-api.service[62055]: X-Auth-Token: gAAAAABkOCyK6iWxIKqDSv6H0rT6hYe7MptxZpmd0isb-i7vUg3jso0s7xsZUrxtoSvPcGgCBo4hK2dNDP0kQx-ibuil0c2Kvsteo-AJ1R0h80Zm73FGeLTKieLGMCzhQ82f-tUm8n-Fpt56d3KgkMnkmwHhKR_MJqNeo3xk_dFOMXNz_EA5ymA Apr 13 16:47:21 user devstack@n-api.service[62055]: X-Domain-Id: None Apr 13 16:47:21 user devstack@n-api.service[62055]: X-Domain-Name: None Apr 13 16:47:21 user devstack@n-api.service[62055]: X-Identity-Status: Confirmed Apr 13 16:47:21 user devstack@n-api.service[62055]: X-Is-Admin-Project: True Apr 13 16:47:21 user devstack@n-api.service[62055]: X-Project-Domain-Id: default Apr 13 16:47:21 user devstack@n-api.service[62055]: X-Project-Domain-Name: Default Apr 13 16:47:21 user devstack@n-api.service[62055]: X-Project-Id: 980559734a504574a83224deb7423c77 Apr 13 16:47:21 user devstack@n-api.service[62055]: X-Project-Name: tempest-ServerActionsTestJSON-713402718 Apr 13 16:47:21 user devstack@n-api.service[62055]: X-Role: reader,member Apr 13 16:47:21 user devstack@n-api.service[62055]: X-Roles: reader,member Apr 13 16:47:21 user devstack@n-api.service[62055]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/980559734a504574a83224deb7423c77"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/980559734a504574a83224deb7423c77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/980559734a504574a83224deb7423c77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 13 16:47:21 user devstack@n-api.service[62055]: X-Tenant: tempest-ServerActionsTestJSON-713402718 Apr 13 16:47:21 user devstack@n-api.service[62055]: X-Tenant-Id: 980559734a504574a83224deb7423c77 Apr 13 16:47:21 user devstack@n-api.service[62055]: X-Tenant-Name: tempest-ServerActionsTestJSON-713402718 Apr 13 16:47:21 user devstack@n-api.service[62055]: X-User: tempest-ServerActionsTestJSON-713402718-project-member Apr 13 16:47:21 user devstack@n-api.service[62055]: X-User-Domain-Id: default Apr 13 16:47:21 user devstack@n-api.service[62055]: X-User-Domain-Name: Default Apr 13 16:47:21 user devstack@n-api.service[62055]: X-User-Id: 1b3df1c5c5d441819bcef89ed6966815 Apr 13 16:47:21 user devstack@n-api.service[62055]: X-User-Name: tempest-ServerActionsTestJSON-713402718-project-member Apr 13 16:47:21 user devstack@n-api.service[62055]: method: > Apr 13 16:47:21 user devstack@n-api.service[62055]: exception: Instance 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687 could not be found. Apr 13 16:47:21 user devstack@n-api.service[62055]: action_args: {'id': '7ae7d3d9-54f7-4c64-8bf6-08fa5c526687'} Apr 13 16:47:21 user devstack@n-api.service[62055]: {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 16:47:21 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:47:21 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 16:47:21 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 16:47:21 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 16:47:21 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 16:47:21 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 16:47:21 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 16:47:21 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 16:47:21 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 16:47:21 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687 could not be found. Apr 13 16:47:21 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:47:21 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:47:21 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:47:21 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:47:21 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 16:47:21 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 16:47:21 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 16:47:21 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 16:47:21 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 16:47:21 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 16:47:21 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 16:47:21 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 16:47:21 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 16:47:21 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 16:47:21 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 16:47:21 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 16:47:21 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687 could not be found. Apr 13 16:47:21 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:47:21 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:47:21 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:47:21 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:47:21 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 16:47:21 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 16:47:21 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 16:47:21 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 16:47:21 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687 could not be found. Apr 13 16:47:21 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:47:21 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-736c0e25-0c73-41a3-941d-3ed8c856fe15 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Returning 404 to user: Instance 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687 could not be found. {{(pid=62055) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 16:47:21 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-736c0e25-0c73-41a3-941d-3ed8c856fe15 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7ae7d3d9-54f7-4c64-8bf6-08fa5c526687" status: 404 len: 111 microversion: 2.1 time: 0.046774 Apr 13 16:47:21 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 304/916] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:47:21 2023] GET /compute/v2.1/servers/7ae7d3d9-54f7-4c64-8bf6-08fa5c526687 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 13 16:47:21 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_api:SELECT=4 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:47:21 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_cell1:SELECT=8 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:47:21 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-00dcc04f-cd30-43a1-9b88-4e4878da4a88 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:47:21 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-00dcc04f-cd30-43a1-9b88-4e4878da4a88 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:47:21 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-00dcc04f-cd30-43a1-9b88-4e4878da4a88 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:47:21 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-00dcc04f-cd30-43a1-9b88-4e4878da4a88 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:47:21 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-00dcc04f-cd30-43a1-9b88-4e4878da4a88 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:47:21 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-00dcc04f-cd30-43a1-9b88-4e4878da4a88 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:47:21 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-00dcc04f-cd30-43a1-9b88-4e4878da4a88 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:47:21 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-00dcc04f-cd30-43a1-9b88-4e4878da4a88 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:47:21 user devstack@n-api.service[62053]: INFO nova.api.openstack.wsgi [None req-00dcc04f-cd30-43a1-9b88-4e4878da4a88 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] HTTP exception thrown: Instance 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687 could not be found. Apr 13 16:47:21 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-00dcc04f-cd30-43a1-9b88-4e4878da4a88 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Request method failure captured: Apr 13 16:47:21 user devstack@n-api.service[62053]: request: DELETE /compute/v2.1/servers/7ae7d3d9-54f7-4c64-8bf6-08fa5c526687 HTTP/1.1 Apr 13 16:47:21 user devstack@n-api.service[62053]: Accept: application/json Apr 13 16:47:21 user devstack@n-api.service[62053]: Accept-Encoding: identity Apr 13 16:47:21 user devstack@n-api.service[62053]: Connection: close Apr 13 16:47:21 user devstack@n-api.service[62053]: Content-Length: 0 Apr 13 16:47:21 user devstack@n-api.service[62053]: Content-Type: application/json Apr 13 16:47:21 user devstack@n-api.service[62053]: Host: 10.0.0.210 Apr 13 16:47:21 user devstack@n-api.service[62053]: Openstack-System-Scope: None Apr 13 16:47:21 user devstack@n-api.service[62053]: User-Agent: python-urllib3/1.26.15 Apr 13 16:47:21 user devstack@n-api.service[62053]: X-Auth-Token: gAAAAABkOCyK6iWxIKqDSv6H0rT6hYe7MptxZpmd0isb-i7vUg3jso0s7xsZUrxtoSvPcGgCBo4hK2dNDP0kQx-ibuil0c2Kvsteo-AJ1R0h80Zm73FGeLTKieLGMCzhQ82f-tUm8n-Fpt56d3KgkMnkmwHhKR_MJqNeo3xk_dFOMXNz_EA5ymA Apr 13 16:47:21 user devstack@n-api.service[62053]: X-Domain-Id: None Apr 13 16:47:21 user devstack@n-api.service[62053]: X-Domain-Name: None Apr 13 16:47:21 user devstack@n-api.service[62053]: X-Identity-Status: Confirmed Apr 13 16:47:21 user devstack@n-api.service[62053]: X-Is-Admin-Project: True Apr 13 16:47:21 user devstack@n-api.service[62053]: X-Project-Domain-Id: default Apr 13 16:47:21 user devstack@n-api.service[62053]: X-Project-Domain-Name: Default Apr 13 16:47:21 user devstack@n-api.service[62053]: X-Project-Id: 980559734a504574a83224deb7423c77 Apr 13 16:47:21 user devstack@n-api.service[62053]: X-Project-Name: tempest-ServerActionsTestJSON-713402718 Apr 13 16:47:21 user devstack@n-api.service[62053]: X-Role: reader,member Apr 13 16:47:21 user devstack@n-api.service[62053]: X-Roles: reader,member Apr 13 16:47:21 user devstack@n-api.service[62053]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/980559734a504574a83224deb7423c77"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/980559734a504574a83224deb7423c77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/980559734a504574a83224deb7423c77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 13 16:47:21 user devstack@n-api.service[62053]: X-Tenant: tempest-ServerActionsTestJSON-713402718 Apr 13 16:47:21 user devstack@n-api.service[62053]: X-Tenant-Id: 980559734a504574a83224deb7423c77 Apr 13 16:47:21 user devstack@n-api.service[62053]: X-Tenant-Name: tempest-ServerActionsTestJSON-713402718 Apr 13 16:47:21 user devstack@n-api.service[62053]: X-User: tempest-ServerActionsTestJSON-713402718-project-member Apr 13 16:47:21 user devstack@n-api.service[62053]: X-User-Domain-Id: default Apr 13 16:47:21 user devstack@n-api.service[62053]: X-User-Domain-Name: Default Apr 13 16:47:21 user devstack@n-api.service[62053]: X-User-Id: 1b3df1c5c5d441819bcef89ed6966815 Apr 13 16:47:21 user devstack@n-api.service[62053]: X-User-Name: tempest-ServerActionsTestJSON-713402718-project-member Apr 13 16:47:21 user devstack@n-api.service[62053]: method: > Apr 13 16:47:21 user devstack@n-api.service[62053]: exception: Instance 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687 could not be found. Apr 13 16:47:21 user devstack@n-api.service[62053]: action_args: {'id': '7ae7d3d9-54f7-4c64-8bf6-08fa5c526687'} Apr 13 16:47:21 user devstack@n-api.service[62053]: {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 16:47:21 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:47:21 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 16:47:21 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 16:47:21 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 16:47:21 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 16:47:21 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 16:47:21 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 16:47:21 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 16:47:21 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 16:47:21 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687 could not be found. Apr 13 16:47:21 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:47:21 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:47:21 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:47:21 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:47:21 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 16:47:21 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 16:47:21 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 16:47:21 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 16:47:21 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 16:47:21 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 16:47:21 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 16:47:21 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 16:47:21 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 16:47:21 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 16:47:21 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 16:47:21 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 16:47:21 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 16:47:21 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 16:47:21 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687 could not be found. Apr 13 16:47:21 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:47:21 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:47:21 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:47:21 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:47:21 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 16:47:21 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 16:47:21 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 16:47:21 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 16:47:21 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687 could not be found. Apr 13 16:47:21 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:47:21 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-00dcc04f-cd30-43a1-9b88-4e4878da4a88 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Returning 404 to user: Instance 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687 could not be found. {{(pid=62053) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 16:47:21 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-00dcc04f-cd30-43a1-9b88-4e4878da4a88 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/7ae7d3d9-54f7-4c64-8bf6-08fa5c526687" status: 404 len: 111 microversion: 2.1 time: 0.042514 Apr 13 16:47:21 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 307/917] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 16:47:21 2023] DELETE /compute/v2.1/servers/7ae7d3d9-54f7-4c64-8bf6-08fa5c526687 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 13 16:47:21 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-75aa866c-8c4c-47a6-a584-49f547b0d5ab tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:47:21 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-75aa866c-8c4c-47a6-a584-49f547b0d5ab tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:47:21 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_api:SELECT=2 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:47:21 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_cell1:SELECT=6 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:47:21 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-75aa866c-8c4c-47a6-a584-49f547b0d5ab tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:47:21 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-75aa866c-8c4c-47a6-a584-49f547b0d5ab tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:47:21 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-75aa866c-8c4c-47a6-a584-49f547b0d5ab tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:47:21 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-75aa866c-8c4c-47a6-a584-49f547b0d5ab tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:47:21 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-75aa866c-8c4c-47a6-a584-49f547b0d5ab tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:47:21 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-75aa866c-8c4c-47a6-a584-49f547b0d5ab tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:47:21 user devstack@n-api.service[62054]: INFO nova.api.openstack.wsgi [None req-75aa866c-8c4c-47a6-a584-49f547b0d5ab tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] HTTP exception thrown: Instance 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687 could not be found. Apr 13 16:47:21 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-75aa866c-8c4c-47a6-a584-49f547b0d5ab tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Request method failure captured: Apr 13 16:47:21 user devstack@n-api.service[62054]: request: GET /compute/v2.1/servers/7ae7d3d9-54f7-4c64-8bf6-08fa5c526687 HTTP/1.1 Apr 13 16:47:21 user devstack@n-api.service[62054]: Accept: application/json Apr 13 16:47:21 user devstack@n-api.service[62054]: Accept-Encoding: identity Apr 13 16:47:21 user devstack@n-api.service[62054]: Connection: close Apr 13 16:47:21 user devstack@n-api.service[62054]: Content-Length: 0 Apr 13 16:47:21 user devstack@n-api.service[62054]: Content-Type: application/json Apr 13 16:47:21 user devstack@n-api.service[62054]: Host: 10.0.0.210 Apr 13 16:47:21 user devstack@n-api.service[62054]: Openstack-System-Scope: None Apr 13 16:47:21 user devstack@n-api.service[62054]: User-Agent: python-urllib3/1.26.15 Apr 13 16:47:21 user devstack@n-api.service[62054]: X-Auth-Token: gAAAAABkOCyK6iWxIKqDSv6H0rT6hYe7MptxZpmd0isb-i7vUg3jso0s7xsZUrxtoSvPcGgCBo4hK2dNDP0kQx-ibuil0c2Kvsteo-AJ1R0h80Zm73FGeLTKieLGMCzhQ82f-tUm8n-Fpt56d3KgkMnkmwHhKR_MJqNeo3xk_dFOMXNz_EA5ymA Apr 13 16:47:21 user devstack@n-api.service[62054]: X-Domain-Id: None Apr 13 16:47:21 user devstack@n-api.service[62054]: X-Domain-Name: None Apr 13 16:47:21 user devstack@n-api.service[62054]: X-Identity-Status: Confirmed Apr 13 16:47:21 user devstack@n-api.service[62054]: X-Is-Admin-Project: True Apr 13 16:47:21 user devstack@n-api.service[62054]: X-Project-Domain-Id: default Apr 13 16:47:21 user devstack@n-api.service[62054]: X-Project-Domain-Name: Default Apr 13 16:47:21 user devstack@n-api.service[62054]: X-Project-Id: 980559734a504574a83224deb7423c77 Apr 13 16:47:21 user devstack@n-api.service[62054]: X-Project-Name: tempest-ServerActionsTestJSON-713402718 Apr 13 16:47:21 user devstack@n-api.service[62054]: X-Role: reader,member Apr 13 16:47:21 user devstack@n-api.service[62054]: X-Roles: reader,member Apr 13 16:47:21 user devstack@n-api.service[62054]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/980559734a504574a83224deb7423c77"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/980559734a504574a83224deb7423c77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/980559734a504574a83224deb7423c77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 13 16:47:21 user devstack@n-api.service[62054]: X-Tenant: tempest-ServerActionsTestJSON-713402718 Apr 13 16:47:21 user devstack@n-api.service[62054]: X-Tenant-Id: 980559734a504574a83224deb7423c77 Apr 13 16:47:21 user devstack@n-api.service[62054]: X-Tenant-Name: tempest-ServerActionsTestJSON-713402718 Apr 13 16:47:21 user devstack@n-api.service[62054]: X-User: tempest-ServerActionsTestJSON-713402718-project-member Apr 13 16:47:21 user devstack@n-api.service[62054]: X-User-Domain-Id: default Apr 13 16:47:21 user devstack@n-api.service[62054]: X-User-Domain-Name: Default Apr 13 16:47:21 user devstack@n-api.service[62054]: X-User-Id: 1b3df1c5c5d441819bcef89ed6966815 Apr 13 16:47:21 user devstack@n-api.service[62054]: X-User-Name: tempest-ServerActionsTestJSON-713402718-project-member Apr 13 16:47:21 user devstack@n-api.service[62054]: method: > Apr 13 16:47:21 user devstack@n-api.service[62054]: exception: Instance 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687 could not be found. Apr 13 16:47:21 user devstack@n-api.service[62054]: action_args: {'id': '7ae7d3d9-54f7-4c64-8bf6-08fa5c526687'} Apr 13 16:47:21 user devstack@n-api.service[62054]: {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 16:47:21 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:47:21 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 16:47:21 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 16:47:21 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 16:47:21 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 16:47:21 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 16:47:21 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 16:47:21 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 16:47:21 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 16:47:21 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687 could not be found. Apr 13 16:47:21 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:47:21 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:47:21 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:47:21 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:47:21 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 16:47:21 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 16:47:21 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 16:47:21 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 16:47:21 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 16:47:21 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 16:47:21 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 16:47:21 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 16:47:21 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 16:47:21 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 16:47:21 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 16:47:21 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 16:47:21 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687 could not be found. Apr 13 16:47:21 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:47:21 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:47:21 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:47:21 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:47:21 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 16:47:21 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 16:47:21 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 16:47:21 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 16:47:21 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687 could not be found. Apr 13 16:47:21 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:47:21 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-75aa866c-8c4c-47a6-a584-49f547b0d5ab tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Returning 404 to user: Instance 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687 could not be found. {{(pid=62054) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 16:47:21 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-75aa866c-8c4c-47a6-a584-49f547b0d5ab tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7ae7d3d9-54f7-4c64-8bf6-08fa5c526687" status: 404 len: 111 microversion: 2.1 time: 0.036266 Apr 13 16:47:21 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 307/918] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:47:21 2023] GET /compute/v2.1/servers/7ae7d3d9-54f7-4c64-8bf6-08fa5c526687 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 16:47:21 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-f59981bc-ad59-406c-b688-e1790f57e724 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:47:21 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-f59981bc-ad59-406c-b688-e1790f57e724 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 5ed800fe-577d-4624-898c-c7f40da77376] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:47:21 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-f59981bc-ad59-406c-b688-e1790f57e724 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:47:21 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-f59981bc-ad59-406c-b688-e1790f57e724 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:47:21 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-f59981bc-ad59-406c-b688-e1790f57e724 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:47:21 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-f59981bc-ad59-406c-b688-e1790f57e724 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:47:21 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-f59981bc-ad59-406c-b688-e1790f57e724 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:47:21 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-f59981bc-ad59-406c-b688-e1790f57e724 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:47:21 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-f59981bc-ad59-406c-b688-e1790f57e724 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 5ed800fe-577d-4624-898c-c7f40da77376] Going to try to terminate instance {{(pid=62055) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 16:47:21 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-f59981bc-ad59-406c-b688-e1790f57e724 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5ed800fe-577d-4624-898c-c7f40da77376" status: 204 len: 0 microversion: 2.1 time: 0.125086 Apr 13 16:47:21 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 305/919] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 16:47:21 2023] DELETE /compute/v2.1/servers/5ed800fe-577d-4624-898c-c7f40da77376 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 16:47:21 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-9e622572-e845-40bd-8115-12274cff970d tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:47:21 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-9e622572-e845-40bd-8115-12274cff970d tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 5ed800fe-577d-4624-898c-c7f40da77376] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:47:21 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-9e622572-e845-40bd-8115-12274cff970d tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:47:21 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-9e622572-e845-40bd-8115-12274cff970d tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:47:21 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-9e622572-e845-40bd-8115-12274cff970d tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:47:21 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-9e622572-e845-40bd-8115-12274cff970d tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:47:21 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-9e622572-e845-40bd-8115-12274cff970d tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:47:21 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-9e622572-e845-40bd-8115-12274cff970d tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:47:21 user devstack@n-api.service[62053]: DEBUG nova.policy [None req-9e622572-e845-40bd-8115-12274cff970d tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b3df1c5c5d441819bcef89ed6966815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980559734a504574a83224deb7423c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62053) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:47:21 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-9e622572-e845-40bd-8115-12274cff970d tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5ed800fe-577d-4624-898c-c7f40da77376" status: 200 len: 1545 microversion: 2.1 time: 0.176613 Apr 13 16:47:21 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 308/920] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:47:21 2023] GET /compute/v2.1/servers/5ed800fe-577d-4624-898c-c7f40da77376 => generated 1545 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:47:21 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-15009e63-06e7-45f5-bdca-e461306cf866 req-eb74cd4a-fa7b-469c-b388-8a510ef73239 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ed800fe-577d-4624-898c-c7f40da77376", "name": "network-vif-unplugged", "status": "completed", "tag": "09531419-c0ff-4d13-89bd-06caa28e019d"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:47:21 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-15009e63-06e7-45f5-bdca-e461306cf866 req-eb74cd4a-fa7b-469c-b388-8a510ef73239 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:47:21 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-15009e63-06e7-45f5-bdca-e461306cf866 req-eb74cd4a-fa7b-469c-b388-8a510ef73239 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:47:21 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-15009e63-06e7-45f5-bdca-e461306cf866 req-eb74cd4a-fa7b-469c-b388-8a510ef73239 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:47:21 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-15009e63-06e7-45f5-bdca-e461306cf866 req-eb74cd4a-fa7b-469c-b388-8a510ef73239 service nova] Creating event network-vif-unplugged:09531419-c0ff-4d13-89bd-06caa28e019d for instance 5ed800fe-577d-4624-898c-c7f40da77376 on user Apr 13 16:47:21 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [req-15009e63-06e7-45f5-bdca-e461306cf866 req-eb74cd4a-fa7b-469c-b388-8a510ef73239 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031567 Apr 13 16:47:21 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 308/921] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:47:21 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:47:22 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [req-1e9f2583-6f61-4c7a-b1ed-320ea90dfadb req-25a19d28-56a9-469b-9e19-250a7c9e34e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ed800fe-577d-4624-898c-c7f40da77376", "name": "network-vif-deleted", "tag": "09531419-c0ff-4d13-89bd-06caa28e019d"}]} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:47:22 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-1e9f2583-6f61-4c7a-b1ed-320ea90dfadb req-25a19d28-56a9-469b-9e19-250a7c9e34e9 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:47:22 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-1e9f2583-6f61-4c7a-b1ed-320ea90dfadb req-25a19d28-56a9-469b-9e19-250a7c9e34e9 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:47:22 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-1e9f2583-6f61-4c7a-b1ed-320ea90dfadb req-25a19d28-56a9-469b-9e19-250a7c9e34e9 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:47:22 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-1e9f2583-6f61-4c7a-b1ed-320ea90dfadb req-25a19d28-56a9-469b-9e19-250a7c9e34e9 service nova] Creating event network-vif-deleted:09531419-c0ff-4d13-89bd-06caa28e019d for instance 5ed800fe-577d-4624-898c-c7f40da77376 on user Apr 13 16:47:22 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [req-1e9f2583-6f61-4c7a-b1ed-320ea90dfadb req-25a19d28-56a9-469b-9e19-250a7c9e34e9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032989 Apr 13 16:47:22 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 306/922] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:47:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:47:23 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-533d1b41-32f3-443e-8492-9a76d15a0d20 req-2af81620-a3e5-48f8-a022-0cf319a755b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ed800fe-577d-4624-898c-c7f40da77376", "name": "network-vif-plugged", "status": "completed", "tag": "09531419-c0ff-4d13-89bd-06caa28e019d"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:47:23 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-533d1b41-32f3-443e-8492-9a76d15a0d20 req-2af81620-a3e5-48f8-a022-0cf319a755b7 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:47:23 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-533d1b41-32f3-443e-8492-9a76d15a0d20 req-2af81620-a3e5-48f8-a022-0cf319a755b7 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:47:23 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-533d1b41-32f3-443e-8492-9a76d15a0d20 req-2af81620-a3e5-48f8-a022-0cf319a755b7 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:47:23 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-533d1b41-32f3-443e-8492-9a76d15a0d20 req-2af81620-a3e5-48f8-a022-0cf319a755b7 service nova] Creating event network-vif-plugged:09531419-c0ff-4d13-89bd-06caa28e019d for instance 5ed800fe-577d-4624-898c-c7f40da77376 on user Apr 13 16:47:23 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [req-533d1b41-32f3-443e-8492-9a76d15a0d20 req-2af81620-a3e5-48f8-a022-0cf319a755b7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030558 Apr 13 16:47:23 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 309/923] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:47:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:47:27 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-3478b1cb-e752-4b7a-891b-cfeb762fb72d tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "28506db0-93c1-45bf-940b-4ee5c422babe"}} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:47:27 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-3478b1cb-e752-4b7a-891b-cfeb762fb72d tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:47:27 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-3478b1cb-e752-4b7a-891b-cfeb762fb72d tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:47:27 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-3478b1cb-e752-4b7a-891b-cfeb762fb72d tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:47:27 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-3478b1cb-e752-4b7a-891b-cfeb762fb72d tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:47:27 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-3478b1cb-e752-4b7a-891b-cfeb762fb72d tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:47:27 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-3478b1cb-e752-4b7a-891b-cfeb762fb72d tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:47:27 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-3478b1cb-e752-4b7a-891b-cfeb762fb72d tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:47:27 user devstack@n-api.service[62054]: INFO nova.api.openstack.wsgi [None req-3478b1cb-e752-4b7a-891b-cfeb762fb72d tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] HTTP exception thrown: Cannot 'attach_volume' instance b2d55cdd-c89c-4c59-afe1-49a33225af22 while it is in vm_state rescued Apr 13 16:47:27 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-3478b1cb-e752-4b7a-891b-cfeb762fb72d tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Request method failure captured: Apr 13 16:47:27 user devstack@n-api.service[62054]: request: POST /compute/v2.1/servers/b2d55cdd-c89c-4c59-afe1-49a33225af22/os-volume_attachments HTTP/1.1 Apr 13 16:47:27 user devstack@n-api.service[62054]: Accept: application/json Apr 13 16:47:27 user devstack@n-api.service[62054]: Accept-Encoding: identity Apr 13 16:47:27 user devstack@n-api.service[62054]: Connection: close Apr 13 16:47:27 user devstack@n-api.service[62054]: Content-Length: 74 Apr 13 16:47:27 user devstack@n-api.service[62054]: Content-Type: application/json Apr 13 16:47:27 user devstack@n-api.service[62054]: Host: 10.0.0.210 Apr 13 16:47:27 user devstack@n-api.service[62054]: Openstack-System-Scope: None Apr 13 16:47:27 user devstack@n-api.service[62054]: User-Agent: python-urllib3/1.26.15 Apr 13 16:47:27 user devstack@n-api.service[62054]: X-Auth-Token: gAAAAABkODCU3usXoI1IVebJSthBcEDDnDQRiqRW1FYIxzNbUkDIlDU6UteHgRT6XFjSy--lQKRkgams1V-mY1gd5tPke-vWBOfO2UtdZbzdTxwejYVyhVlXHTvoZAZm9c6SfYSLgZwcZgvQEz-q8fj1HcQgZ7FQjGdabv9rlkNPMhT1A1Ry22g Apr 13 16:47:27 user devstack@n-api.service[62054]: X-Domain-Id: None Apr 13 16:47:27 user devstack@n-api.service[62054]: X-Domain-Name: None Apr 13 16:47:27 user devstack@n-api.service[62054]: X-Identity-Status: Confirmed Apr 13 16:47:27 user devstack@n-api.service[62054]: X-Is-Admin-Project: True Apr 13 16:47:27 user devstack@n-api.service[62054]: X-Project-Domain-Id: default Apr 13 16:47:27 user devstack@n-api.service[62054]: X-Project-Domain-Name: Default Apr 13 16:47:27 user devstack@n-api.service[62054]: X-Project-Id: 846732ecb7e047128b4684972d3cd8c6 Apr 13 16:47:27 user devstack@n-api.service[62054]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-84287455 Apr 13 16:47:27 user devstack@n-api.service[62054]: X-Role: reader,member Apr 13 16:47:27 user devstack@n-api.service[62054]: X-Roles: reader,member Apr 13 16:47:27 user devstack@n-api.service[62054]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/846732ecb7e047128b4684972d3cd8c6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/846732ecb7e047128b4684972d3cd8c6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/846732ecb7e047128b4684972d3cd8c6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 13 16:47:27 user devstack@n-api.service[62054]: X-Tenant: tempest-ServerRescueNegativeTestJSON-84287455 Apr 13 16:47:27 user devstack@n-api.service[62054]: X-Tenant-Id: 846732ecb7e047128b4684972d3cd8c6 Apr 13 16:47:27 user devstack@n-api.service[62054]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-84287455 Apr 13 16:47:27 user devstack@n-api.service[62054]: X-User: tempest-ServerRescueNegativeTestJSON-84287455-project-member Apr 13 16:47:27 user devstack@n-api.service[62054]: X-User-Domain-Id: default Apr 13 16:47:27 user devstack@n-api.service[62054]: X-User-Domain-Name: Default Apr 13 16:47:27 user devstack@n-api.service[62054]: X-User-Id: 0c7f54723c494e05ada117353c0790cb Apr 13 16:47:27 user devstack@n-api.service[62054]: X-User-Name: tempest-ServerRescueNegativeTestJSON-84287455-project-member Apr 13 16:47:27 user devstack@n-api.service[62054]: Apr 13 16:47:27 user devstack@n-api.service[62054]: {"volumeAttachment": {"volumeId": "28506db0-93c1-45bf-940b-4ee5c422babe"}} Apr 13 16:47:27 user devstack@n-api.service[62054]: method: > Apr 13 16:47:27 user devstack@n-api.service[62054]: exception: Cannot 'attach_volume' instance b2d55cdd-c89c-4c59-afe1-49a33225af22 while it is in vm_state rescued Apr 13 16:47:27 user devstack@n-api.service[62054]: action_args: {'server_id': 'b2d55cdd-c89c-4c59-afe1-49a33225af22', 'body': {'volumeAttachment': {'volumeId': '28506db0-93c1-45bf-940b-4ee5c422babe'}}} Apr 13 16:47:27 user devstack@n-api.service[62054]: {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 16:47:27 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:47:27 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Apr 13 16:47:27 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Apr 13 16:47:27 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 13 16:47:27 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 13 16:47:27 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Apr 13 16:47:27 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Apr 13 16:47:27 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b2d55cdd-c89c-4c59-afe1-49a33225af22 in vm_state rescued. Cannot attach_volume while the instance is in this state. Apr 13 16:47:27 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:47:27 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:47:27 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:47:27 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:47:27 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 16:47:27 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 16:47:27 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 16:47:27 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 16:47:27 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 16:47:27 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 16:47:27 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 13 16:47:27 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 16:47:27 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 13 16:47:27 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 16:47:27 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 13 16:47:27 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 16:47:27 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Apr 13 16:47:27 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Apr 13 16:47:27 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Apr 13 16:47:27 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Apr 13 16:47:27 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance b2d55cdd-c89c-4c59-afe1-49a33225af22 while it is in vm_state rescued Apr 13 16:47:27 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:47:27 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:47:27 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:47:27 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:47:27 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 16:47:27 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 16:47:27 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 16:47:27 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 16:47:27 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance b2d55cdd-c89c-4c59-afe1-49a33225af22 while it is in vm_state rescued Apr 13 16:47:27 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:47:27 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-3478b1cb-e752-4b7a-891b-cfeb762fb72d tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Returning 409 to user: Cannot 'attach_volume' instance b2d55cdd-c89c-4c59-afe1-49a33225af22 while it is in vm_state rescued {{(pid=62054) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 16:47:27 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-3478b1cb-e752-4b7a-891b-cfeb762fb72d tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] 10.0.0.210 "POST /compute/v2.1/servers/b2d55cdd-c89c-4c59-afe1-49a33225af22/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.042872 Apr 13 16:47:27 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 309/924] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 16:47:27 2023] POST /compute/v2.1/servers/b2d55cdd-c89c-4c59-afe1-49a33225af22/os-volume_attachments => generated 152 bytes in 44 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 13 16:47:27 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-35bc6642-5345-4176-88d4-75e63794ed53 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:47:27 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-35bc6642-5345-4176-88d4-75e63794ed53 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:47:27 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-35bc6642-5345-4176-88d4-75e63794ed53 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:47:27 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-35bc6642-5345-4176-88d4-75e63794ed53 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:47:27 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-35bc6642-5345-4176-88d4-75e63794ed53 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:47:27 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-35bc6642-5345-4176-88d4-75e63794ed53 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:47:27 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-35bc6642-5345-4176-88d4-75e63794ed53 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:47:27 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-35bc6642-5345-4176-88d4-75e63794ed53 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:47:27 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-35bc6642-5345-4176-88d4-75e63794ed53 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] 10.0.0.210 "POST /compute/v2.1/servers/b2d55cdd-c89c-4c59-afe1-49a33225af22/action" status: 202 len: 0 microversion: 2.1 time: 0.079138 Apr 13 16:47:27 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 307/925] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 16:47:27 2023] POST /compute/v2.1/servers/b2d55cdd-c89c-4c59-afe1-49a33225af22/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 16:47:27 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-3083dc66-7c1d-4be9-8a3e-12446d3f3c21 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:47:27 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-3083dc66-7c1d-4be9-8a3e-12446d3f3c21 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:47:27 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-3083dc66-7c1d-4be9-8a3e-12446d3f3c21 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:47:27 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-3083dc66-7c1d-4be9-8a3e-12446d3f3c21 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:47:27 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-3083dc66-7c1d-4be9-8a3e-12446d3f3c21 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:47:27 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-3083dc66-7c1d-4be9-8a3e-12446d3f3c21 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:47:27 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-3083dc66-7c1d-4be9-8a3e-12446d3f3c21 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:47:27 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-3083dc66-7c1d-4be9-8a3e-12446d3f3c21 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:47:28 user devstack@n-api.service[62053]: DEBUG nova.policy [None req-3083dc66-7c1d-4be9-8a3e-12446d3f3c21 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c7f54723c494e05ada117353c0790cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '846732ecb7e047128b4684972d3cd8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62053) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:47:28 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-3083dc66-7c1d-4be9-8a3e-12446d3f3c21 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b2d55cdd-c89c-4c59-afe1-49a33225af22" status: 200 len: 1498 microversion: 2.1 time: 0.227426 Apr 13 16:47:28 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 310/926] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:47:27 2023] GET /compute/v2.1/servers/b2d55cdd-c89c-4c59-afe1-49a33225af22 => generated 1498 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:47:29 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-5e71b076-ca17-4f50-a0fa-682683ab944d req-4809452f-f8e4-44b7-b48e-af82bbf319b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2d55cdd-c89c-4c59-afe1-49a33225af22", "name": "network-vif-unplugged", "status": "completed", "tag": "31e1957f-9bd1-42ae-a2ac-954b49ca15f1"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:47:29 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-5e71b076-ca17-4f50-a0fa-682683ab944d req-4809452f-f8e4-44b7-b48e-af82bbf319b8 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:47:29 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-5e71b076-ca17-4f50-a0fa-682683ab944d req-4809452f-f8e4-44b7-b48e-af82bbf319b8 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:47:29 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-5e71b076-ca17-4f50-a0fa-682683ab944d req-4809452f-f8e4-44b7-b48e-af82bbf319b8 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:47:29 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-5e71b076-ca17-4f50-a0fa-682683ab944d req-4809452f-f8e4-44b7-b48e-af82bbf319b8 service nova] Creating event network-vif-unplugged:31e1957f-9bd1-42ae-a2ac-954b49ca15f1 for instance b2d55cdd-c89c-4c59-afe1-49a33225af22 on user Apr 13 16:47:29 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [req-5e71b076-ca17-4f50-a0fa-682683ab944d req-4809452f-f8e4-44b7-b48e-af82bbf319b8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038794 Apr 13 16:47:29 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 310/927] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:47:29 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:47:31 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [req-367abee9-a7a4-46ce-a436-c37cec26413e req-dfa37c31-84e5-4ae3-b8eb-f8cc69ceab5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2d55cdd-c89c-4c59-afe1-49a33225af22", "name": "network-vif-plugged", "status": "completed", "tag": "31e1957f-9bd1-42ae-a2ac-954b49ca15f1"}, {"server_uuid": "b2d55cdd-c89c-4c59-afe1-49a33225af22", "name": "network-vif-plugged", "status": "completed", "tag": "31e1957f-9bd1-42ae-a2ac-954b49ca15f1"}]} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:47:31 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-367abee9-a7a4-46ce-a436-c37cec26413e req-dfa37c31-84e5-4ae3-b8eb-f8cc69ceab5e service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:47:31 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-367abee9-a7a4-46ce-a436-c37cec26413e req-dfa37c31-84e5-4ae3-b8eb-f8cc69ceab5e service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:47:31 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-367abee9-a7a4-46ce-a436-c37cec26413e req-dfa37c31-84e5-4ae3-b8eb-f8cc69ceab5e service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:47:31 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-367abee9-a7a4-46ce-a436-c37cec26413e req-dfa37c31-84e5-4ae3-b8eb-f8cc69ceab5e service nova] Creating event network-vif-plugged:31e1957f-9bd1-42ae-a2ac-954b49ca15f1 for instance b2d55cdd-c89c-4c59-afe1-49a33225af22 on user Apr 13 16:47:31 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-367abee9-a7a4-46ce-a436-c37cec26413e req-dfa37c31-84e5-4ae3-b8eb-f8cc69ceab5e service nova] Creating event network-vif-plugged:31e1957f-9bd1-42ae-a2ac-954b49ca15f1 for instance b2d55cdd-c89c-4c59-afe1-49a33225af22 on user Apr 13 16:47:31 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [req-367abee9-a7a4-46ce-a436-c37cec26413e req-dfa37c31-84e5-4ae3-b8eb-f8cc69ceab5e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.055091 Apr 13 16:47:31 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 308/928] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:47:31 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:47:33 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-11881430-874c-47d4-9ca3-db452d8fe917 req-847b3d42-e70c-42ae-98da-0f6e713ce31c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2d55cdd-c89c-4c59-afe1-49a33225af22", "name": "network-vif-plugged", "status": "completed", "tag": "31e1957f-9bd1-42ae-a2ac-954b49ca15f1"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:47:33 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-11881430-874c-47d4-9ca3-db452d8fe917 req-847b3d42-e70c-42ae-98da-0f6e713ce31c service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:47:33 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-11881430-874c-47d4-9ca3-db452d8fe917 req-847b3d42-e70c-42ae-98da-0f6e713ce31c service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:47:33 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-11881430-874c-47d4-9ca3-db452d8fe917 req-847b3d42-e70c-42ae-98da-0f6e713ce31c service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:47:33 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-11881430-874c-47d4-9ca3-db452d8fe917 req-847b3d42-e70c-42ae-98da-0f6e713ce31c service nova] Creating event network-vif-plugged:31e1957f-9bd1-42ae-a2ac-954b49ca15f1 for instance b2d55cdd-c89c-4c59-afe1-49a33225af22 on user Apr 13 16:47:33 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [req-11881430-874c-47d4-9ca3-db452d8fe917 req-847b3d42-e70c-42ae-98da-0f6e713ce31c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029544 Apr 13 16:47:33 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 311/929] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:47:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:48:05 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_api:SELECT=8 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:48:05 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_cell1:SELECT=10 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:48:05 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-fa803e77-748e-43c9-9eb8-0afc7b55bae7 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:48:05 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-fa803e77-748e-43c9-9eb8-0afc7b55bae7 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] [instance: 6e4776e8-d528-4110-90a3-daf4d1df0171] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:48:05 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-fa803e77-748e-43c9-9eb8-0afc7b55bae7 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:48:05 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-fa803e77-748e-43c9-9eb8-0afc7b55bae7 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:48:05 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-fa803e77-748e-43c9-9eb8-0afc7b55bae7 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:48:05 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-fa803e77-748e-43c9-9eb8-0afc7b55bae7 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:48:05 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-fa803e77-748e-43c9-9eb8-0afc7b55bae7 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:48:05 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-fa803e77-748e-43c9-9eb8-0afc7b55bae7 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:48:05 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-fa803e77-748e-43c9-9eb8-0afc7b55bae7 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] [instance: 6e4776e8-d528-4110-90a3-daf4d1df0171] Going to try to terminate instance {{(pid=62054) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 16:48:05 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-fa803e77-748e-43c9-9eb8-0afc7b55bae7 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6e4776e8-d528-4110-90a3-daf4d1df0171" status: 204 len: 0 microversion: 2.1 time: 0.166507 Apr 13 16:48:05 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 311/930] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 16:48:05 2023] DELETE /compute/v2.1/servers/6e4776e8-d528-4110-90a3-daf4d1df0171 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 16:48:05 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:48:05 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:48:05 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-711ed9e5-67a0-496e-84c1-4ba29a26bc6f tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:48:05 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-711ed9e5-67a0-496e-84c1-4ba29a26bc6f tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] [instance: 6e4776e8-d528-4110-90a3-daf4d1df0171] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:48:05 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-711ed9e5-67a0-496e-84c1-4ba29a26bc6f tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:48:05 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-711ed9e5-67a0-496e-84c1-4ba29a26bc6f tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:48:05 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-711ed9e5-67a0-496e-84c1-4ba29a26bc6f tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:48:05 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-711ed9e5-67a0-496e-84c1-4ba29a26bc6f tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:48:05 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-711ed9e5-67a0-496e-84c1-4ba29a26bc6f tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:48:05 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-711ed9e5-67a0-496e-84c1-4ba29a26bc6f tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:48:05 user devstack@n-api.service[62055]: DEBUG nova.policy [None req-711ed9e5-67a0-496e-84c1-4ba29a26bc6f tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '623668858bee4d308f31f4facd600fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0bb7653df574769941cf284c6a63154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62055) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:48:05 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-711ed9e5-67a0-496e-84c1-4ba29a26bc6f tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6e4776e8-d528-4110-90a3-daf4d1df0171" status: 200 len: 1492 microversion: 2.1 time: 0.233559 Apr 13 16:48:05 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 309/931] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:48:05 2023] GET /compute/v2.1/servers/6e4776e8-d528-4110-90a3-daf4d1df0171 => generated 1492 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:48:05 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-80f71cdd-18ae-44c1-98e3-73b3bfdccd8d req-ebac759f-e33b-4f65-b0c8-0d68da688a94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e4776e8-d528-4110-90a3-daf4d1df0171", "name": "network-vif-unplugged", "status": "completed", "tag": "e4d1a1bf-cfc0-43cb-a0a2-db01fe4fd0e7"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:48:05 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_api:SELECT=10 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:48:05 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_cell1:SELECT=18 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:48:05 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-80f71cdd-18ae-44c1-98e3-73b3bfdccd8d req-ebac759f-e33b-4f65-b0c8-0d68da688a94 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:48:05 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-80f71cdd-18ae-44c1-98e3-73b3bfdccd8d req-ebac759f-e33b-4f65-b0c8-0d68da688a94 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:48:05 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-80f71cdd-18ae-44c1-98e3-73b3bfdccd8d req-ebac759f-e33b-4f65-b0c8-0d68da688a94 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:48:05 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-80f71cdd-18ae-44c1-98e3-73b3bfdccd8d req-ebac759f-e33b-4f65-b0c8-0d68da688a94 service nova] Creating event network-vif-unplugged:e4d1a1bf-cfc0-43cb-a0a2-db01fe4fd0e7 for instance 6e4776e8-d528-4110-90a3-daf4d1df0171 on user Apr 13 16:48:05 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [req-80f71cdd-18ae-44c1-98e3-73b3bfdccd8d req-ebac759f-e33b-4f65-b0c8-0d68da688a94 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034638 Apr 13 16:48:05 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 312/932] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:48:05 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:48:06 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-a810f0de-9044-4163-a33b-9640fdbff408 req-b63651e2-988b-405e-851f-75693825ceaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e4776e8-d528-4110-90a3-daf4d1df0171", "name": "network-vif-deleted", "tag": "e4d1a1bf-cfc0-43cb-a0a2-db01fe4fd0e7"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:48:06 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-a810f0de-9044-4163-a33b-9640fdbff408 req-b63651e2-988b-405e-851f-75693825ceaf service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:48:06 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-a810f0de-9044-4163-a33b-9640fdbff408 req-b63651e2-988b-405e-851f-75693825ceaf service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:48:06 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-a810f0de-9044-4163-a33b-9640fdbff408 req-b63651e2-988b-405e-851f-75693825ceaf service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:48:06 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-a810f0de-9044-4163-a33b-9640fdbff408 req-b63651e2-988b-405e-851f-75693825ceaf service nova] Creating event network-vif-deleted:e4d1a1bf-cfc0-43cb-a0a2-db01fe4fd0e7 for instance 6e4776e8-d528-4110-90a3-daf4d1df0171 on user Apr 13 16:48:06 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [req-a810f0de-9044-4163-a33b-9640fdbff408 req-b63651e2-988b-405e-851f-75693825ceaf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032605 Apr 13 16:48:06 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 312/933] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:48:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:48:07 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [req-28e0d75f-2c63-4599-b554-affb77a9b793 req-5ef74977-42a6-4cda-9239-b35c6856a739 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e4776e8-d528-4110-90a3-daf4d1df0171", "name": "network-vif-plugged", "status": "completed", "tag": "e4d1a1bf-cfc0-43cb-a0a2-db01fe4fd0e7"}]} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:48:07 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-28e0d75f-2c63-4599-b554-affb77a9b793 req-5ef74977-42a6-4cda-9239-b35c6856a739 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:48:07 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-28e0d75f-2c63-4599-b554-affb77a9b793 req-5ef74977-42a6-4cda-9239-b35c6856a739 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:48:07 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-28e0d75f-2c63-4599-b554-affb77a9b793 req-5ef74977-42a6-4cda-9239-b35c6856a739 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:48:07 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-28e0d75f-2c63-4599-b554-affb77a9b793 req-5ef74977-42a6-4cda-9239-b35c6856a739 service nova] Creating event network-vif-plugged:e4d1a1bf-cfc0-43cb-a0a2-db01fe4fd0e7 for instance 6e4776e8-d528-4110-90a3-daf4d1df0171 on user Apr 13 16:48:07 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [req-28e0d75f-2c63-4599-b554-affb77a9b793 req-5ef74977-42a6-4cda-9239-b35c6856a739 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034178 Apr 13 16:48:07 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 310/934] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:48:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:48:11 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-b8e7cf0c-1560-4db7-8b81-119a3924a21a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:48:11 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-b8e7cf0c-1560-4db7-8b81-119a3924a21a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 5ed800fe-577d-4624-898c-c7f40da77376] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:48:11 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-b8e7cf0c-1560-4db7-8b81-119a3924a21a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:48:11 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-b8e7cf0c-1560-4db7-8b81-119a3924a21a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:48:11 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-b8e7cf0c-1560-4db7-8b81-119a3924a21a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:48:11 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-b8e7cf0c-1560-4db7-8b81-119a3924a21a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:48:11 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-b8e7cf0c-1560-4db7-8b81-119a3924a21a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:48:11 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-b8e7cf0c-1560-4db7-8b81-119a3924a21a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:48:11 user devstack@n-api.service[62053]: INFO nova.api.openstack.wsgi [None req-b8e7cf0c-1560-4db7-8b81-119a3924a21a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] HTTP exception thrown: Instance 5ed800fe-577d-4624-898c-c7f40da77376 could not be found. Apr 13 16:48:11 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-b8e7cf0c-1560-4db7-8b81-119a3924a21a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Request method failure captured: Apr 13 16:48:11 user devstack@n-api.service[62053]: request: GET /compute/v2.1/servers/5ed800fe-577d-4624-898c-c7f40da77376 HTTP/1.1 Apr 13 16:48:11 user devstack@n-api.service[62053]: Accept: application/json Apr 13 16:48:11 user devstack@n-api.service[62053]: Accept-Encoding: identity Apr 13 16:48:11 user devstack@n-api.service[62053]: Connection: close Apr 13 16:48:11 user devstack@n-api.service[62053]: Content-Length: 0 Apr 13 16:48:11 user devstack@n-api.service[62053]: Content-Type: application/json Apr 13 16:48:11 user devstack@n-api.service[62053]: Host: 10.0.0.210 Apr 13 16:48:11 user devstack@n-api.service[62053]: Openstack-System-Scope: None Apr 13 16:48:11 user devstack@n-api.service[62053]: User-Agent: python-urllib3/1.26.15 Apr 13 16:48:11 user devstack@n-api.service[62053]: X-Auth-Token: gAAAAABkOCyK6iWxIKqDSv6H0rT6hYe7MptxZpmd0isb-i7vUg3jso0s7xsZUrxtoSvPcGgCBo4hK2dNDP0kQx-ibuil0c2Kvsteo-AJ1R0h80Zm73FGeLTKieLGMCzhQ82f-tUm8n-Fpt56d3KgkMnkmwHhKR_MJqNeo3xk_dFOMXNz_EA5ymA Apr 13 16:48:11 user devstack@n-api.service[62053]: X-Domain-Id: None Apr 13 16:48:11 user devstack@n-api.service[62053]: X-Domain-Name: None Apr 13 16:48:11 user devstack@n-api.service[62053]: X-Identity-Status: Confirmed Apr 13 16:48:11 user devstack@n-api.service[62053]: X-Is-Admin-Project: True Apr 13 16:48:11 user devstack@n-api.service[62053]: X-Project-Domain-Id: default Apr 13 16:48:11 user devstack@n-api.service[62053]: X-Project-Domain-Name: Default Apr 13 16:48:11 user devstack@n-api.service[62053]: X-Project-Id: 980559734a504574a83224deb7423c77 Apr 13 16:48:11 user devstack@n-api.service[62053]: X-Project-Name: tempest-ServerActionsTestJSON-713402718 Apr 13 16:48:11 user devstack@n-api.service[62053]: X-Role: reader,member Apr 13 16:48:11 user devstack@n-api.service[62053]: X-Roles: reader,member Apr 13 16:48:11 user devstack@n-api.service[62053]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/980559734a504574a83224deb7423c77"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/980559734a504574a83224deb7423c77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/980559734a504574a83224deb7423c77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 13 16:48:11 user devstack@n-api.service[62053]: X-Tenant: tempest-ServerActionsTestJSON-713402718 Apr 13 16:48:11 user devstack@n-api.service[62053]: X-Tenant-Id: 980559734a504574a83224deb7423c77 Apr 13 16:48:11 user devstack@n-api.service[62053]: X-Tenant-Name: tempest-ServerActionsTestJSON-713402718 Apr 13 16:48:11 user devstack@n-api.service[62053]: X-User: tempest-ServerActionsTestJSON-713402718-project-member Apr 13 16:48:11 user devstack@n-api.service[62053]: X-User-Domain-Id: default Apr 13 16:48:11 user devstack@n-api.service[62053]: X-User-Domain-Name: Default Apr 13 16:48:11 user devstack@n-api.service[62053]: X-User-Id: 1b3df1c5c5d441819bcef89ed6966815 Apr 13 16:48:11 user devstack@n-api.service[62053]: X-User-Name: tempest-ServerActionsTestJSON-713402718-project-member Apr 13 16:48:11 user devstack@n-api.service[62053]: method: > Apr 13 16:48:11 user devstack@n-api.service[62053]: exception: Instance 5ed800fe-577d-4624-898c-c7f40da77376 could not be found. Apr 13 16:48:11 user devstack@n-api.service[62053]: action_args: {'id': '5ed800fe-577d-4624-898c-c7f40da77376'} Apr 13 16:48:11 user devstack@n-api.service[62053]: {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 16:48:11 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:48:11 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 16:48:11 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 16:48:11 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 16:48:11 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 16:48:11 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 16:48:11 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 16:48:11 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 16:48:11 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 16:48:11 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ed800fe-577d-4624-898c-c7f40da77376 could not be found. Apr 13 16:48:11 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:48:11 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:48:11 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:48:11 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:48:11 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 16:48:11 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 16:48:11 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 16:48:11 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 16:48:11 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 16:48:11 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 16:48:11 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 16:48:11 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 16:48:11 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 16:48:11 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 16:48:11 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 16:48:11 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 16:48:11 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ed800fe-577d-4624-898c-c7f40da77376 could not be found. Apr 13 16:48:11 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:48:11 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:48:11 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:48:11 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:48:11 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 16:48:11 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 16:48:11 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 16:48:11 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 16:48:11 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ed800fe-577d-4624-898c-c7f40da77376 could not be found. Apr 13 16:48:11 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:48:11 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-b8e7cf0c-1560-4db7-8b81-119a3924a21a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Returning 404 to user: Instance 5ed800fe-577d-4624-898c-c7f40da77376 could not be found. {{(pid=62053) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 16:48:11 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-b8e7cf0c-1560-4db7-8b81-119a3924a21a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5ed800fe-577d-4624-898c-c7f40da77376" status: 404 len: 111 microversion: 2.1 time: 0.030371 Apr 13 16:48:11 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 313/935] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:48:11 2023] GET /compute/v2.1/servers/5ed800fe-577d-4624-898c-c7f40da77376 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 16:48:16 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-65c78337-8b23-46de-a2f7-28be8fd5d84d tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:48:16 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-65c78337-8b23-46de-a2f7-28be8fd5d84d tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:48:16 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-65c78337-8b23-46de-a2f7-28be8fd5d84d tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:48:16 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-65c78337-8b23-46de-a2f7-28be8fd5d84d tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:48:16 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-65c78337-8b23-46de-a2f7-28be8fd5d84d tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:48:16 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-65c78337-8b23-46de-a2f7-28be8fd5d84d tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:48:16 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-65c78337-8b23-46de-a2f7-28be8fd5d84d tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:48:16 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-65c78337-8b23-46de-a2f7-28be8fd5d84d tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:48:16 user devstack@n-api.service[62054]: INFO nova.api.openstack.wsgi [None req-65c78337-8b23-46de-a2f7-28be8fd5d84d tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] HTTP exception thrown: Instance acbcaee0-a47b-4fee-8765-9b1c9597d515 could not be found. Apr 13 16:48:16 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-65c78337-8b23-46de-a2f7-28be8fd5d84d tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Request method failure captured: Apr 13 16:48:16 user devstack@n-api.service[62054]: request: DELETE /compute/v2.1/servers/acbcaee0-a47b-4fee-8765-9b1c9597d515 HTTP/1.1 Apr 13 16:48:16 user devstack@n-api.service[62054]: Accept: application/json Apr 13 16:48:16 user devstack@n-api.service[62054]: Accept-Encoding: identity Apr 13 16:48:16 user devstack@n-api.service[62054]: Connection: close Apr 13 16:48:16 user devstack@n-api.service[62054]: Content-Length: 0 Apr 13 16:48:16 user devstack@n-api.service[62054]: Content-Type: application/json Apr 13 16:48:16 user devstack@n-api.service[62054]: Host: 10.0.0.210 Apr 13 16:48:16 user devstack@n-api.service[62054]: Openstack-System-Scope: None Apr 13 16:48:16 user devstack@n-api.service[62054]: User-Agent: python-urllib3/1.26.15 Apr 13 16:48:16 user devstack@n-api.service[62054]: X-Auth-Token: gAAAAABkOCyK6iWxIKqDSv6H0rT6hYe7MptxZpmd0isb-i7vUg3jso0s7xsZUrxtoSvPcGgCBo4hK2dNDP0kQx-ibuil0c2Kvsteo-AJ1R0h80Zm73FGeLTKieLGMCzhQ82f-tUm8n-Fpt56d3KgkMnkmwHhKR_MJqNeo3xk_dFOMXNz_EA5ymA Apr 13 16:48:16 user devstack@n-api.service[62054]: X-Domain-Id: None Apr 13 16:48:16 user devstack@n-api.service[62054]: X-Domain-Name: None Apr 13 16:48:16 user devstack@n-api.service[62054]: X-Identity-Status: Confirmed Apr 13 16:48:16 user devstack@n-api.service[62054]: X-Is-Admin-Project: True Apr 13 16:48:16 user devstack@n-api.service[62054]: X-Project-Domain-Id: default Apr 13 16:48:16 user devstack@n-api.service[62054]: X-Project-Domain-Name: Default Apr 13 16:48:16 user devstack@n-api.service[62054]: X-Project-Id: 980559734a504574a83224deb7423c77 Apr 13 16:48:16 user devstack@n-api.service[62054]: X-Project-Name: tempest-ServerActionsTestJSON-713402718 Apr 13 16:48:16 user devstack@n-api.service[62054]: X-Role: reader,member Apr 13 16:48:16 user devstack@n-api.service[62054]: X-Roles: reader,member Apr 13 16:48:16 user devstack@n-api.service[62054]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/980559734a504574a83224deb7423c77"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/980559734a504574a83224deb7423c77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/980559734a504574a83224deb7423c77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 13 16:48:16 user devstack@n-api.service[62054]: X-Tenant: tempest-ServerActionsTestJSON-713402718 Apr 13 16:48:16 user devstack@n-api.service[62054]: X-Tenant-Id: 980559734a504574a83224deb7423c77 Apr 13 16:48:16 user devstack@n-api.service[62054]: X-Tenant-Name: tempest-ServerActionsTestJSON-713402718 Apr 13 16:48:16 user devstack@n-api.service[62054]: X-User: tempest-ServerActionsTestJSON-713402718-project-member Apr 13 16:48:16 user devstack@n-api.service[62054]: X-User-Domain-Id: default Apr 13 16:48:16 user devstack@n-api.service[62054]: X-User-Domain-Name: Default Apr 13 16:48:16 user devstack@n-api.service[62054]: X-User-Id: 1b3df1c5c5d441819bcef89ed6966815 Apr 13 16:48:16 user devstack@n-api.service[62054]: X-User-Name: tempest-ServerActionsTestJSON-713402718-project-member Apr 13 16:48:16 user devstack@n-api.service[62054]: method: > Apr 13 16:48:16 user devstack@n-api.service[62054]: exception: Instance acbcaee0-a47b-4fee-8765-9b1c9597d515 could not be found. Apr 13 16:48:16 user devstack@n-api.service[62054]: action_args: {'id': 'acbcaee0-a47b-4fee-8765-9b1c9597d515'} Apr 13 16:48:16 user devstack@n-api.service[62054]: {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 16:48:16 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:48:16 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 16:48:16 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 16:48:16 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 16:48:16 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 16:48:16 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 16:48:16 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 16:48:16 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 16:48:16 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 16:48:16 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance acbcaee0-a47b-4fee-8765-9b1c9597d515 could not be found. Apr 13 16:48:16 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:48:16 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:48:16 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:48:16 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:48:16 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 16:48:16 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 16:48:16 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 16:48:16 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 16:48:16 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 16:48:16 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 16:48:16 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 16:48:16 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 16:48:16 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 16:48:16 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 16:48:16 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 16:48:16 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 16:48:16 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 16:48:16 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 16:48:16 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance acbcaee0-a47b-4fee-8765-9b1c9597d515 could not be found. Apr 13 16:48:16 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:48:16 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:48:16 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:48:16 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:48:16 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 16:48:16 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 16:48:16 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 16:48:16 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 16:48:16 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance acbcaee0-a47b-4fee-8765-9b1c9597d515 could not be found. Apr 13 16:48:16 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:48:16 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-65c78337-8b23-46de-a2f7-28be8fd5d84d tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Returning 404 to user: Instance acbcaee0-a47b-4fee-8765-9b1c9597d515 could not be found. {{(pid=62054) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 16:48:16 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-65c78337-8b23-46de-a2f7-28be8fd5d84d tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/acbcaee0-a47b-4fee-8765-9b1c9597d515" status: 404 len: 111 microversion: 2.1 time: 0.030476 Apr 13 16:48:16 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 313/936] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 16:48:16 2023] DELETE /compute/v2.1/servers/acbcaee0-a47b-4fee-8765-9b1c9597d515 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 16:48:16 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-3cca4876-f7fa-49bc-b3ec-7f2cab2bef19 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:48:16 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-3cca4876-f7fa-49bc-b3ec-7f2cab2bef19 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:48:16 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-3cca4876-f7fa-49bc-b3ec-7f2cab2bef19 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:48:16 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-3cca4876-f7fa-49bc-b3ec-7f2cab2bef19 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:48:16 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-3cca4876-f7fa-49bc-b3ec-7f2cab2bef19 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:48:16 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-3cca4876-f7fa-49bc-b3ec-7f2cab2bef19 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:48:16 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-3cca4876-f7fa-49bc-b3ec-7f2cab2bef19 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:48:16 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-3cca4876-f7fa-49bc-b3ec-7f2cab2bef19 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:48:16 user devstack@n-api.service[62055]: INFO nova.api.openstack.wsgi [None req-3cca4876-f7fa-49bc-b3ec-7f2cab2bef19 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] HTTP exception thrown: Instance acbcaee0-a47b-4fee-8765-9b1c9597d515 could not be found. Apr 13 16:48:16 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-3cca4876-f7fa-49bc-b3ec-7f2cab2bef19 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Request method failure captured: Apr 13 16:48:16 user devstack@n-api.service[62055]: request: GET /compute/v2.1/servers/acbcaee0-a47b-4fee-8765-9b1c9597d515 HTTP/1.1 Apr 13 16:48:16 user devstack@n-api.service[62055]: Accept: application/json Apr 13 16:48:16 user devstack@n-api.service[62055]: Accept-Encoding: identity Apr 13 16:48:16 user devstack@n-api.service[62055]: Connection: close Apr 13 16:48:16 user devstack@n-api.service[62055]: Content-Length: 0 Apr 13 16:48:16 user devstack@n-api.service[62055]: Content-Type: application/json Apr 13 16:48:16 user devstack@n-api.service[62055]: Host: 10.0.0.210 Apr 13 16:48:16 user devstack@n-api.service[62055]: Openstack-System-Scope: None Apr 13 16:48:16 user devstack@n-api.service[62055]: User-Agent: python-urllib3/1.26.15 Apr 13 16:48:16 user devstack@n-api.service[62055]: X-Auth-Token: gAAAAABkOCyK6iWxIKqDSv6H0rT6hYe7MptxZpmd0isb-i7vUg3jso0s7xsZUrxtoSvPcGgCBo4hK2dNDP0kQx-ibuil0c2Kvsteo-AJ1R0h80Zm73FGeLTKieLGMCzhQ82f-tUm8n-Fpt56d3KgkMnkmwHhKR_MJqNeo3xk_dFOMXNz_EA5ymA Apr 13 16:48:16 user devstack@n-api.service[62055]: X-Domain-Id: None Apr 13 16:48:16 user devstack@n-api.service[62055]: X-Domain-Name: None Apr 13 16:48:16 user devstack@n-api.service[62055]: X-Identity-Status: Confirmed Apr 13 16:48:16 user devstack@n-api.service[62055]: X-Is-Admin-Project: True Apr 13 16:48:16 user devstack@n-api.service[62055]: X-Project-Domain-Id: default Apr 13 16:48:16 user devstack@n-api.service[62055]: X-Project-Domain-Name: Default Apr 13 16:48:16 user devstack@n-api.service[62055]: X-Project-Id: 980559734a504574a83224deb7423c77 Apr 13 16:48:16 user devstack@n-api.service[62055]: X-Project-Name: tempest-ServerActionsTestJSON-713402718 Apr 13 16:48:16 user devstack@n-api.service[62055]: X-Role: reader,member Apr 13 16:48:16 user devstack@n-api.service[62055]: X-Roles: reader,member Apr 13 16:48:16 user devstack@n-api.service[62055]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/980559734a504574a83224deb7423c77"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/980559734a504574a83224deb7423c77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/980559734a504574a83224deb7423c77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 13 16:48:16 user devstack@n-api.service[62055]: X-Tenant: tempest-ServerActionsTestJSON-713402718 Apr 13 16:48:16 user devstack@n-api.service[62055]: X-Tenant-Id: 980559734a504574a83224deb7423c77 Apr 13 16:48:16 user devstack@n-api.service[62055]: X-Tenant-Name: tempest-ServerActionsTestJSON-713402718 Apr 13 16:48:16 user devstack@n-api.service[62055]: X-User: tempest-ServerActionsTestJSON-713402718-project-member Apr 13 16:48:16 user devstack@n-api.service[62055]: X-User-Domain-Id: default Apr 13 16:48:16 user devstack@n-api.service[62055]: X-User-Domain-Name: Default Apr 13 16:48:16 user devstack@n-api.service[62055]: X-User-Id: 1b3df1c5c5d441819bcef89ed6966815 Apr 13 16:48:16 user devstack@n-api.service[62055]: X-User-Name: tempest-ServerActionsTestJSON-713402718-project-member Apr 13 16:48:16 user devstack@n-api.service[62055]: method: > Apr 13 16:48:16 user devstack@n-api.service[62055]: exception: Instance acbcaee0-a47b-4fee-8765-9b1c9597d515 could not be found. Apr 13 16:48:16 user devstack@n-api.service[62055]: action_args: {'id': 'acbcaee0-a47b-4fee-8765-9b1c9597d515'} Apr 13 16:48:16 user devstack@n-api.service[62055]: {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 16:48:16 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:48:16 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 16:48:16 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 16:48:16 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 16:48:16 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 16:48:16 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 16:48:16 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 16:48:16 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 16:48:16 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 16:48:16 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance acbcaee0-a47b-4fee-8765-9b1c9597d515 could not be found. Apr 13 16:48:16 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:48:16 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:48:16 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:48:16 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:48:16 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 16:48:16 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 16:48:16 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 16:48:16 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 16:48:16 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 16:48:16 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 16:48:16 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 16:48:16 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 16:48:16 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 16:48:16 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 16:48:16 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 16:48:16 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 16:48:16 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance acbcaee0-a47b-4fee-8765-9b1c9597d515 could not be found. Apr 13 16:48:16 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:48:16 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:48:16 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:48:16 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:48:16 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 16:48:16 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 16:48:16 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 16:48:16 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 16:48:16 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance acbcaee0-a47b-4fee-8765-9b1c9597d515 could not be found. Apr 13 16:48:16 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:48:16 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-3cca4876-f7fa-49bc-b3ec-7f2cab2bef19 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Returning 404 to user: Instance acbcaee0-a47b-4fee-8765-9b1c9597d515 could not be found. {{(pid=62055) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 16:48:16 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-3cca4876-f7fa-49bc-b3ec-7f2cab2bef19 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] 10.0.0.210 "GET /compute/v2.1/servers/acbcaee0-a47b-4fee-8765-9b1c9597d515" status: 404 len: 111 microversion: 2.1 time: 0.027531 Apr 13 16:48:16 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 311/937] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:48:16 2023] GET /compute/v2.1/servers/acbcaee0-a47b-4fee-8765-9b1c9597d515 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 16:48:16 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-96587172-58d8-4268-b8cf-04bdbeefefce tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Calling method '.version_select at 0x7f96e4ae9f30>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:48:16 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-96587172-58d8-4268-b8cf-04bdbeefefce tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1700037342" status: 202 len: 0 microversion: 2.1 time: 0.023678 Apr 13 16:48:16 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 314/938] 10.0.0.210 () {62 vars in 1298 bytes} [Thu Apr 13 16:48:16 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1700037342 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 16:48:18 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-70ae2e9c-5b60-477c-a176-f0adc8729428 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:48:18 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-70ae2e9c-5b60-477c-a176-f0adc8729428 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:48:18 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-70ae2e9c-5b60-477c-a176-f0adc8729428 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:48:18 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-70ae2e9c-5b60-477c-a176-f0adc8729428 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:48:18 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-70ae2e9c-5b60-477c-a176-f0adc8729428 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:48:18 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-70ae2e9c-5b60-477c-a176-f0adc8729428 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:48:18 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-70ae2e9c-5b60-477c-a176-f0adc8729428 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:48:18 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-70ae2e9c-5b60-477c-a176-f0adc8729428 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:48:18 user devstack@n-api.service[62054]: DEBUG nova.policy [None req-70ae2e9c-5b60-477c-a176-f0adc8729428 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c7f54723c494e05ada117353c0790cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '846732ecb7e047128b4684972d3cd8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62054) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:48:18 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-70ae2e9c-5b60-477c-a176-f0adc8729428 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b2d55cdd-c89c-4c59-afe1-49a33225af22" status: 200 len: 1504 microversion: 2.1 time: 0.146919 Apr 13 16:48:18 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 314/939] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:48:18 2023] GET /compute/v2.1/servers/b2d55cdd-c89c-4c59-afe1-49a33225af22 => generated 1504 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:48:34 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-9757a67b-8e17-4d18-8a72-d09742bbf3d7 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1742782258", "imageRef": "708622a9-7465-4492-ade8-b827198f7e30", "flavorRef": "42", "networks": [{"uuid": "b742fa77-3781-46be-8a60-11bf61969238"}]}} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:48:34 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_api:SELECT=6 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:48:34 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_cell1:SELECT=10 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:48:34 user devstack@n-api.service[62055]: DEBUG nova.network.neutron [None req-9757a67b-8e17-4d18-8a72-d09742bbf3d7 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] validate_networks() for [('b742fa77-3781-46be-8a60-11bf61969238', None, None, None, None, None)] {{(pid=62055) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 16:48:34 user devstack@n-api.service[62055]: DEBUG nova.virt.hardware [None req-9757a67b-8e17-4d18-8a72-d09742bbf3d7 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Flavor limits 0:0:0 {{(pid=62055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 16:48:34 user devstack@n-api.service[62055]: DEBUG nova.virt.hardware [None req-9757a67b-8e17-4d18-8a72-d09742bbf3d7 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Image limits 0:0:0 {{(pid=62055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 16:48:34 user devstack@n-api.service[62055]: DEBUG nova.virt.hardware [None req-9757a67b-8e17-4d18-8a72-d09742bbf3d7 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Flavor pref 0:0:0 {{(pid=62055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 16:48:34 user devstack@n-api.service[62055]: DEBUG nova.virt.hardware [None req-9757a67b-8e17-4d18-8a72-d09742bbf3d7 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Image pref 0:0:0 {{(pid=62055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 16:48:34 user devstack@n-api.service[62055]: DEBUG nova.virt.hardware [None req-9757a67b-8e17-4d18-8a72-d09742bbf3d7 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 16:48:34 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-9757a67b-8e17-4d18-8a72-d09742bbf3d7 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:48:34 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-9757a67b-8e17-4d18-8a72-d09742bbf3d7 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:48:34 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-9757a67b-8e17-4d18-8a72-d09742bbf3d7 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:48:34 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-9757a67b-8e17-4d18-8a72-d09742bbf3d7 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:48:34 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-9757a67b-8e17-4d18-8a72-d09742bbf3d7 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:48:34 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-9757a67b-8e17-4d18-8a72-d09742bbf3d7 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:48:34 user devstack@n-api.service[62055]: DEBUG nova.quota [None req-9757a67b-8e17-4d18-8a72-d09742bbf3d7 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Getting quotas for project d099f58565de44fba2df173a2bdb3019. Resources: {'instances', 'cores', 'ram'} {{(pid=62055) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 16:48:34 user devstack@n-api.service[62055]: DEBUG nova.quota [None req-9757a67b-8e17-4d18-8a72-d09742bbf3d7 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Getting quotas for user 5051bef91062494f991ee96a93c9dc6a and project d099f58565de44fba2df173a2bdb3019. Resources: {'instances', 'cores', 'ram'} {{(pid=62055) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 16:48:34 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-9757a67b-8e17-4d18-8a72-d09742bbf3d7 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Going to run 1 instances... {{(pid=62055) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 16:48:34 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-9757a67b-8e17-4d18-8a72-d09742bbf3d7 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] [instance: e6953c30-c409-45fe-8b22-d9e66d1138ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='708622a9-7465-4492-ade8-b827198f7e30',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=62055) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 16:48:34 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-9757a67b-8e17-4d18-8a72-d09742bbf3d7 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.528234 Apr 13 16:48:34 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 312/940] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 16:48:34 2023] POST /compute/v2.1/servers => generated 378 bytes in 531 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 16:48:34 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_cell1:SELECT=4 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:48:34 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_api:SELECT=7,nova_api:DELETE=1 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:48:34 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-fcef0c4a-fa7c-4b1b-b5c0-6eaabd16aed8 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:48:34 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-fcef0c4a-fa7c-4b1b-b5c0-6eaabd16aed8 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] [instance: e6953c30-c409-45fe-8b22-d9e66d1138ed] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:48:34 user devstack@n-api.service[62053]: DEBUG nova.policy [None req-fcef0c4a-fa7c-4b1b-b5c0-6eaabd16aed8 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5051bef91062494f991ee96a93c9dc6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd099f58565de44fba2df173a2bdb3019', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62053) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:48:34 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-fcef0c4a-fa7c-4b1b-b5c0-6eaabd16aed8 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e6953c30-c409-45fe-8b22-d9e66d1138ed" status: 200 len: 1208 microversion: 2.1 time: 0.070386 Apr 13 16:48:34 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 315/941] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:48:34 2023] GET /compute/v2.1/servers/e6953c30-c409-45fe-8b22-d9e66d1138ed => generated 1208 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:48:36 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-c3d80c04-e9dd-4df7-b785-03f7e93fc4eb req-f823a084-de08-496b-9eea-99fc36463199 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6953c30-c409-45fe-8b22-d9e66d1138ed", "tag": "e2f0381a-2e17-4d01-b125-0d9ad8c94788"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:48:36 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:48:36 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:48:36 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-c3d80c04-e9dd-4df7-b785-03f7e93fc4eb req-f823a084-de08-496b-9eea-99fc36463199 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:48:36 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-c3d80c04-e9dd-4df7-b785-03f7e93fc4eb req-f823a084-de08-496b-9eea-99fc36463199 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:48:36 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-c3d80c04-e9dd-4df7-b785-03f7e93fc4eb req-f823a084-de08-496b-9eea-99fc36463199 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:48:37 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-c3d80c04-e9dd-4df7-b785-03f7e93fc4eb req-f823a084-de08-496b-9eea-99fc36463199 service nova] Creating event network-changed:e2f0381a-2e17-4d01-b125-0d9ad8c94788 for instance e6953c30-c409-45fe-8b22-d9e66d1138ed on user Apr 13 16:48:37 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [req-c3d80c04-e9dd-4df7-b785-03f7e93fc4eb req-f823a084-de08-496b-9eea-99fc36463199 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036751 Apr 13 16:48:37 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 315/942] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:48:36 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:48:39 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [req-369d9ab5-1eab-4210-a5ca-4fcddb2a597c req-209fd33f-fad0-4b58-9ac3-c804be3740d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6953c30-c409-45fe-8b22-d9e66d1138ed", "name": "network-vif-plugged", "status": "completed", "tag": "e2f0381a-2e17-4d01-b125-0d9ad8c94788"}]} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:48:39 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-369d9ab5-1eab-4210-a5ca-4fcddb2a597c req-209fd33f-fad0-4b58-9ac3-c804be3740d3 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:48:39 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-369d9ab5-1eab-4210-a5ca-4fcddb2a597c req-209fd33f-fad0-4b58-9ac3-c804be3740d3 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:48:39 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-369d9ab5-1eab-4210-a5ca-4fcddb2a597c req-209fd33f-fad0-4b58-9ac3-c804be3740d3 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:48:39 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-369d9ab5-1eab-4210-a5ca-4fcddb2a597c req-209fd33f-fad0-4b58-9ac3-c804be3740d3 service nova] Creating event network-vif-plugged:e2f0381a-2e17-4d01-b125-0d9ad8c94788 for instance e6953c30-c409-45fe-8b22-d9e66d1138ed on user Apr 13 16:48:39 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [req-369d9ab5-1eab-4210-a5ca-4fcddb2a597c req-209fd33f-fad0-4b58-9ac3-c804be3740d3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043330 Apr 13 16:48:39 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 313/943] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:48:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:48:41 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-8763cf36-78fb-40a1-81db-8a8ada80ff63 req-dd1621f6-95f8-4215-b10f-f66e35086536 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6953c30-c409-45fe-8b22-d9e66d1138ed", "name": "network-vif-plugged", "status": "completed", "tag": "e2f0381a-2e17-4d01-b125-0d9ad8c94788"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:48:41 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-8763cf36-78fb-40a1-81db-8a8ada80ff63 req-dd1621f6-95f8-4215-b10f-f66e35086536 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:48:41 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-8763cf36-78fb-40a1-81db-8a8ada80ff63 req-dd1621f6-95f8-4215-b10f-f66e35086536 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:48:41 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-8763cf36-78fb-40a1-81db-8a8ada80ff63 req-dd1621f6-95f8-4215-b10f-f66e35086536 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:48:41 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-8763cf36-78fb-40a1-81db-8a8ada80ff63 req-dd1621f6-95f8-4215-b10f-f66e35086536 service nova] Creating event network-vif-plugged:e2f0381a-2e17-4d01-b125-0d9ad8c94788 for instance e6953c30-c409-45fe-8b22-d9e66d1138ed on user Apr 13 16:48:41 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [req-8763cf36-78fb-40a1-81db-8a8ada80ff63 req-dd1621f6-95f8-4215-b10f-f66e35086536 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032591 Apr 13 16:48:41 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 316/944] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:48:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 16:48:55 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_cell1:SELECT=2 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:48:55 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_api:SELECT=2 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:48:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-bc72f422-d858-47de-9b28-8c9dabe86a70 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:48:55 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-bc72f422-d858-47de-9b28-8c9dabe86a70 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] [instance: 6e4776e8-d528-4110-90a3-daf4d1df0171] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:48:55 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-bc72f422-d858-47de-9b28-8c9dabe86a70 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:48:55 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-bc72f422-d858-47de-9b28-8c9dabe86a70 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:48:55 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-bc72f422-d858-47de-9b28-8c9dabe86a70 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:48:55 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-bc72f422-d858-47de-9b28-8c9dabe86a70 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:48:55 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-bc72f422-d858-47de-9b28-8c9dabe86a70 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:48:55 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-bc72f422-d858-47de-9b28-8c9dabe86a70 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:48:55 user devstack@n-api.service[62054]: INFO nova.api.openstack.wsgi [None req-bc72f422-d858-47de-9b28-8c9dabe86a70 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] HTTP exception thrown: Instance 6e4776e8-d528-4110-90a3-daf4d1df0171 could not be found. Apr 13 16:48:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-bc72f422-d858-47de-9b28-8c9dabe86a70 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] Request method failure captured: Apr 13 16:48:55 user devstack@n-api.service[62054]: request: GET /compute/v2.1/servers/6e4776e8-d528-4110-90a3-daf4d1df0171 HTTP/1.1 Apr 13 16:48:55 user devstack@n-api.service[62054]: Accept: application/json Apr 13 16:48:55 user devstack@n-api.service[62054]: Accept-Encoding: identity Apr 13 16:48:55 user devstack@n-api.service[62054]: Connection: close Apr 13 16:48:55 user devstack@n-api.service[62054]: Content-Length: 0 Apr 13 16:48:55 user devstack@n-api.service[62054]: Content-Type: application/json Apr 13 16:48:55 user devstack@n-api.service[62054]: Host: 10.0.0.210 Apr 13 16:48:55 user devstack@n-api.service[62054]: Openstack-System-Scope: None Apr 13 16:48:55 user devstack@n-api.service[62054]: User-Agent: python-urllib3/1.26.15 Apr 13 16:48:55 user devstack@n-api.service[62054]: X-Auth-Token: gAAAAABkODHO_T1E8FoR9UVBPE5FLaSVNV9MthUqX7rwrTA_pW4_VFfRqK-6AXVGenGrA8dZRk2PGRvS7DQG3nTJ9RlLDfcN0L_0q-byJV5rgCVuKfSKG_rhZrQZww9a77nlk5TBC0kuFqiVh8AtBPGRnQMQu7tf1GKP0bx6XmFhDY16SZ6PKTY Apr 13 16:48:55 user devstack@n-api.service[62054]: X-Domain-Id: None Apr 13 16:48:55 user devstack@n-api.service[62054]: X-Domain-Name: None Apr 13 16:48:55 user devstack@n-api.service[62054]: X-Identity-Status: Confirmed Apr 13 16:48:55 user devstack@n-api.service[62054]: X-Is-Admin-Project: True Apr 13 16:48:55 user devstack@n-api.service[62054]: X-Project-Domain-Id: default Apr 13 16:48:55 user devstack@n-api.service[62054]: X-Project-Domain-Name: Default Apr 13 16:48:55 user devstack@n-api.service[62054]: X-Project-Id: c0bb7653df574769941cf284c6a63154 Apr 13 16:48:55 user devstack@n-api.service[62054]: X-Project-Name: tempest-VolumesActionsTest-150031261 Apr 13 16:48:55 user devstack@n-api.service[62054]: X-Role: reader,member Apr 13 16:48:55 user devstack@n-api.service[62054]: X-Roles: reader,member Apr 13 16:48:55 user devstack@n-api.service[62054]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c0bb7653df574769941cf284c6a63154"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c0bb7653df574769941cf284c6a63154"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c0bb7653df574769941cf284c6a63154"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 13 16:48:55 user devstack@n-api.service[62054]: X-Tenant: tempest-VolumesActionsTest-150031261 Apr 13 16:48:55 user devstack@n-api.service[62054]: X-Tenant-Id: c0bb7653df574769941cf284c6a63154 Apr 13 16:48:55 user devstack@n-api.service[62054]: X-Tenant-Name: tempest-VolumesActionsTest-150031261 Apr 13 16:48:55 user devstack@n-api.service[62054]: X-User: tempest-VolumesActionsTest-150031261-project-member Apr 13 16:48:55 user devstack@n-api.service[62054]: X-User-Domain-Id: default Apr 13 16:48:55 user devstack@n-api.service[62054]: X-User-Domain-Name: Default Apr 13 16:48:55 user devstack@n-api.service[62054]: X-User-Id: 623668858bee4d308f31f4facd600fb1 Apr 13 16:48:55 user devstack@n-api.service[62054]: X-User-Name: tempest-VolumesActionsTest-150031261-project-member Apr 13 16:48:55 user devstack@n-api.service[62054]: method: > Apr 13 16:48:55 user devstack@n-api.service[62054]: exception: Instance 6e4776e8-d528-4110-90a3-daf4d1df0171 could not be found. Apr 13 16:48:55 user devstack@n-api.service[62054]: action_args: {'id': '6e4776e8-d528-4110-90a3-daf4d1df0171'} Apr 13 16:48:55 user devstack@n-api.service[62054]: {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 16:48:55 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:48:55 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 16:48:55 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 16:48:55 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 16:48:55 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 16:48:55 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 16:48:55 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 16:48:55 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 16:48:55 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 16:48:55 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e4776e8-d528-4110-90a3-daf4d1df0171 could not be found. Apr 13 16:48:55 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:48:55 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:48:55 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:48:55 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:48:55 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 16:48:55 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 16:48:55 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 16:48:55 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 16:48:55 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 16:48:55 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 16:48:55 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 16:48:55 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 16:48:55 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 16:48:55 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 16:48:55 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 16:48:55 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 16:48:55 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e4776e8-d528-4110-90a3-daf4d1df0171 could not be found. Apr 13 16:48:55 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:48:55 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:48:55 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:48:55 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:48:55 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 16:48:55 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 16:48:55 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 16:48:55 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 16:48:55 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e4776e8-d528-4110-90a3-daf4d1df0171 could not be found. Apr 13 16:48:55 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 16:48:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-bc72f422-d858-47de-9b28-8c9dabe86a70 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] Returning 404 to user: Instance 6e4776e8-d528-4110-90a3-daf4d1df0171 could not be found. {{(pid=62054) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 16:48:55 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-bc72f422-d858-47de-9b28-8c9dabe86a70 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6e4776e8-d528-4110-90a3-daf4d1df0171" status: 404 len: 111 microversion: 2.1 time: 0.035084 Apr 13 16:48:55 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 316/945] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:48:55 2023] GET /compute/v2.1/servers/6e4776e8-d528-4110-90a3-daf4d1df0171 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 16:49:19 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_cell0:SELECT=2 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:49:19 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_cell0:SELECT=6 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:49:19 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=3 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:49:19 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_cell1:SELECT=4 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:49:19 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-069c028b-abcb-4e19-90ba-1804ee237408 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Action: 'create', calling method: .version_select at 0x7f96dc6c5a20>, body: {"keypair": {"name": "tempest-keypair-1684148765", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBInYPh0gx086UszGyyqEY0fWXC6yPnnRldjV6vUByd8iGqw/BPMxIKhGYsYjdNeYHSNNfn33Tapk/jQbqiYzfJYw4chd2naEdDS8MeKSMHscX8fHOp+k3fZ6id92uef9aA=="}} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:49:19 user devstack@n-api.service[62055]: DEBUG nova.quota [None req-069c028b-abcb-4e19-90ba-1804ee237408 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Getting quotas for project 846732ecb7e047128b4684972d3cd8c6. Resources: {'key_pairs'} {{(pid=62055) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 16:49:19 user devstack@n-api.service[62055]: DEBUG nova.quota [None req-069c028b-abcb-4e19-90ba-1804ee237408 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Getting quotas for user 0c7f54723c494e05ada117353c0790cb and project 846732ecb7e047128b4684972d3cd8c6. Resources: {'key_pairs'} {{(pid=62055) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 16:49:19 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-069c028b-abcb-4e19-90ba-1804ee237408 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.062692 Apr 13 16:49:19 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 314/946] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 13 16:49:19 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:49:21 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-5d5320bb-c759-41f7-a5c0-eb74140bcb89 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2129119099", "imageRef": "708622a9-7465-4492-ade8-b827198f7e30", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "2a5b69f1-fc5b-4c33-a9eb-12a4d9293500"}], "security_groups": [{"name": "tempest-securitygroup--94674129"}], "key_name": "tempest-keypair-1684148765", "user_data": "}} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:49:21 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_cell0:SELECT=2 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:49:21 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_api:SELECT=6 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:49:21 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_cell1:SELECT=2 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:49:21 user devstack@n-api.service[62053]: DEBUG nova.network.neutron [None req-5d5320bb-c759-41f7-a5c0-eb74140bcb89 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] validate_networks() for [('2a5b69f1-fc5b-4c33-a9eb-12a4d9293500', None, None, None, None, None)] {{(pid=62053) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 16:49:21 user devstack@n-api.service[62053]: DEBUG nova.virt.hardware [None req-5d5320bb-c759-41f7-a5c0-eb74140bcb89 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Flavor limits 0:0:0 {{(pid=62053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 16:49:21 user devstack@n-api.service[62053]: DEBUG nova.virt.hardware [None req-5d5320bb-c759-41f7-a5c0-eb74140bcb89 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Image limits 0:0:0 {{(pid=62053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 16:49:21 user devstack@n-api.service[62053]: DEBUG nova.virt.hardware [None req-5d5320bb-c759-41f7-a5c0-eb74140bcb89 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Flavor pref 0:0:0 {{(pid=62053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 16:49:21 user devstack@n-api.service[62053]: DEBUG nova.virt.hardware [None req-5d5320bb-c759-41f7-a5c0-eb74140bcb89 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Image pref 0:0:0 {{(pid=62053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 16:49:21 user devstack@n-api.service[62053]: DEBUG nova.virt.hardware [None req-5d5320bb-c759-41f7-a5c0-eb74140bcb89 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 16:49:21 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-5d5320bb-c759-41f7-a5c0-eb74140bcb89 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:49:21 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-5d5320bb-c759-41f7-a5c0-eb74140bcb89 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:49:21 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-5d5320bb-c759-41f7-a5c0-eb74140bcb89 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:49:21 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-5d5320bb-c759-41f7-a5c0-eb74140bcb89 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:49:21 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-5d5320bb-c759-41f7-a5c0-eb74140bcb89 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:49:21 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-5d5320bb-c759-41f7-a5c0-eb74140bcb89 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:49:21 user devstack@n-api.service[62053]: DEBUG nova.quota [None req-5d5320bb-c759-41f7-a5c0-eb74140bcb89 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Getting quotas for project 846732ecb7e047128b4684972d3cd8c6. Resources: {'instances', 'cores', 'ram'} {{(pid=62053) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 16:49:21 user devstack@n-api.service[62053]: DEBUG nova.quota [None req-5d5320bb-c759-41f7-a5c0-eb74140bcb89 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Getting quotas for user 0c7f54723c494e05ada117353c0790cb and project 846732ecb7e047128b4684972d3cd8c6. Resources: {'instances', 'cores', 'ram'} {{(pid=62053) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 16:49:21 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-5d5320bb-c759-41f7-a5c0-eb74140bcb89 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Going to run 1 instances... {{(pid=62053) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 16:49:21 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-5d5320bb-c759-41f7-a5c0-eb74140bcb89 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='708622a9-7465-4492-ade8-b827198f7e30',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=62053) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 16:49:21 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-5d5320bb-c759-41f7-a5c0-eb74140bcb89 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.698964 Apr 13 16:49:21 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 317/947] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 16:49:21 2023] POST /compute/v2.1/servers => generated 405 bytes in 700 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 16:49:21 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-2cb0daed-3607-460f-9c56-d3861c0c9e54 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:49:21 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-2cb0daed-3607-460f-9c56-d3861c0c9e54 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:49:21 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_api:SELECT=2 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:49:21 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_cell1:SELECT=2 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:49:21 user devstack@n-api.service[62054]: DEBUG nova.policy [None req-2cb0daed-3607-460f-9c56-d3861c0c9e54 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c7f54723c494e05ada117353c0790cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '846732ecb7e047128b4684972d3cd8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62054) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:49:21 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-2cb0daed-3607-460f-9c56-d3861c0c9e54 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] 10.0.0.210 "GET /compute/v2.1/servers/37a39f40-d239-4716-91bc-3f562906bd1e" status: 200 len: 1240 microversion: 2.1 time: 0.080261 Apr 13 16:49:21 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 317/948] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:49:21 2023] GET /compute/v2.1/servers/37a39f40-d239-4716-91bc-3f562906bd1e => generated 1240 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 13 16:49:24 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [req-6aa50eb6-2751-43e5-ba17-7276f11dcbc6 req-e90a0871-49fd-4944-8f78-5e7e34f3bb30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37a39f40-d239-4716-91bc-3f562906bd1e", "tag": "86b0ae4e-a317-4c75-9033-49325a4399d2"}]} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:49:24 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-6aa50eb6-2751-43e5-ba17-7276f11dcbc6 req-e90a0871-49fd-4944-8f78-5e7e34f3bb30 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:49:24 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-6aa50eb6-2751-43e5-ba17-7276f11dcbc6 req-e90a0871-49fd-4944-8f78-5e7e34f3bb30 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:49:24 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-6aa50eb6-2751-43e5-ba17-7276f11dcbc6 req-e90a0871-49fd-4944-8f78-5e7e34f3bb30 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:49:24 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-6aa50eb6-2751-43e5-ba17-7276f11dcbc6 req-e90a0871-49fd-4944-8f78-5e7e34f3bb30 service nova] Creating event network-changed:86b0ae4e-a317-4c75-9033-49325a4399d2 for instance 37a39f40-d239-4716-91bc-3f562906bd1e on user Apr 13 16:49:24 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [req-6aa50eb6-2751-43e5-ba17-7276f11dcbc6 req-e90a0871-49fd-4944-8f78-5e7e34f3bb30 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036249 Apr 13 16:49:24 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 315/949] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:49:24 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:49:24 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-724b6fff-2851-46c6-b516-a324e3806dda tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:49:24 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-724b6fff-2851-46c6-b516-a324e3806dda tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] [instance: e6953c30-c409-45fe-8b22-d9e66d1138ed] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:49:24 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-724b6fff-2851-46c6-b516-a324e3806dda tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:49:24 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-724b6fff-2851-46c6-b516-a324e3806dda tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:49:24 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-724b6fff-2851-46c6-b516-a324e3806dda tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:49:24 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-724b6fff-2851-46c6-b516-a324e3806dda tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:49:24 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-724b6fff-2851-46c6-b516-a324e3806dda tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:49:24 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-724b6fff-2851-46c6-b516-a324e3806dda tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:49:25 user devstack@n-api.service[62053]: DEBUG nova.policy [None req-724b6fff-2851-46c6-b516-a324e3806dda tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5051bef91062494f991ee96a93c9dc6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd099f58565de44fba2df173a2bdb3019', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62053) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:49:25 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-724b6fff-2851-46c6-b516-a324e3806dda tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e6953c30-c409-45fe-8b22-d9e66d1138ed" status: 200 len: 1485 microversion: 2.1 time: 0.234483 Apr 13 16:49:25 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 318/950] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:49:24 2023] GET /compute/v2.1/servers/e6953c30-c409-45fe-8b22-d9e66d1138ed => generated 1485 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:49:26 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-4967fb7e-4ea6-4cb5-9771-d11d7db10ba5 req-2ef0925e-1c3b-46da-ab74-62d54a138d60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37a39f40-d239-4716-91bc-3f562906bd1e", "name": "network-vif-plugged", "status": "completed", "tag": "86b0ae4e-a317-4c75-9033-49325a4399d2"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:49:26 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-4967fb7e-4ea6-4cb5-9771-d11d7db10ba5 req-2ef0925e-1c3b-46da-ab74-62d54a138d60 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:49:26 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-4967fb7e-4ea6-4cb5-9771-d11d7db10ba5 req-2ef0925e-1c3b-46da-ab74-62d54a138d60 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:49:26 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-4967fb7e-4ea6-4cb5-9771-d11d7db10ba5 req-2ef0925e-1c3b-46da-ab74-62d54a138d60 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:49:26 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-4967fb7e-4ea6-4cb5-9771-d11d7db10ba5 req-2ef0925e-1c3b-46da-ab74-62d54a138d60 service nova] Creating event network-vif-plugged:86b0ae4e-a317-4c75-9033-49325a4399d2 for instance 37a39f40-d239-4716-91bc-3f562906bd1e on user Apr 13 16:49:26 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [req-4967fb7e-4ea6-4cb5-9771-d11d7db10ba5 req-2ef0925e-1c3b-46da-ab74-62d54a138d60 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035187 Apr 13 16:49:26 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 318/951] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:49:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:49:28 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [req-4c3b3ac4-512c-4fc6-a8b5-242c66653bfe req-dad72944-f5b8-490b-8f44-c538aacb9422 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37a39f40-d239-4716-91bc-3f562906bd1e", "name": "network-vif-plugged", "status": "completed", "tag": "86b0ae4e-a317-4c75-9033-49325a4399d2"}]} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:49:28 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-4c3b3ac4-512c-4fc6-a8b5-242c66653bfe req-dad72944-f5b8-490b-8f44-c538aacb9422 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:49:28 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-4c3b3ac4-512c-4fc6-a8b5-242c66653bfe req-dad72944-f5b8-490b-8f44-c538aacb9422 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:49:28 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-4c3b3ac4-512c-4fc6-a8b5-242c66653bfe req-dad72944-f5b8-490b-8f44-c538aacb9422 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:49:28 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-4c3b3ac4-512c-4fc6-a8b5-242c66653bfe req-dad72944-f5b8-490b-8f44-c538aacb9422 service nova] Creating event network-vif-plugged:86b0ae4e-a317-4c75-9033-49325a4399d2 for instance 37a39f40-d239-4716-91bc-3f562906bd1e on user Apr 13 16:49:28 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [req-4c3b3ac4-512c-4fc6-a8b5-242c66653bfe req-dad72944-f5b8-490b-8f44-c538aacb9422 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038976 Apr 13 16:49:28 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 316/952] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:49:28 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:50:12 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-61c0f7d5-071d-4d5e-a734-12c7a5e99841 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:50:12 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-61c0f7d5-071d-4d5e-a734-12c7a5e99841 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:50:12 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_cell0:SELECT=2 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:50:12 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_cell0:SELECT=6 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:50:12 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:50:12 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_cell1:SELECT=8 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:50:12 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-61c0f7d5-071d-4d5e-a734-12c7a5e99841 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:50:12 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-61c0f7d5-071d-4d5e-a734-12c7a5e99841 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:50:12 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-61c0f7d5-071d-4d5e-a734-12c7a5e99841 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:50:12 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-61c0f7d5-071d-4d5e-a734-12c7a5e99841 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:50:12 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-61c0f7d5-071d-4d5e-a734-12c7a5e99841 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:50:12 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-61c0f7d5-071d-4d5e-a734-12c7a5e99841 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:50:12 user devstack@n-api.service[62053]: DEBUG nova.policy [None req-61c0f7d5-071d-4d5e-a734-12c7a5e99841 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c7f54723c494e05ada117353c0790cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '846732ecb7e047128b4684972d3cd8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62053) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:50:12 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-61c0f7d5-071d-4d5e-a734-12c7a5e99841 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] 10.0.0.210 "GET /compute/v2.1/servers/37a39f40-d239-4716-91bc-3f562906bd1e" status: 200 len: 1552 microversion: 2.1 time: 0.156990 Apr 13 16:50:12 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 319/953] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:50:12 2023] GET /compute/v2.1/servers/37a39f40-d239-4716-91bc-3f562906bd1e => generated 1552 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:50:25 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_cell0:SELECT=2 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:50:25 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_api:SELECT=6 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:50:25 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_cell1:SELECT=2 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:50:25 user devstack@n-api.service[62054]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 13 16:50:25 user devstack@n-api.service[62054]: Thu Apr 13 16:50:25 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e6953c30-c409-45fe-8b22-d9e66d1138ed (ip 10.0.0.210) !!! Apr 13 16:50:25 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-27f5dad0-6008-4642-8adf-5d7b827912ba tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:50:25 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-27f5dad0-6008-4642-8adf-5d7b827912ba tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] [instance: e6953c30-c409-45fe-8b22-d9e66d1138ed] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:50:25 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-27f5dad0-6008-4642-8adf-5d7b827912ba tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:50:25 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-27f5dad0-6008-4642-8adf-5d7b827912ba tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:50:25 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-27f5dad0-6008-4642-8adf-5d7b827912ba tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:50:25 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-27f5dad0-6008-4642-8adf-5d7b827912ba tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:50:25 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-27f5dad0-6008-4642-8adf-5d7b827912ba tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:50:25 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-27f5dad0-6008-4642-8adf-5d7b827912ba tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:50:25 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-27f5dad0-6008-4642-8adf-5d7b827912ba tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] [instance: e6953c30-c409-45fe-8b22-d9e66d1138ed] Going to try to terminate instance {{(pid=62054) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 16:50:25 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-27f5dad0-6008-4642-8adf-5d7b827912ba tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e6953c30-c409-45fe-8b22-d9e66d1138ed" status: 204 len: 0 microversion: 2.1 time: 0.152534 Apr 13 16:50:25 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 319/954] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 16:50:25 2023] DELETE /compute/v2.1/servers/e6953c30-c409-45fe-8b22-d9e66d1138ed => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 16:50:25 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_cell0:SELECT=4 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:50:25 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=1 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:50:25 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_cell1:SELECT=4 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:50:25 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-521c7efc-2a28-4f07-bc02-6e4a32e7bdc8 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:50:25 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-521c7efc-2a28-4f07-bc02-6e4a32e7bdc8 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] [instance: e6953c30-c409-45fe-8b22-d9e66d1138ed] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:50:25 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-521c7efc-2a28-4f07-bc02-6e4a32e7bdc8 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:50:25 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-521c7efc-2a28-4f07-bc02-6e4a32e7bdc8 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:50:25 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-521c7efc-2a28-4f07-bc02-6e4a32e7bdc8 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:50:25 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-521c7efc-2a28-4f07-bc02-6e4a32e7bdc8 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:50:25 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-521c7efc-2a28-4f07-bc02-6e4a32e7bdc8 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:50:25 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-521c7efc-2a28-4f07-bc02-6e4a32e7bdc8 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:50:25 user devstack@n-api.service[62055]: DEBUG nova.policy [None req-521c7efc-2a28-4f07-bc02-6e4a32e7bdc8 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5051bef91062494f991ee96a93c9dc6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd099f58565de44fba2df173a2bdb3019', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62055) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:50:25 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-521c7efc-2a28-4f07-bc02-6e4a32e7bdc8 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e6953c30-c409-45fe-8b22-d9e66d1138ed" status: 200 len: 1491 microversion: 2.1 time: 0.188380 Apr 13 16:50:25 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 317/955] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:50:25 2023] GET /compute/v2.1/servers/e6953c30-c409-45fe-8b22-d9e66d1138ed => generated 1491 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:50:25 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-c1a0d5b4-4e06-4b6a-8090-31f785cc398b req-813380b8-a44a-434e-a8e5-68cf5cc752fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6953c30-c409-45fe-8b22-d9e66d1138ed", "name": "network-vif-unplugged", "status": "completed", "tag": "e2f0381a-2e17-4d01-b125-0d9ad8c94788"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:50:26 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_api:SELECT=2 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:50:26 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_cell1:SELECT=6 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:50:26 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-c1a0d5b4-4e06-4b6a-8090-31f785cc398b req-813380b8-a44a-434e-a8e5-68cf5cc752fd service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:50:26 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-c1a0d5b4-4e06-4b6a-8090-31f785cc398b req-813380b8-a44a-434e-a8e5-68cf5cc752fd service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:50:26 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-c1a0d5b4-4e06-4b6a-8090-31f785cc398b req-813380b8-a44a-434e-a8e5-68cf5cc752fd service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:50:26 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-c1a0d5b4-4e06-4b6a-8090-31f785cc398b req-813380b8-a44a-434e-a8e5-68cf5cc752fd service nova] Creating event network-vif-unplugged:e2f0381a-2e17-4d01-b125-0d9ad8c94788 for instance e6953c30-c409-45fe-8b22-d9e66d1138ed on user Apr 13 16:50:26 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [req-c1a0d5b4-4e06-4b6a-8090-31f785cc398b req-813380b8-a44a-434e-a8e5-68cf5cc752fd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033192 Apr 13 16:50:26 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 320/956] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:50:25 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:50:26 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-48e1ae66-f3ea-4068-adb3-0919a946ae2a req-33155e01-3dc6-4cd4-85bd-615e08ca4b06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6953c30-c409-45fe-8b22-d9e66d1138ed", "name": "network-vif-deleted", "tag": "e2f0381a-2e17-4d01-b125-0d9ad8c94788"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:50:26 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-48e1ae66-f3ea-4068-adb3-0919a946ae2a req-33155e01-3dc6-4cd4-85bd-615e08ca4b06 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:50:26 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-48e1ae66-f3ea-4068-adb3-0919a946ae2a req-33155e01-3dc6-4cd4-85bd-615e08ca4b06 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:50:26 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-48e1ae66-f3ea-4068-adb3-0919a946ae2a req-33155e01-3dc6-4cd4-85bd-615e08ca4b06 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:50:26 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-48e1ae66-f3ea-4068-adb3-0919a946ae2a req-33155e01-3dc6-4cd4-85bd-615e08ca4b06 service nova] Creating event network-vif-deleted:e2f0381a-2e17-4d01-b125-0d9ad8c94788 for instance e6953c30-c409-45fe-8b22-d9e66d1138ed on user Apr 13 16:50:26 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [req-48e1ae66-f3ea-4068-adb3-0919a946ae2a req-33155e01-3dc6-4cd4-85bd-615e08ca4b06 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036659 Apr 13 16:50:26 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 320/957] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:50:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:50:28 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [req-1d12911d-9288-4a35-be21-b36c56b74e7a req-c0ce2af1-4ddf-4693-b9cd-7eb7cb8274d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6953c30-c409-45fe-8b22-d9e66d1138ed", "name": "network-vif-plugged", "status": "completed", "tag": "e2f0381a-2e17-4d01-b125-0d9ad8c94788"}]} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:50:28 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-1d12911d-9288-4a35-be21-b36c56b74e7a req-c0ce2af1-4ddf-4693-b9cd-7eb7cb8274d5 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:50:28 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-1d12911d-9288-4a35-be21-b36c56b74e7a req-c0ce2af1-4ddf-4693-b9cd-7eb7cb8274d5 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:50:28 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-1d12911d-9288-4a35-be21-b36c56b74e7a req-c0ce2af1-4ddf-4693-b9cd-7eb7cb8274d5 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:50:28 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-1d12911d-9288-4a35-be21-b36c56b74e7a req-c0ce2af1-4ddf-4693-b9cd-7eb7cb8274d5 service nova] Creating event network-vif-plugged:e2f0381a-2e17-4d01-b125-0d9ad8c94788 for instance e6953c30-c409-45fe-8b22-d9e66d1138ed on user Apr 13 16:50:28 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [req-1d12911d-9288-4a35-be21-b36c56b74e7a req-c0ce2af1-4ddf-4693-b9cd-7eb7cb8274d5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039106 Apr 13 16:50:28 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 318/958] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:50:28 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:51:12 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_api:SELECT=2 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:51:12 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_cell1:SELECT=2 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:51:12 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-35b80211-9b9e-40e4-a088-739650ee2cc6 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:51:12 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-35b80211-9b9e-40e4-a088-739650ee2cc6 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:51:12 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-35b80211-9b9e-40e4-a088-739650ee2cc6 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:51:12 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-35b80211-9b9e-40e4-a088-739650ee2cc6 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:51:12 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-35b80211-9b9e-40e4-a088-739650ee2cc6 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:51:12 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-35b80211-9b9e-40e4-a088-739650ee2cc6 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:51:12 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-35b80211-9b9e-40e4-a088-739650ee2cc6 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:51:12 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-35b80211-9b9e-40e4-a088-739650ee2cc6 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:51:12 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-35b80211-9b9e-40e4-a088-739650ee2cc6 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] 10.0.0.210 "GET /compute/v2.1/servers/37a39f40-d239-4716-91bc-3f562906bd1e/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.395073 Apr 13 16:51:12 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 321/959] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 13 16:51:12 2023] GET /compute/v2.1/servers/37a39f40-d239-4716-91bc-3f562906bd1e/os-interface => generated 282 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:51:13 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:51:13 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:51:13 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_api:SELECT=4 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:51:13 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_cell1:SELECT=8 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:51:13 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-00252ad1-5058-4934-bf99-a252af075394 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "80224b51-c622-4586-9f20-796024d9cba0"}} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:51:13 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-00252ad1-5058-4934-bf99-a252af075394 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:51:13 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-00252ad1-5058-4934-bf99-a252af075394 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:51:13 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-00252ad1-5058-4934-bf99-a252af075394 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:51:13 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-00252ad1-5058-4934-bf99-a252af075394 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:51:13 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-00252ad1-5058-4934-bf99-a252af075394 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:51:13 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-00252ad1-5058-4934-bf99-a252af075394 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:51:13 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-00252ad1-5058-4934-bf99-a252af075394 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:51:13 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-8607508b-1f20-456f-a829-5dcd41cc702b req-7822911d-6040-40ed-9594-0535747e490e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37a39f40-d239-4716-91bc-3f562906bd1e", "tag": "86b0ae4e-a317-4c75-9033-49325a4399d2"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:51:13 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-8607508b-1f20-456f-a829-5dcd41cc702b req-7822911d-6040-40ed-9594-0535747e490e service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:51:13 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-8607508b-1f20-456f-a829-5dcd41cc702b req-7822911d-6040-40ed-9594-0535747e490e service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:51:13 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-8607508b-1f20-456f-a829-5dcd41cc702b req-7822911d-6040-40ed-9594-0535747e490e service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:51:13 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-8607508b-1f20-456f-a829-5dcd41cc702b req-7822911d-6040-40ed-9594-0535747e490e service nova] Creating event network-changed:86b0ae4e-a317-4c75-9033-49325a4399d2 for instance 37a39f40-d239-4716-91bc-3f562906bd1e on user Apr 13 16:51:13 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [req-8607508b-1f20-456f-a829-5dcd41cc702b req-7822911d-6040-40ed-9594-0535747e490e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.202827 Apr 13 16:51:13 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 321/960] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:51:13 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:51:14 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-00252ad1-5058-4934-bf99-a252af075394 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] 10.0.0.210 "POST /compute/v2.1/servers/37a39f40-d239-4716-91bc-3f562906bd1e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.451062 Apr 13 16:51:14 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 319/961] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 16:51:13 2023] POST /compute/v2.1/servers/37a39f40-d239-4716-91bc-3f562906bd1e/os-volume_attachments => generated 194 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:51:16 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-2d276fb2-10a0-4214-8aa3-445fdc1b116a tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:51:16 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-2d276fb2-10a0-4214-8aa3-445fdc1b116a tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] [instance: e6953c30-c409-45fe-8b22-d9e66d1138ed] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:51:16 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-2d276fb2-10a0-4214-8aa3-445fdc1b116a tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:51:16 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-2d276fb2-10a0-4214-8aa3-445fdc1b116a tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:51:16 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-2d276fb2-10a0-4214-8aa3-445fdc1b116a tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:51:16 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-2d276fb2-10a0-4214-8aa3-445fdc1b116a tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:51:16 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-2d276fb2-10a0-4214-8aa3-445fdc1b116a tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:51:16 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-2d276fb2-10a0-4214-8aa3-445fdc1b116a tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:51:16 user devstack@n-api.service[62053]: INFO nova.api.openstack.wsgi [None req-2d276fb2-10a0-4214-8aa3-445fdc1b116a tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] HTTP exception thrown: Instance e6953c30-c409-45fe-8b22-d9e66d1138ed could not be found. Apr 13 16:51:16 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-2d276fb2-10a0-4214-8aa3-445fdc1b116a tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Request method failure captured: Apr 13 16:51:16 user devstack@n-api.service[62053]: request: GET /compute/v2.1/servers/e6953c30-c409-45fe-8b22-d9e66d1138ed HTTP/1.1 Apr 13 16:51:16 user devstack@n-api.service[62053]: Accept: application/json Apr 13 16:51:16 user devstack@n-api.service[62053]: Accept-Encoding: identity Apr 13 16:51:16 user devstack@n-api.service[62053]: Connection: close Apr 13 16:51:16 user devstack@n-api.service[62053]: Content-Length: 0 Apr 13 16:51:16 user devstack@n-api.service[62053]: Content-Type: application/json Apr 13 16:51:16 user devstack@n-api.service[62053]: Host: 10.0.0.210 Apr 13 16:51:16 user devstack@n-api.service[62053]: Openstack-System-Scope: None Apr 13 16:51:16 user devstack@n-api.service[62053]: User-Agent: python-urllib3/1.26.15 Apr 13 16:51:16 user devstack@n-api.service[62053]: X-Auth-Token: gAAAAABkODJgX0v9K-cYZbP6vb41sGHXNFxcFlxG04TSE13fS7U9uGTqgZ7uGgBaekN_LbRiubvybiUP3DUF12GWGUcbGW9kndN9AF_R6mfFMI94XcW_6sIorn6k04w06tK9bXeZW4OWw6g5PXXgXzNTgYxej3qnRJ4ksG43sdo0eFw1ESb_OpI Apr 13 16:51:16 user devstack@n-api.service[62053]: X-Domain-Id: None Apr 13 16:51:16 user devstack@n-api.service[62053]: X-Domain-Name: None Apr 13 16:51:16 user devstack@n-api.service[62053]: X-Identity-Status: Confirmed Apr 13 16:51:16 user devstack@n-api.service[62053]: X-Is-Admin-Project: True Apr 13 16:51:16 user devstack@n-api.service[62053]: X-Project-Domain-Id: default Apr 13 16:51:16 user devstack@n-api.service[62053]: X-Project-Domain-Name: Default Apr 13 16:51:16 user devstack@n-api.service[62053]: X-Project-Id: d099f58565de44fba2df173a2bdb3019 Apr 13 16:51:16 user devstack@n-api.service[62053]: X-Project-Name: tempest-VolumesActionsTest-450740344 Apr 13 16:51:16 user devstack@n-api.service[62053]: X-Role: reader,member Apr 13 16:51:16 user devstack@n-api.service[62053]: X-Roles: reader,member Apr 13 16:51:16 user devstack@n-api.service[62053]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d099f58565de44fba2df173a2bdb3019"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d099f58565de44fba2df173a2bdb3019"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d099f58565de44fba2df173a2bdb3019"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 13 16:51:16 user devstack@n-api.service[62053]: X-Tenant: tempest-VolumesActionsTest-450740344 Apr 13 16:51:16 user devstack@n-api.service[62053]: X-Tenant-Id: d099f58565de44fba2df173a2bdb3019 Apr 13 16:51:16 user devstack@n-api.service[62053]: X-Tenant-Name: tempest-VolumesActionsTest-450740344 Apr 13 16:51:16 user devstack@n-api.service[62053]: X-User: tempest-VolumesActionsTest-450740344-project-member Apr 13 16:51:16 user devstack@n-api.service[62053]: X-User-Domain-Id: default Apr 13 16:51:16 user devstack@n-api.service[62053]: X-User-Domain-Name: Default Apr 13 16:51:16 user devstack@n-api.service[62053]: X-User-Id: 5051bef91062494f991ee96a93c9dc6a Apr 13 16:51:16 user devstack@n-api.service[62053]: X-User-Name: tempest-VolumesActionsTest-450740344-project-member Apr 13 16:51:16 user devstack@n-api.service[62053]: method: > Apr 13 16:51:16 user devstack@n-api.service[62053]: exception: Instance e6953c30-c409-45fe-8b22-d9e66d1138ed could not be found. Apr 13 16:51:16 user devstack@n-api.service[62053]: action_args: {'id': 'e6953c30-c409-45fe-8b22-d9e66d1138ed'} Apr 13 16:51:16 user devstack@n-api.service[62053]: {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 16:51:16 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:51:16 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 16:51:16 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 16:51:16 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 16:51:16 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 16:51:16 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 16:51:16 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 16:51:16 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 16:51:16 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 16:51:16 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6953c30-c409-45fe-8b22-d9e66d1138ed could not be found. Apr 13 16:51:16 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:51:16 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:51:16 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:51:16 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:51:16 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 16:51:16 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 16:51:16 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 16:51:16 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 16:51:16 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 16:51:16 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 16:51:16 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 16:51:16 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 16:51:16 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 16:51:16 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 16:51:16 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 16:51:16 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 16:51:16 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6953c30-c409-45fe-8b22-d9e66d1138ed could not be found. Apr 13 16:51:16 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:51:16 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:51:16 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:51:16 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:51:16 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 16:51:16 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 16:51:16 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 16:51:16 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 16:51:16 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6953c30-c409-45fe-8b22-d9e66d1138ed could not be found. Apr 13 16:51:16 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:51:16 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-2d276fb2-10a0-4214-8aa3-445fdc1b116a tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Returning 404 to user: Instance e6953c30-c409-45fe-8b22-d9e66d1138ed could not be found. {{(pid=62053) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 16:51:16 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-2d276fb2-10a0-4214-8aa3-445fdc1b116a tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e6953c30-c409-45fe-8b22-d9e66d1138ed" status: 404 len: 111 microversion: 2.1 time: 0.046992 Apr 13 16:51:16 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 322/962] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:51:15 2023] GET /compute/v2.1/servers/e6953c30-c409-45fe-8b22-d9e66d1138ed => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 16:51:16 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-8c4816d7-3cce-452f-a2ac-47a3a4f04d7e tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1617630502", "imageRef": "708622a9-7465-4492-ade8-b827198f7e30", "flavorRef": "42", "networks": [{"uuid": "b742fa77-3781-46be-8a60-11bf61969238"}]}} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:51:16 user devstack@n-api.service[62054]: DEBUG nova.network.neutron [None req-8c4816d7-3cce-452f-a2ac-47a3a4f04d7e tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] validate_networks() for [('b742fa77-3781-46be-8a60-11bf61969238', None, None, None, None, None)] {{(pid=62054) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 16:51:16 user devstack@n-api.service[62054]: DEBUG nova.virt.hardware [None req-8c4816d7-3cce-452f-a2ac-47a3a4f04d7e tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Flavor limits 0:0:0 {{(pid=62054) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 16:51:16 user devstack@n-api.service[62054]: DEBUG nova.virt.hardware [None req-8c4816d7-3cce-452f-a2ac-47a3a4f04d7e tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Image limits 0:0:0 {{(pid=62054) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 16:51:16 user devstack@n-api.service[62054]: DEBUG nova.virt.hardware [None req-8c4816d7-3cce-452f-a2ac-47a3a4f04d7e tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Flavor pref 0:0:0 {{(pid=62054) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 16:51:16 user devstack@n-api.service[62054]: DEBUG nova.virt.hardware [None req-8c4816d7-3cce-452f-a2ac-47a3a4f04d7e tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Image pref 0:0:0 {{(pid=62054) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 16:51:16 user devstack@n-api.service[62054]: DEBUG nova.virt.hardware [None req-8c4816d7-3cce-452f-a2ac-47a3a4f04d7e tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62054) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 16:51:16 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-8c4816d7-3cce-452f-a2ac-47a3a4f04d7e tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:51:16 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-8c4816d7-3cce-452f-a2ac-47a3a4f04d7e tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:51:16 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-8c4816d7-3cce-452f-a2ac-47a3a4f04d7e tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:51:16 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-8c4816d7-3cce-452f-a2ac-47a3a4f04d7e tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:51:16 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-8c4816d7-3cce-452f-a2ac-47a3a4f04d7e tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:51:16 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-8c4816d7-3cce-452f-a2ac-47a3a4f04d7e tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:51:16 user devstack@n-api.service[62054]: DEBUG nova.quota [None req-8c4816d7-3cce-452f-a2ac-47a3a4f04d7e tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Getting quotas for project d099f58565de44fba2df173a2bdb3019. Resources: {'instances', 'cores', 'ram'} {{(pid=62054) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 16:51:16 user devstack@n-api.service[62054]: DEBUG nova.quota [None req-8c4816d7-3cce-452f-a2ac-47a3a4f04d7e tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Getting quotas for user 5051bef91062494f991ee96a93c9dc6a and project d099f58565de44fba2df173a2bdb3019. Resources: {'instances', 'cores', 'ram'} {{(pid=62054) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 16:51:16 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-8c4816d7-3cce-452f-a2ac-47a3a4f04d7e tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Going to run 1 instances... {{(pid=62054) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 16:51:16 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-8c4816d7-3cce-452f-a2ac-47a3a4f04d7e tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] [instance: 61c8082e-a4c5-47de-a239-05c10bb4c5ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='708622a9-7465-4492-ade8-b827198f7e30',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=62054) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 16:51:16 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-8c4816d7-3cce-452f-a2ac-47a3a4f04d7e tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.619025 Apr 13 16:51:16 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 322/963] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 16:51:16 2023] POST /compute/v2.1/servers => generated 378 bytes in 621 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 16:51:16 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-fa41cbfe-b876-4076-b2cb-072f604700cf tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:51:16 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-fa41cbfe-b876-4076-b2cb-072f604700cf tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] [instance: 61c8082e-a4c5-47de-a239-05c10bb4c5ac] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:51:16 user devstack@n-api.service[62055]: DEBUG nova.policy [None req-fa41cbfe-b876-4076-b2cb-072f604700cf tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5051bef91062494f991ee96a93c9dc6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd099f58565de44fba2df173a2bdb3019', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62055) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:51:16 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-fa41cbfe-b876-4076-b2cb-072f604700cf tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] 10.0.0.210 "GET /compute/v2.1/servers/61c8082e-a4c5-47de-a239-05c10bb4c5ac" status: 200 len: 1208 microversion: 2.1 time: 0.172243 Apr 13 16:51:16 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 320/964] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:51:16 2023] GET /compute/v2.1/servers/61c8082e-a4c5-47de-a239-05c10bb4c5ac => generated 1208 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:51:19 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-4fb09c35-1f3f-42ca-9145-13014bb9d8d5 req-d0a4e77d-d4c3-4ff5-ab5c-5962ab91e16f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61c8082e-a4c5-47de-a239-05c10bb4c5ac", "tag": "2366235b-52e8-49ab-8a64-f961015f5bec"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:51:19 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-4fb09c35-1f3f-42ca-9145-13014bb9d8d5 req-d0a4e77d-d4c3-4ff5-ab5c-5962ab91e16f service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:51:19 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-4fb09c35-1f3f-42ca-9145-13014bb9d8d5 req-d0a4e77d-d4c3-4ff5-ab5c-5962ab91e16f service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:51:19 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-4fb09c35-1f3f-42ca-9145-13014bb9d8d5 req-d0a4e77d-d4c3-4ff5-ab5c-5962ab91e16f service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:51:19 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-4fb09c35-1f3f-42ca-9145-13014bb9d8d5 req-d0a4e77d-d4c3-4ff5-ab5c-5962ab91e16f service nova] Creating event network-changed:2366235b-52e8-49ab-8a64-f961015f5bec for instance 61c8082e-a4c5-47de-a239-05c10bb4c5ac on user Apr 13 16:51:19 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [req-4fb09c35-1f3f-42ca-9145-13014bb9d8d5 req-d0a4e77d-d4c3-4ff5-ab5c-5962ab91e16f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045672 Apr 13 16:51:19 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 323/965] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:51:19 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:51:22 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-e02886f6-a69b-4313-b1a2-235373cf73db req-2e304ed4-e0dc-4d0a-b1d2-91f5a0a75460 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61c8082e-a4c5-47de-a239-05c10bb4c5ac", "name": "network-vif-plugged", "status": "completed", "tag": "2366235b-52e8-49ab-8a64-f961015f5bec"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:51:22 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-e02886f6-a69b-4313-b1a2-235373cf73db req-2e304ed4-e0dc-4d0a-b1d2-91f5a0a75460 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:51:22 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-e02886f6-a69b-4313-b1a2-235373cf73db req-2e304ed4-e0dc-4d0a-b1d2-91f5a0a75460 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:51:22 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-e02886f6-a69b-4313-b1a2-235373cf73db req-2e304ed4-e0dc-4d0a-b1d2-91f5a0a75460 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:51:22 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-e02886f6-a69b-4313-b1a2-235373cf73db req-2e304ed4-e0dc-4d0a-b1d2-91f5a0a75460 service nova] Creating event network-vif-plugged:2366235b-52e8-49ab-8a64-f961015f5bec for instance 61c8082e-a4c5-47de-a239-05c10bb4c5ac on user Apr 13 16:51:22 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [req-e02886f6-a69b-4313-b1a2-235373cf73db req-2e304ed4-e0dc-4d0a-b1d2-91f5a0a75460 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115932 Apr 13 16:51:22 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 323/966] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:51:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:51:22 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-795dab24-b9d0-4b47-992f-7e1e5c3ad0d6 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:51:22 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-795dab24-b9d0-4b47-992f-7e1e5c3ad0d6 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:51:22 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-795dab24-b9d0-4b47-992f-7e1e5c3ad0d6 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:51:22 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-795dab24-b9d0-4b47-992f-7e1e5c3ad0d6 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:51:22 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-795dab24-b9d0-4b47-992f-7e1e5c3ad0d6 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:51:22 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-795dab24-b9d0-4b47-992f-7e1e5c3ad0d6 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:51:22 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-795dab24-b9d0-4b47-992f-7e1e5c3ad0d6 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:51:22 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-795dab24-b9d0-4b47-992f-7e1e5c3ad0d6 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:51:22 user devstack@n-api.service[62055]: DEBUG nova.objects.instance [None req-795dab24-b9d0-4b47-992f-7e1e5c3ad0d6 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lazy-loading 'flavor' on Instance uuid 37a39f40-d239-4716-91bc-3f562906bd1e {{(pid=62055) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 16:51:22 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-795dab24-b9d0-4b47-992f-7e1e5c3ad0d6 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] 10.0.0.210 "POST /compute/v2.1/servers/37a39f40-d239-4716-91bc-3f562906bd1e/action" status: 200 len: 32 microversion: 2.1 time: 0.156907 Apr 13 16:51:22 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 321/967] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 16:51:22 2023] POST /compute/v2.1/servers/37a39f40-d239-4716-91bc-3f562906bd1e/action => generated 32 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 16:51:22 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-b4ab2abf-cbf8-41cd-8185-6a5517f6dd14 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:51:22 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-b4ab2abf-cbf8-41cd-8185-6a5517f6dd14 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:51:22 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-b4ab2abf-cbf8-41cd-8185-6a5517f6dd14 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:51:22 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-b4ab2abf-cbf8-41cd-8185-6a5517f6dd14 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:51:22 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-b4ab2abf-cbf8-41cd-8185-6a5517f6dd14 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:51:22 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-b4ab2abf-cbf8-41cd-8185-6a5517f6dd14 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:51:22 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-b4ab2abf-cbf8-41cd-8185-6a5517f6dd14 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:51:22 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-b4ab2abf-cbf8-41cd-8185-6a5517f6dd14 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:51:23 user devstack@n-api.service[62053]: DEBUG nova.policy [None req-b4ab2abf-cbf8-41cd-8185-6a5517f6dd14 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c7f54723c494e05ada117353c0790cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '846732ecb7e047128b4684972d3cd8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62053) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:51:23 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-b4ab2abf-cbf8-41cd-8185-6a5517f6dd14 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] 10.0.0.210 "GET /compute/v2.1/servers/37a39f40-d239-4716-91bc-3f562906bd1e" status: 200 len: 1723 microversion: 2.1 time: 0.229626 Apr 13 16:51:23 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 324/968] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:51:22 2023] GET /compute/v2.1/servers/37a39f40-d239-4716-91bc-3f562906bd1e => generated 1723 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 13 16:51:23 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-90d3c2b1-d291-455c-872d-1af87b18a323 req-236e74d7-91b8-46c2-94ba-668de3eee733 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37a39f40-d239-4716-91bc-3f562906bd1e", "name": "network-vif-unplugged", "status": "completed", "tag": "86b0ae4e-a317-4c75-9033-49325a4399d2"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:51:23 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-90d3c2b1-d291-455c-872d-1af87b18a323 req-236e74d7-91b8-46c2-94ba-668de3eee733 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:51:23 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-90d3c2b1-d291-455c-872d-1af87b18a323 req-236e74d7-91b8-46c2-94ba-668de3eee733 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:51:23 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-90d3c2b1-d291-455c-872d-1af87b18a323 req-236e74d7-91b8-46c2-94ba-668de3eee733 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:51:23 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-90d3c2b1-d291-455c-872d-1af87b18a323 req-236e74d7-91b8-46c2-94ba-668de3eee733 service nova] Creating event network-vif-unplugged:86b0ae4e-a317-4c75-9033-49325a4399d2 for instance 37a39f40-d239-4716-91bc-3f562906bd1e on user Apr 13 16:51:23 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [req-90d3c2b1-d291-455c-872d-1af87b18a323 req-236e74d7-91b8-46c2-94ba-668de3eee733 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.084455 Apr 13 16:51:23 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 324/969] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:51:23 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:51:24 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [req-cb70d00b-7d41-40a6-9719-519dbde8638f req-09e578f3-5cc6-439e-9075-ae858e0037f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61c8082e-a4c5-47de-a239-05c10bb4c5ac", "name": "network-vif-plugged", "status": "completed", "tag": "2366235b-52e8-49ab-8a64-f961015f5bec"}]} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:51:24 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-cb70d00b-7d41-40a6-9719-519dbde8638f req-09e578f3-5cc6-439e-9075-ae858e0037f6 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:51:24 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-cb70d00b-7d41-40a6-9719-519dbde8638f req-09e578f3-5cc6-439e-9075-ae858e0037f6 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:51:24 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-cb70d00b-7d41-40a6-9719-519dbde8638f req-09e578f3-5cc6-439e-9075-ae858e0037f6 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:51:24 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-cb70d00b-7d41-40a6-9719-519dbde8638f req-09e578f3-5cc6-439e-9075-ae858e0037f6 service nova] Creating event network-vif-plugged:2366235b-52e8-49ab-8a64-f961015f5bec for instance 61c8082e-a4c5-47de-a239-05c10bb4c5ac on user Apr 13 16:51:24 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [req-cb70d00b-7d41-40a6-9719-519dbde8638f req-09e578f3-5cc6-439e-9075-ae858e0037f6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035823 Apr 13 16:51:24 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 322/970] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:51:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:51:25 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-ad3247e1-83e3-4aa5-91d0-6bbed95859ab req-3cc65031-a2c8-4243-9df0-ec61d8ec3472 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37a39f40-d239-4716-91bc-3f562906bd1e", "name": "network-vif-plugged", "status": "completed", "tag": "86b0ae4e-a317-4c75-9033-49325a4399d2"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:51:25 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-ad3247e1-83e3-4aa5-91d0-6bbed95859ab req-3cc65031-a2c8-4243-9df0-ec61d8ec3472 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:51:25 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-ad3247e1-83e3-4aa5-91d0-6bbed95859ab req-3cc65031-a2c8-4243-9df0-ec61d8ec3472 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:51:25 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-ad3247e1-83e3-4aa5-91d0-6bbed95859ab req-3cc65031-a2c8-4243-9df0-ec61d8ec3472 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:51:25 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-ad3247e1-83e3-4aa5-91d0-6bbed95859ab req-3cc65031-a2c8-4243-9df0-ec61d8ec3472 service nova] Creating event network-vif-plugged:86b0ae4e-a317-4c75-9033-49325a4399d2 for instance 37a39f40-d239-4716-91bc-3f562906bd1e on user Apr 13 16:51:25 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [req-ad3247e1-83e3-4aa5-91d0-6bbed95859ab req-3cc65031-a2c8-4243-9df0-ec61d8ec3472 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034893 Apr 13 16:51:25 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 325/971] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:51:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:51:27 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_cell0:SELECT=2 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:51:27 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_cell0:SELECT=6 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:51:27 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-40722a49-4ef2-489e-80a4-9462e97574e5 req-0ed5e5bc-4116-43dd-b288-9af6ef01e625 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37a39f40-d239-4716-91bc-3f562906bd1e", "name": "network-vif-plugged", "status": "completed", "tag": "86b0ae4e-a317-4c75-9033-49325a4399d2"}, {"server_uuid": "37a39f40-d239-4716-91bc-3f562906bd1e", "name": "network-vif-plugged", "status": "completed", "tag": "86b0ae4e-a317-4c75-9033-49325a4399d2"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:51:27 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-40722a49-4ef2-489e-80a4-9462e97574e5 req-0ed5e5bc-4116-43dd-b288-9af6ef01e625 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:51:27 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-40722a49-4ef2-489e-80a4-9462e97574e5 req-0ed5e5bc-4116-43dd-b288-9af6ef01e625 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:51:27 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-40722a49-4ef2-489e-80a4-9462e97574e5 req-0ed5e5bc-4116-43dd-b288-9af6ef01e625 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:51:27 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-40722a49-4ef2-489e-80a4-9462e97574e5 req-0ed5e5bc-4116-43dd-b288-9af6ef01e625 service nova] Creating event network-vif-plugged:86b0ae4e-a317-4c75-9033-49325a4399d2 for instance 37a39f40-d239-4716-91bc-3f562906bd1e on user Apr 13 16:51:27 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-40722a49-4ef2-489e-80a4-9462e97574e5 req-0ed5e5bc-4116-43dd-b288-9af6ef01e625 service nova] Creating event network-vif-plugged:86b0ae4e-a317-4c75-9033-49325a4399d2 for instance 37a39f40-d239-4716-91bc-3f562906bd1e on user Apr 13 16:51:27 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [req-40722a49-4ef2-489e-80a4-9462e97574e5 req-0ed5e5bc-4116-43dd-b288-9af6ef01e625 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.037982 Apr 13 16:51:27 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 325/972] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:51:27 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:52:07 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_cell0:SELECT=2 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:52:07 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_api:SELECT=10 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:52:07 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:52:07 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-0707ee09-2199-4cca-8af3-9789f04686b8 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:52:07 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-0707ee09-2199-4cca-8af3-9789f04686b8 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] [instance: 61c8082e-a4c5-47de-a239-05c10bb4c5ac] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:52:07 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-0707ee09-2199-4cca-8af3-9789f04686b8 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:52:07 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-0707ee09-2199-4cca-8af3-9789f04686b8 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:52:07 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-0707ee09-2199-4cca-8af3-9789f04686b8 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:52:07 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-0707ee09-2199-4cca-8af3-9789f04686b8 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:52:07 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-0707ee09-2199-4cca-8af3-9789f04686b8 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:52:07 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-0707ee09-2199-4cca-8af3-9789f04686b8 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:52:07 user devstack@n-api.service[62055]: DEBUG nova.policy [None req-0707ee09-2199-4cca-8af3-9789f04686b8 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5051bef91062494f991ee96a93c9dc6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd099f58565de44fba2df173a2bdb3019', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62055) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:52:07 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-0707ee09-2199-4cca-8af3-9789f04686b8 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] 10.0.0.210 "GET /compute/v2.1/servers/61c8082e-a4c5-47de-a239-05c10bb4c5ac" status: 200 len: 1486 microversion: 2.1 time: 0.214405 Apr 13 16:52:07 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 323/973] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:52:07 2023] GET /compute/v2.1/servers/61c8082e-a4c5-47de-a239-05c10bb4c5ac => generated 1486 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:52:13 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_api:SELECT=10 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:52:13 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_cell1:SELECT=16 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:52:13 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-a9208220-ef3e-40e7-8ee6-9b0e8e5f3919 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:52:13 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-a9208220-ef3e-40e7-8ee6-9b0e8e5f3919 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:52:13 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-a9208220-ef3e-40e7-8ee6-9b0e8e5f3919 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:52:13 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-a9208220-ef3e-40e7-8ee6-9b0e8e5f3919 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:52:13 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-a9208220-ef3e-40e7-8ee6-9b0e8e5f3919 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:52:13 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-a9208220-ef3e-40e7-8ee6-9b0e8e5f3919 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:52:13 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-a9208220-ef3e-40e7-8ee6-9b0e8e5f3919 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:52:13 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-a9208220-ef3e-40e7-8ee6-9b0e8e5f3919 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:52:13 user devstack@n-api.service[62053]: DEBUG nova.policy [None req-a9208220-ef3e-40e7-8ee6-9b0e8e5f3919 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c7f54723c494e05ada117353c0790cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '846732ecb7e047128b4684972d3cd8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62053) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:52:13 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-a9208220-ef3e-40e7-8ee6-9b0e8e5f3919 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] 10.0.0.210 "GET /compute/v2.1/servers/37a39f40-d239-4716-91bc-3f562906bd1e" status: 200 len: 1703 microversion: 2.1 time: 0.327752 Apr 13 16:52:13 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 326/974] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:52:13 2023] GET /compute/v2.1/servers/37a39f40-d239-4716-91bc-3f562906bd1e => generated 1703 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 13 16:53:07 user devstack@n-api.service[62054]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d5f4f53d-a137-4628-9932-f3f71afa82e2] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 13 16:53:07 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=3 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:53:07 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_cell1:SELECT=10 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:53:07 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-1f598c04-91d1-4862-a498-d2bd25bb734f tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:53:07 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-1f598c04-91d1-4862-a498-d2bd25bb734f tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] [instance: 61c8082e-a4c5-47de-a239-05c10bb4c5ac] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:53:07 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-1f598c04-91d1-4862-a498-d2bd25bb734f tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:53:07 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-1f598c04-91d1-4862-a498-d2bd25bb734f tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:53:07 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-1f598c04-91d1-4862-a498-d2bd25bb734f tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:53:07 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-1f598c04-91d1-4862-a498-d2bd25bb734f tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:53:07 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-1f598c04-91d1-4862-a498-d2bd25bb734f tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:53:07 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-1f598c04-91d1-4862-a498-d2bd25bb734f tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:53:07 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-1f598c04-91d1-4862-a498-d2bd25bb734f tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] [instance: 61c8082e-a4c5-47de-a239-05c10bb4c5ac] Going to try to terminate instance {{(pid=62054) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 16:53:07 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-1f598c04-91d1-4862-a498-d2bd25bb734f tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/61c8082e-a4c5-47de-a239-05c10bb4c5ac" status: 204 len: 0 microversion: 2.1 time: 0.118229 Apr 13 16:53:07 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 326/975] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 16:53:07 2023] DELETE /compute/v2.1/servers/61c8082e-a4c5-47de-a239-05c10bb4c5ac => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 16:53:07 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_api:SELECT=2 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:53:07 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_cell1:SELECT=6 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:53:07 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-7d9f4df9-83e5-45d2-b80c-c2e527dd4a18 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:53:07 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-7d9f4df9-83e5-45d2-b80c-c2e527dd4a18 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] [instance: 61c8082e-a4c5-47de-a239-05c10bb4c5ac] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:53:07 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-7d9f4df9-83e5-45d2-b80c-c2e527dd4a18 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:53:07 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-7d9f4df9-83e5-45d2-b80c-c2e527dd4a18 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:53:07 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-7d9f4df9-83e5-45d2-b80c-c2e527dd4a18 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:53:07 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-7d9f4df9-83e5-45d2-b80c-c2e527dd4a18 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:53:07 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-7d9f4df9-83e5-45d2-b80c-c2e527dd4a18 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:53:07 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-7d9f4df9-83e5-45d2-b80c-c2e527dd4a18 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:53:08 user devstack@n-api.service[62055]: DEBUG nova.policy [None req-7d9f4df9-83e5-45d2-b80c-c2e527dd4a18 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5051bef91062494f991ee96a93c9dc6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd099f58565de44fba2df173a2bdb3019', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62055) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:53:08 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-7d9f4df9-83e5-45d2-b80c-c2e527dd4a18 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] 10.0.0.210 "GET /compute/v2.1/servers/61c8082e-a4c5-47de-a239-05c10bb4c5ac" status: 200 len: 1492 microversion: 2.1 time: 0.231116 Apr 13 16:53:08 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 324/976] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:53:07 2023] GET /compute/v2.1/servers/61c8082e-a4c5-47de-a239-05c10bb4c5ac => generated 1492 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:53:08 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_api:SELECT=2 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:53:08 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_cell1:SELECT=6 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:53:08 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-21aa598f-a466-43fa-a774-4e4208b63dc4 req-9733910a-6fec-4cf6-a942-d992571a72a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61c8082e-a4c5-47de-a239-05c10bb4c5ac", "name": "network-vif-unplugged", "status": "completed", "tag": "2366235b-52e8-49ab-8a64-f961015f5bec"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:53:08 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-21aa598f-a466-43fa-a774-4e4208b63dc4 req-9733910a-6fec-4cf6-a942-d992571a72a2 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:53:08 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-21aa598f-a466-43fa-a774-4e4208b63dc4 req-9733910a-6fec-4cf6-a942-d992571a72a2 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:53:08 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-21aa598f-a466-43fa-a774-4e4208b63dc4 req-9733910a-6fec-4cf6-a942-d992571a72a2 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:53:08 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-21aa598f-a466-43fa-a774-4e4208b63dc4 req-9733910a-6fec-4cf6-a942-d992571a72a2 service nova] Creating event network-vif-unplugged:2366235b-52e8-49ab-8a64-f961015f5bec for instance 61c8082e-a4c5-47de-a239-05c10bb4c5ac on user Apr 13 16:53:08 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [req-21aa598f-a466-43fa-a774-4e4208b63dc4 req-9733910a-6fec-4cf6-a942-d992571a72a2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033845 Apr 13 16:53:08 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 327/977] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:53:08 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:53:09 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-69243293-0af1-486d-bf36-89caf8c4371d req-cc66958b-6dc3-468b-9495-df37d788ebf3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61c8082e-a4c5-47de-a239-05c10bb4c5ac", "name": "network-vif-deleted", "tag": "2366235b-52e8-49ab-8a64-f961015f5bec"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:53:09 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-69243293-0af1-486d-bf36-89caf8c4371d req-cc66958b-6dc3-468b-9495-df37d788ebf3 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:53:09 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-69243293-0af1-486d-bf36-89caf8c4371d req-cc66958b-6dc3-468b-9495-df37d788ebf3 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:53:09 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-69243293-0af1-486d-bf36-89caf8c4371d req-cc66958b-6dc3-468b-9495-df37d788ebf3 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:53:09 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-69243293-0af1-486d-bf36-89caf8c4371d req-cc66958b-6dc3-468b-9495-df37d788ebf3 service nova] Creating event network-vif-deleted:2366235b-52e8-49ab-8a64-f961015f5bec for instance 61c8082e-a4c5-47de-a239-05c10bb4c5ac on user Apr 13 16:53:09 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [req-69243293-0af1-486d-bf36-89caf8c4371d req-cc66958b-6dc3-468b-9495-df37d788ebf3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029645 Apr 13 16:53:09 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 327/978] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:53:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:53:10 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [req-39defff9-ed2f-4d42-8b07-1c4fb51ab9ac req-913f0fde-33d2-4dd2-afcf-2f031b4f4f20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61c8082e-a4c5-47de-a239-05c10bb4c5ac", "name": "network-vif-plugged", "status": "completed", "tag": "2366235b-52e8-49ab-8a64-f961015f5bec"}]} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:53:10 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-39defff9-ed2f-4d42-8b07-1c4fb51ab9ac req-913f0fde-33d2-4dd2-afcf-2f031b4f4f20 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:53:10 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-39defff9-ed2f-4d42-8b07-1c4fb51ab9ac req-913f0fde-33d2-4dd2-afcf-2f031b4f4f20 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:53:10 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-39defff9-ed2f-4d42-8b07-1c4fb51ab9ac req-913f0fde-33d2-4dd2-afcf-2f031b4f4f20 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:53:10 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-39defff9-ed2f-4d42-8b07-1c4fb51ab9ac req-913f0fde-33d2-4dd2-afcf-2f031b4f4f20 service nova] Creating event network-vif-plugged:2366235b-52e8-49ab-8a64-f961015f5bec for instance 61c8082e-a4c5-47de-a239-05c10bb4c5ac on user Apr 13 16:53:10 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [req-39defff9-ed2f-4d42-8b07-1c4fb51ab9ac req-913f0fde-33d2-4dd2-afcf-2f031b4f4f20 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031095 Apr 13 16:53:10 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 325/979] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:53:10 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:53:13 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-59cad00b-ea4b-4e9e-b6ca-b5a8ed8fe1b2 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:53:13 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-59cad00b-ea4b-4e9e-b6ca-b5a8ed8fe1b2 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:53:13 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-59cad00b-ea4b-4e9e-b6ca-b5a8ed8fe1b2 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:53:13 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-59cad00b-ea4b-4e9e-b6ca-b5a8ed8fe1b2 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:53:13 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-59cad00b-ea4b-4e9e-b6ca-b5a8ed8fe1b2 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:53:13 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-59cad00b-ea4b-4e9e-b6ca-b5a8ed8fe1b2 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:53:13 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-59cad00b-ea4b-4e9e-b6ca-b5a8ed8fe1b2 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:53:13 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-59cad00b-ea4b-4e9e-b6ca-b5a8ed8fe1b2 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:53:13 user devstack@n-api.service[62053]: INFO nova.api.openstack.wsgi [None req-59cad00b-ea4b-4e9e-b6ca-b5a8ed8fe1b2 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] HTTP exception thrown: Cannot 'detach_volume' instance 37a39f40-d239-4716-91bc-3f562906bd1e while it is in vm_state rescued Apr 13 16:53:13 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-59cad00b-ea4b-4e9e-b6ca-b5a8ed8fe1b2 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Request method failure captured: Apr 13 16:53:13 user devstack@n-api.service[62053]: request: DELETE /compute/v2.1/servers/37a39f40-d239-4716-91bc-3f562906bd1e/os-volume_attachments/80224b51-c622-4586-9f20-796024d9cba0 HTTP/1.1 Apr 13 16:53:13 user devstack@n-api.service[62053]: Accept: application/json Apr 13 16:53:13 user devstack@n-api.service[62053]: Accept-Encoding: identity Apr 13 16:53:13 user devstack@n-api.service[62053]: Connection: close Apr 13 16:53:13 user devstack@n-api.service[62053]: Content-Length: 0 Apr 13 16:53:13 user devstack@n-api.service[62053]: Content-Type: application/json Apr 13 16:53:13 user devstack@n-api.service[62053]: Host: 10.0.0.210 Apr 13 16:53:13 user devstack@n-api.service[62053]: Openstack-System-Scope: None Apr 13 16:53:13 user devstack@n-api.service[62053]: User-Agent: python-urllib3/1.26.15 Apr 13 16:53:13 user devstack@n-api.service[62053]: X-Auth-Token: gAAAAABkODCU3usXoI1IVebJSthBcEDDnDQRiqRW1FYIxzNbUkDIlDU6UteHgRT6XFjSy--lQKRkgams1V-mY1gd5tPke-vWBOfO2UtdZbzdTxwejYVyhVlXHTvoZAZm9c6SfYSLgZwcZgvQEz-q8fj1HcQgZ7FQjGdabv9rlkNPMhT1A1Ry22g Apr 13 16:53:13 user devstack@n-api.service[62053]: X-Domain-Id: None Apr 13 16:53:13 user devstack@n-api.service[62053]: X-Domain-Name: None Apr 13 16:53:13 user devstack@n-api.service[62053]: X-Identity-Status: Confirmed Apr 13 16:53:13 user devstack@n-api.service[62053]: X-Is-Admin-Project: True Apr 13 16:53:13 user devstack@n-api.service[62053]: X-Project-Domain-Id: default Apr 13 16:53:13 user devstack@n-api.service[62053]: X-Project-Domain-Name: Default Apr 13 16:53:13 user devstack@n-api.service[62053]: X-Project-Id: 846732ecb7e047128b4684972d3cd8c6 Apr 13 16:53:13 user devstack@n-api.service[62053]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-84287455 Apr 13 16:53:13 user devstack@n-api.service[62053]: X-Role: reader,member Apr 13 16:53:13 user devstack@n-api.service[62053]: X-Roles: reader,member Apr 13 16:53:13 user devstack@n-api.service[62053]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/846732ecb7e047128b4684972d3cd8c6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/846732ecb7e047128b4684972d3cd8c6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/846732ecb7e047128b4684972d3cd8c6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 13 16:53:13 user devstack@n-api.service[62053]: X-Tenant: tempest-ServerRescueNegativeTestJSON-84287455 Apr 13 16:53:13 user devstack@n-api.service[62053]: X-Tenant-Id: 846732ecb7e047128b4684972d3cd8c6 Apr 13 16:53:13 user devstack@n-api.service[62053]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-84287455 Apr 13 16:53:13 user devstack@n-api.service[62053]: X-User: tempest-ServerRescueNegativeTestJSON-84287455-project-member Apr 13 16:53:13 user devstack@n-api.service[62053]: X-User-Domain-Id: default Apr 13 16:53:13 user devstack@n-api.service[62053]: X-User-Domain-Name: Default Apr 13 16:53:13 user devstack@n-api.service[62053]: X-User-Id: 0c7f54723c494e05ada117353c0790cb Apr 13 16:53:13 user devstack@n-api.service[62053]: X-User-Name: tempest-ServerRescueNegativeTestJSON-84287455-project-member Apr 13 16:53:13 user devstack@n-api.service[62053]: method: > Apr 13 16:53:13 user devstack@n-api.service[62053]: exception: Cannot 'detach_volume' instance 37a39f40-d239-4716-91bc-3f562906bd1e while it is in vm_state rescued Apr 13 16:53:13 user devstack@n-api.service[62053]: action_args: {'server_id': '37a39f40-d239-4716-91bc-3f562906bd1e', 'id': '80224b51-c622-4586-9f20-796024d9cba0'} Apr 13 16:53:13 user devstack@n-api.service[62053]: {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 16:53:13 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:53:13 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Apr 13 16:53:13 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Apr 13 16:53:13 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 13 16:53:13 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 13 16:53:13 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Apr 13 16:53:13 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Apr 13 16:53:13 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 37a39f40-d239-4716-91bc-3f562906bd1e in vm_state rescued. Cannot detach_volume while the instance is in this state. Apr 13 16:53:13 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:53:13 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:53:13 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:53:13 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:53:13 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 16:53:13 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 16:53:13 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 16:53:13 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 16:53:13 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 16:53:13 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 16:53:13 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Apr 13 16:53:13 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Apr 13 16:53:13 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Apr 13 16:53:13 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Apr 13 16:53:13 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 37a39f40-d239-4716-91bc-3f562906bd1e while it is in vm_state rescued Apr 13 16:53:13 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:53:13 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:53:13 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:53:13 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:53:13 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 16:53:13 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 16:53:13 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 16:53:13 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 16:53:13 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 37a39f40-d239-4716-91bc-3f562906bd1e while it is in vm_state rescued Apr 13 16:53:13 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:53:13 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-59cad00b-ea4b-4e9e-b6ca-b5a8ed8fe1b2 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Returning 409 to user: Cannot 'detach_volume' instance 37a39f40-d239-4716-91bc-3f562906bd1e while it is in vm_state rescued {{(pid=62053) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 16:53:13 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-59cad00b-ea4b-4e9e-b6ca-b5a8ed8fe1b2 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/37a39f40-d239-4716-91bc-3f562906bd1e/os-volume_attachments/80224b51-c622-4586-9f20-796024d9cba0" status: 409 len: 152 microversion: 2.1 time: 0.096954 Apr 13 16:53:13 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 328/980] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 16:53:13 2023] DELETE /compute/v2.1/servers/37a39f40-d239-4716-91bc-3f562906bd1e/os-volume_attachments/80224b51-c622-4586-9f20-796024d9cba0 => generated 152 bytes in 98 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 13 16:53:13 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-e441d8ae-eaec-4bee-a538-3506eaf69806 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:53:13 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-e441d8ae-eaec-4bee-a538-3506eaf69806 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:53:13 user devstack@n-api.service[62054]: INFO oslo.messaging._drivers.impl_rabbit [-] [d5f4f53d-a137-4628-9932-f3f71afa82e2] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 58408. Apr 13 16:53:13 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-e441d8ae-eaec-4bee-a538-3506eaf69806 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:53:13 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-e441d8ae-eaec-4bee-a538-3506eaf69806 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:53:13 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-e441d8ae-eaec-4bee-a538-3506eaf69806 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:53:13 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-e441d8ae-eaec-4bee-a538-3506eaf69806 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:53:13 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-e441d8ae-eaec-4bee-a538-3506eaf69806 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:53:13 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-e441d8ae-eaec-4bee-a538-3506eaf69806 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:53:13 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-e441d8ae-eaec-4bee-a538-3506eaf69806 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] 10.0.0.210 "POST /compute/v2.1/servers/37a39f40-d239-4716-91bc-3f562906bd1e/action" status: 202 len: 0 microversion: 2.1 time: 0.076014 Apr 13 16:53:13 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 328/981] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 16:53:13 2023] POST /compute/v2.1/servers/37a39f40-d239-4716-91bc-3f562906bd1e/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 16:53:13 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-8b0a7b42-186b-44db-8319-99006f66ea8c tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:53:13 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-8b0a7b42-186b-44db-8319-99006f66ea8c tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:53:13 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-8b0a7b42-186b-44db-8319-99006f66ea8c tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:53:13 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-8b0a7b42-186b-44db-8319-99006f66ea8c tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:53:13 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-8b0a7b42-186b-44db-8319-99006f66ea8c tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:53:13 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-8b0a7b42-186b-44db-8319-99006f66ea8c tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:53:13 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-8b0a7b42-186b-44db-8319-99006f66ea8c tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:53:13 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-8b0a7b42-186b-44db-8319-99006f66ea8c tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:53:13 user devstack@n-api.service[62055]: DEBUG nova.policy [None req-8b0a7b42-186b-44db-8319-99006f66ea8c tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c7f54723c494e05ada117353c0790cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '846732ecb7e047128b4684972d3cd8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62055) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:53:13 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-8b0a7b42-186b-44db-8319-99006f66ea8c tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] 10.0.0.210 "GET /compute/v2.1/servers/37a39f40-d239-4716-91bc-3f562906bd1e" status: 200 len: 1711 microversion: 2.1 time: 0.143554 Apr 13 16:53:14 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 326/982] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:53:13 2023] GET /compute/v2.1/servers/37a39f40-d239-4716-91bc-3f562906bd1e => generated 1711 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:53:14 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-ba287e0c-033e-4311-8783-4fe2551b5be6 req-2375e220-d321-4cdf-9a26-0ce8e6441b20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37a39f40-d239-4716-91bc-3f562906bd1e", "name": "network-vif-unplugged", "status": "completed", "tag": "86b0ae4e-a317-4c75-9033-49325a4399d2"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:53:14 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-ba287e0c-033e-4311-8783-4fe2551b5be6 req-2375e220-d321-4cdf-9a26-0ce8e6441b20 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:53:14 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-ba287e0c-033e-4311-8783-4fe2551b5be6 req-2375e220-d321-4cdf-9a26-0ce8e6441b20 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:53:14 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-ba287e0c-033e-4311-8783-4fe2551b5be6 req-2375e220-d321-4cdf-9a26-0ce8e6441b20 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:53:14 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-ba287e0c-033e-4311-8783-4fe2551b5be6 req-2375e220-d321-4cdf-9a26-0ce8e6441b20 service nova] Creating event network-vif-unplugged:86b0ae4e-a317-4c75-9033-49325a4399d2 for instance 37a39f40-d239-4716-91bc-3f562906bd1e on user Apr 13 16:53:14 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [req-ba287e0c-033e-4311-8783-4fe2551b5be6 req-2375e220-d321-4cdf-9a26-0ce8e6441b20 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034796 Apr 13 16:53:14 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 329/983] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:53:14 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:53:16 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-802b3323-cb9c-48d1-a6d3-2497e0daa037 req-2cb53de1-499a-4a57-8b35-f85425890ef0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37a39f40-d239-4716-91bc-3f562906bd1e", "name": "network-vif-plugged", "status": "completed", "tag": "86b0ae4e-a317-4c75-9033-49325a4399d2"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:53:16 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-802b3323-cb9c-48d1-a6d3-2497e0daa037 req-2cb53de1-499a-4a57-8b35-f85425890ef0 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:53:16 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-802b3323-cb9c-48d1-a6d3-2497e0daa037 req-2cb53de1-499a-4a57-8b35-f85425890ef0 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:53:16 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-802b3323-cb9c-48d1-a6d3-2497e0daa037 req-2cb53de1-499a-4a57-8b35-f85425890ef0 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:53:16 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-802b3323-cb9c-48d1-a6d3-2497e0daa037 req-2cb53de1-499a-4a57-8b35-f85425890ef0 service nova] Creating event network-vif-plugged:86b0ae4e-a317-4c75-9033-49325a4399d2 for instance 37a39f40-d239-4716-91bc-3f562906bd1e on user Apr 13 16:53:16 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [req-802b3323-cb9c-48d1-a6d3-2497e0daa037 req-2cb53de1-499a-4a57-8b35-f85425890ef0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030771 Apr 13 16:53:16 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 329/984] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:53:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:53:18 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [req-c43e6d06-af4a-4b48-af92-aacd551a8202 req-383a4921-0e39-44cd-996b-8fa8a8783574 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37a39f40-d239-4716-91bc-3f562906bd1e", "name": "network-vif-plugged", "status": "completed", "tag": "86b0ae4e-a317-4c75-9033-49325a4399d2"}, {"server_uuid": "37a39f40-d239-4716-91bc-3f562906bd1e", "name": "network-vif-plugged", "status": "completed", "tag": "86b0ae4e-a317-4c75-9033-49325a4399d2"}]} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:53:18 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-c43e6d06-af4a-4b48-af92-aacd551a8202 req-383a4921-0e39-44cd-996b-8fa8a8783574 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:53:18 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-c43e6d06-af4a-4b48-af92-aacd551a8202 req-383a4921-0e39-44cd-996b-8fa8a8783574 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:53:18 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-c43e6d06-af4a-4b48-af92-aacd551a8202 req-383a4921-0e39-44cd-996b-8fa8a8783574 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:53:18 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-c43e6d06-af4a-4b48-af92-aacd551a8202 req-383a4921-0e39-44cd-996b-8fa8a8783574 service nova] Creating event network-vif-plugged:86b0ae4e-a317-4c75-9033-49325a4399d2 for instance 37a39f40-d239-4716-91bc-3f562906bd1e on user Apr 13 16:53:18 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-c43e6d06-af4a-4b48-af92-aacd551a8202 req-383a4921-0e39-44cd-996b-8fa8a8783574 service nova] Creating event network-vif-plugged:86b0ae4e-a317-4c75-9033-49325a4399d2 for instance 37a39f40-d239-4716-91bc-3f562906bd1e on user Apr 13 16:53:18 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [req-c43e6d06-af4a-4b48-af92-aacd551a8202 req-383a4921-0e39-44cd-996b-8fa8a8783574 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.034395 Apr 13 16:53:18 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 327/985] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:53:18 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:53:58 user devstack@n-api.service[62053]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 13 16:53:58 user devstack@n-api.service[62053]: Thu Apr 13 16:53:58 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/61c8082e-a4c5-47de-a239-05c10bb4c5ac (ip 10.0.0.210) !!! Apr 13 16:53:58 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_api:SELECT=6 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:53:58 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_cell1:SELECT=10 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:53:58 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-39ac6f54-afdb-4e4a-8893-e16b9118759f tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:53:58 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-39ac6f54-afdb-4e4a-8893-e16b9118759f tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] [instance: 61c8082e-a4c5-47de-a239-05c10bb4c5ac] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:53:58 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-39ac6f54-afdb-4e4a-8893-e16b9118759f tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:53:58 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-39ac6f54-afdb-4e4a-8893-e16b9118759f tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:53:58 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-39ac6f54-afdb-4e4a-8893-e16b9118759f tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:53:58 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-39ac6f54-afdb-4e4a-8893-e16b9118759f tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:53:58 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-39ac6f54-afdb-4e4a-8893-e16b9118759f tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:53:58 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-39ac6f54-afdb-4e4a-8893-e16b9118759f tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:53:58 user devstack@n-api.service[62053]: INFO nova.api.openstack.wsgi [None req-39ac6f54-afdb-4e4a-8893-e16b9118759f tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] HTTP exception thrown: Instance 61c8082e-a4c5-47de-a239-05c10bb4c5ac could not be found. Apr 13 16:53:58 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-39ac6f54-afdb-4e4a-8893-e16b9118759f tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Request method failure captured: Apr 13 16:53:58 user devstack@n-api.service[62053]: request: GET /compute/v2.1/servers/61c8082e-a4c5-47de-a239-05c10bb4c5ac HTTP/1.1 Apr 13 16:53:58 user devstack@n-api.service[62053]: Accept: application/json Apr 13 16:53:58 user devstack@n-api.service[62053]: Accept-Encoding: identity Apr 13 16:53:58 user devstack@n-api.service[62053]: Connection: close Apr 13 16:53:58 user devstack@n-api.service[62053]: Content-Length: 0 Apr 13 16:53:58 user devstack@n-api.service[62053]: Content-Type: application/json Apr 13 16:53:58 user devstack@n-api.service[62053]: Host: 10.0.0.210 Apr 13 16:53:58 user devstack@n-api.service[62053]: Openstack-System-Scope: None Apr 13 16:53:58 user devstack@n-api.service[62053]: User-Agent: python-urllib3/1.26.15 Apr 13 16:53:58 user devstack@n-api.service[62053]: X-Auth-Token: gAAAAABkODJgX0v9K-cYZbP6vb41sGHXNFxcFlxG04TSE13fS7U9uGTqgZ7uGgBaekN_LbRiubvybiUP3DUF12GWGUcbGW9kndN9AF_R6mfFMI94XcW_6sIorn6k04w06tK9bXeZW4OWw6g5PXXgXzNTgYxej3qnRJ4ksG43sdo0eFw1ESb_OpI Apr 13 16:53:58 user devstack@n-api.service[62053]: X-Domain-Id: None Apr 13 16:53:58 user devstack@n-api.service[62053]: X-Domain-Name: None Apr 13 16:53:58 user devstack@n-api.service[62053]: X-Identity-Status: Confirmed Apr 13 16:53:58 user devstack@n-api.service[62053]: X-Is-Admin-Project: True Apr 13 16:53:58 user devstack@n-api.service[62053]: X-Project-Domain-Id: default Apr 13 16:53:58 user devstack@n-api.service[62053]: X-Project-Domain-Name: Default Apr 13 16:53:58 user devstack@n-api.service[62053]: X-Project-Id: d099f58565de44fba2df173a2bdb3019 Apr 13 16:53:58 user devstack@n-api.service[62053]: X-Project-Name: tempest-VolumesActionsTest-450740344 Apr 13 16:53:58 user devstack@n-api.service[62053]: X-Role: reader,member Apr 13 16:53:58 user devstack@n-api.service[62053]: X-Roles: reader,member Apr 13 16:53:58 user devstack@n-api.service[62053]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d099f58565de44fba2df173a2bdb3019"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d099f58565de44fba2df173a2bdb3019"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d099f58565de44fba2df173a2bdb3019"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 13 16:53:58 user devstack@n-api.service[62053]: X-Tenant: tempest-VolumesActionsTest-450740344 Apr 13 16:53:58 user devstack@n-api.service[62053]: X-Tenant-Id: d099f58565de44fba2df173a2bdb3019 Apr 13 16:53:58 user devstack@n-api.service[62053]: X-Tenant-Name: tempest-VolumesActionsTest-450740344 Apr 13 16:53:58 user devstack@n-api.service[62053]: X-User: tempest-VolumesActionsTest-450740344-project-member Apr 13 16:53:58 user devstack@n-api.service[62053]: X-User-Domain-Id: default Apr 13 16:53:58 user devstack@n-api.service[62053]: X-User-Domain-Name: Default Apr 13 16:53:58 user devstack@n-api.service[62053]: X-User-Id: 5051bef91062494f991ee96a93c9dc6a Apr 13 16:53:58 user devstack@n-api.service[62053]: X-User-Name: tempest-VolumesActionsTest-450740344-project-member Apr 13 16:53:58 user devstack@n-api.service[62053]: method: > Apr 13 16:53:58 user devstack@n-api.service[62053]: exception: Instance 61c8082e-a4c5-47de-a239-05c10bb4c5ac could not be found. Apr 13 16:53:58 user devstack@n-api.service[62053]: action_args: {'id': '61c8082e-a4c5-47de-a239-05c10bb4c5ac'} Apr 13 16:53:58 user devstack@n-api.service[62053]: {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 16:53:58 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:53:58 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 16:53:58 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 16:53:58 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 16:53:58 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 16:53:58 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 16:53:58 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 16:53:58 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 16:53:58 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 16:53:58 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61c8082e-a4c5-47de-a239-05c10bb4c5ac could not be found. Apr 13 16:53:58 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:53:58 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:53:58 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:53:58 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:53:58 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 16:53:58 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 16:53:58 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 16:53:58 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 16:53:58 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 16:53:58 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 16:53:58 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 16:53:58 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 16:53:58 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 16:53:58 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 16:53:58 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 16:53:58 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 16:53:58 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61c8082e-a4c5-47de-a239-05c10bb4c5ac could not be found. Apr 13 16:53:58 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:53:58 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:53:58 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:53:58 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:53:58 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 16:53:58 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 16:53:58 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 16:53:58 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 16:53:58 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61c8082e-a4c5-47de-a239-05c10bb4c5ac could not be found. Apr 13 16:53:58 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:53:58 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-39ac6f54-afdb-4e4a-8893-e16b9118759f tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Returning 404 to user: Instance 61c8082e-a4c5-47de-a239-05c10bb4c5ac could not be found. {{(pid=62053) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 16:53:58 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-39ac6f54-afdb-4e4a-8893-e16b9118759f tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] 10.0.0.210 "GET /compute/v2.1/servers/61c8082e-a4c5-47de-a239-05c10bb4c5ac" status: 404 len: 111 microversion: 2.1 time: 0.105706 Apr 13 16:53:58 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 330/986] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:53:58 2023] GET /compute/v2.1/servers/61c8082e-a4c5-47de-a239-05c10bb4c5ac => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 16:54:04 user devstack@n-api.service[62054]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Apr 13 16:54:04 user devstack@n-api.service[62054]: Thu Apr 13 16:54:04 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/37a39f40-d239-4716-91bc-3f562906bd1e (ip 10.0.0.210) !!! Apr 13 16:54:04 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:54:04 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:54:04 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-4ac57a95-4857-4147-8978-2d3ffe9db524 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:54:04 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-4ac57a95-4857-4147-8978-2d3ffe9db524 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:54:04 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-4ac57a95-4857-4147-8978-2d3ffe9db524 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:54:04 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-4ac57a95-4857-4147-8978-2d3ffe9db524 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:54:04 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-4ac57a95-4857-4147-8978-2d3ffe9db524 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:54:04 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-4ac57a95-4857-4147-8978-2d3ffe9db524 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:54:04 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-4ac57a95-4857-4147-8978-2d3ffe9db524 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:54:04 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-4ac57a95-4857-4147-8978-2d3ffe9db524 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:54:04 user devstack@n-api.service[62054]: DEBUG nova.policy [None req-4ac57a95-4857-4147-8978-2d3ffe9db524 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c7f54723c494e05ada117353c0790cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '846732ecb7e047128b4684972d3cd8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62054) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:54:04 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-4ac57a95-4857-4147-8978-2d3ffe9db524 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] 10.0.0.210 "GET /compute/v2.1/servers/37a39f40-d239-4716-91bc-3f562906bd1e" status: 200 len: 1717 microversion: 2.1 time: 0.211990 Apr 13 16:54:04 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 330/987] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:54:04 2023] GET /compute/v2.1/servers/37a39f40-d239-4716-91bc-3f562906bd1e => generated 1717 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:54:53 user devstack@n-api.service[62055]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 13 16:54:53 user devstack@n-api.service[62055]: Thu Apr 13 16:54:53 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.0.0.210) !!! Apr 13 16:54:53 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_api:SELECT=8 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:54:53 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_cell1:SELECT=16 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:54:53 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-554f2ca2-b21a-4fba-91d9-a755c6eb0152 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Action: 'create', calling method: .version_select at 0x7f96dc6c4940>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-810545990", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCJeR98CrX5Pyefe/rcz7c7swHCPLDeP62HQPhZNTY1lR3svV0j4RlALHIf9UrR6zTy6O2Onfsic7sNVnaIU+KNr9U5sJ8q1nmWzQ0dRWeAumpZeD0Chk2QSpA1BLE1qxA=="}} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:54:53 user devstack@n-api.service[62055]: DEBUG nova.quota [None req-554f2ca2-b21a-4fba-91d9-a755c6eb0152 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Getting quotas for project 7edf468527d84954a943bb4c1f7ff54d. Resources: {'key_pairs'} {{(pid=62055) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 16:54:53 user devstack@n-api.service[62055]: DEBUG nova.quota [None req-554f2ca2-b21a-4fba-91d9-a755c6eb0152 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Getting quotas for user 91a450674d7046ae82f5dd182506c85b and project 7edf468527d84954a943bb4c1f7ff54d. Resources: {'key_pairs'} {{(pid=62055) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 16:54:53 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-554f2ca2-b21a-4fba-91d9-a755c6eb0152 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.069046 Apr 13 16:54:53 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 328/988] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 13 16:54:53 2023] POST /compute/v2.1/os-keypairs => generated 402 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:54:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-0adfe3be-b106-4c9a-984c-ecd07fb321c9 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-2141029123", "imageRef": "e81308c1-1e9d-43bf-bd21-d6a7d7856ff1", "flavorRef": "42", "key_name": "tempest-TestMinimumBasicScenario-810545990", "networks": [{"uuid": "0c6a5f46-e53b-4b4c-806e-b2617ba3ef35"}]}} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:54:54 user devstack@n-api.service[62053]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f769d44c-a0ce-4038-a872-8a5b800691cd] AMQP server on 10.0.0.210:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 13 16:54:54 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_api:SELECT=2 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:54:54 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_cell1:SELECT=2 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:54:54 user devstack@n-api.service[62053]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 13 16:54:54 user devstack@n-api.service[62053]: Thu Apr 13 16:54:54 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.0.0.210) !!! Apr 13 16:54:54 user devstack@n-api.service[62053]: DEBUG nova.network.neutron [None req-0adfe3be-b106-4c9a-984c-ecd07fb321c9 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] validate_networks() for [('0c6a5f46-e53b-4b4c-806e-b2617ba3ef35', None, None, None, None, None)] {{(pid=62053) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 16:54:54 user devstack@n-api.service[62053]: DEBUG nova.virt.hardware [None req-0adfe3be-b106-4c9a-984c-ecd07fb321c9 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Flavor limits 0:0:0 {{(pid=62053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 16:54:54 user devstack@n-api.service[62053]: DEBUG nova.virt.hardware [None req-0adfe3be-b106-4c9a-984c-ecd07fb321c9 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Image limits 0:0:0 {{(pid=62053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 16:54:54 user devstack@n-api.service[62053]: DEBUG nova.virt.hardware [None req-0adfe3be-b106-4c9a-984c-ecd07fb321c9 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Flavor pref 0:0:0 {{(pid=62053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 16:54:54 user devstack@n-api.service[62053]: DEBUG nova.virt.hardware [None req-0adfe3be-b106-4c9a-984c-ecd07fb321c9 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Image pref 0:0:0 {{(pid=62053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 16:54:54 user devstack@n-api.service[62053]: DEBUG nova.virt.hardware [None req-0adfe3be-b106-4c9a-984c-ecd07fb321c9 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 16:54:54 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-0adfe3be-b106-4c9a-984c-ecd07fb321c9 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:54:54 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-0adfe3be-b106-4c9a-984c-ecd07fb321c9 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:54:54 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-0adfe3be-b106-4c9a-984c-ecd07fb321c9 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:54:54 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-0adfe3be-b106-4c9a-984c-ecd07fb321c9 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:54:54 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-0adfe3be-b106-4c9a-984c-ecd07fb321c9 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:54:54 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-0adfe3be-b106-4c9a-984c-ecd07fb321c9 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:54:54 user devstack@n-api.service[62053]: DEBUG nova.quota [None req-0adfe3be-b106-4c9a-984c-ecd07fb321c9 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Getting quotas for project 7edf468527d84954a943bb4c1f7ff54d. Resources: {'instances', 'cores', 'ram'} {{(pid=62053) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 16:54:54 user devstack@n-api.service[62053]: DEBUG nova.quota [None req-0adfe3be-b106-4c9a-984c-ecd07fb321c9 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Getting quotas for user 91a450674d7046ae82f5dd182506c85b and project 7edf468527d84954a943bb4c1f7ff54d. Resources: {'instances', 'cores', 'ram'} {{(pid=62053) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 16:54:54 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-0adfe3be-b106-4c9a-984c-ecd07fb321c9 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Going to run 1 instances... {{(pid=62053) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 16:54:54 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-0adfe3be-b106-4c9a-984c-ecd07fb321c9 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e81308c1-1e9d-43bf-bd21-d6a7d7856ff1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=62053) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 16:54:54 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-0adfe3be-b106-4c9a-984c-ecd07fb321c9 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.665124 Apr 13 16:54:54 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 331/989] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 16:54:54 2023] POST /compute/v2.1/servers => generated 378 bytes in 667 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 16:54:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-76cc375f-6182-461e-b4f7-bfff65e38c8b tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:54:54 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-76cc375f-6182-461e-b4f7-bfff65e38c8b tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:54:54 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_api:SELECT=2 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:54:54 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_cell1:SELECT=6 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:54:54 user devstack@n-api.service[62054]: DEBUG nova.policy [None req-76cc375f-6182-461e-b4f7-bfff65e38c8b tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a450674d7046ae82f5dd182506c85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edf468527d84954a943bb4c1f7ff54d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62054) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:54:54 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-76cc375f-6182-461e-b4f7-bfff65e38c8b tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e048d6f6-f6aa-4491-ae06-9e22a8ff6691" status: 200 len: 1252 microversion: 2.1 time: 0.083588 Apr 13 16:54:54 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 331/990] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:54:54 2023] GET /compute/v2.1/servers/e048d6f6-f6aa-4491-ae06-9e22a8ff6691 => generated 1252 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:54:57 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [req-509db3ba-04c9-43be-8fcc-d2ded13dd827 req-16c24618-d49f-4ede-a7b0-63893476e642 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e048d6f6-f6aa-4491-ae06-9e22a8ff6691", "tag": "4fb36f71-2601-4c01-9eba-514f5f2af95f"}]} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:54:57 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-509db3ba-04c9-43be-8fcc-d2ded13dd827 req-16c24618-d49f-4ede-a7b0-63893476e642 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:54:57 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-509db3ba-04c9-43be-8fcc-d2ded13dd827 req-16c24618-d49f-4ede-a7b0-63893476e642 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:54:57 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-509db3ba-04c9-43be-8fcc-d2ded13dd827 req-16c24618-d49f-4ede-a7b0-63893476e642 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:54:57 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-509db3ba-04c9-43be-8fcc-d2ded13dd827 req-16c24618-d49f-4ede-a7b0-63893476e642 service nova] Creating event network-changed:4fb36f71-2601-4c01-9eba-514f5f2af95f for instance e048d6f6-f6aa-4491-ae06-9e22a8ff6691 on user Apr 13 16:54:57 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [req-509db3ba-04c9-43be-8fcc-d2ded13dd827 req-16c24618-d49f-4ede-a7b0-63893476e642 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038448 Apr 13 16:54:57 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 329/991] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:54:57 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:54:59 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-8623803b-b1d5-436e-93c3-76d5640fec66 req-06dd62ab-4977-4c05-b92f-55e8ef53064a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e048d6f6-f6aa-4491-ae06-9e22a8ff6691", "name": "network-vif-plugged", "status": "completed", "tag": "4fb36f71-2601-4c01-9eba-514f5f2af95f"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:54:59 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-8623803b-b1d5-436e-93c3-76d5640fec66 req-06dd62ab-4977-4c05-b92f-55e8ef53064a service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:54:59 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-8623803b-b1d5-436e-93c3-76d5640fec66 req-06dd62ab-4977-4c05-b92f-55e8ef53064a service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:54:59 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-8623803b-b1d5-436e-93c3-76d5640fec66 req-06dd62ab-4977-4c05-b92f-55e8ef53064a service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:54:59 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-8623803b-b1d5-436e-93c3-76d5640fec66 req-06dd62ab-4977-4c05-b92f-55e8ef53064a service nova] Creating event network-vif-plugged:4fb36f71-2601-4c01-9eba-514f5f2af95f for instance e048d6f6-f6aa-4491-ae06-9e22a8ff6691 on user Apr 13 16:54:59 user devstack@n-api.service[62053]: INFO oslo.messaging._drivers.impl_rabbit [-] [f769d44c-a0ce-4038-a872-8a5b800691cd] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 60914. Apr 13 16:54:59 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [req-8623803b-b1d5-436e-93c3-76d5640fec66 req-06dd62ab-4977-4c05-b92f-55e8ef53064a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034708 Apr 13 16:54:59 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 332/992] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:54:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:55:01 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-9c8c93e3-a81a-49a3-9ffc-a768b49622dc req-f1e6695d-336a-427c-b643-4ea8f6b951e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e048d6f6-f6aa-4491-ae06-9e22a8ff6691", "name": "network-vif-plugged", "status": "completed", "tag": "4fb36f71-2601-4c01-9eba-514f5f2af95f"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:55:02 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-9c8c93e3-a81a-49a3-9ffc-a768b49622dc req-f1e6695d-336a-427c-b643-4ea8f6b951e3 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:55:02 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-9c8c93e3-a81a-49a3-9ffc-a768b49622dc req-f1e6695d-336a-427c-b643-4ea8f6b951e3 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:55:02 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-9c8c93e3-a81a-49a3-9ffc-a768b49622dc req-f1e6695d-336a-427c-b643-4ea8f6b951e3 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:55:02 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-9c8c93e3-a81a-49a3-9ffc-a768b49622dc req-f1e6695d-336a-427c-b643-4ea8f6b951e3 service nova] Creating event network-vif-plugged:4fb36f71-2601-4c01-9eba-514f5f2af95f for instance e048d6f6-f6aa-4491-ae06-9e22a8ff6691 on user Apr 13 16:55:02 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [req-9c8c93e3-a81a-49a3-9ffc-a768b49622dc req-f1e6695d-336a-427c-b643-4ea8f6b951e3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.367430 Apr 13 16:55:02 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 332/993] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:55:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:55:04 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-475e4cc9-5e7f-43bf-ae2b-f483925d0315 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:55:04 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-475e4cc9-5e7f-43bf-ae2b-f483925d0315 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:55:04 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_cell0:SELECT=4 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:55:04 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-475e4cc9-5e7f-43bf-ae2b-f483925d0315 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:55:04 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-475e4cc9-5e7f-43bf-ae2b-f483925d0315 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:55:04 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-475e4cc9-5e7f-43bf-ae2b-f483925d0315 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:55:04 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-475e4cc9-5e7f-43bf-ae2b-f483925d0315 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:55:04 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-475e4cc9-5e7f-43bf-ae2b-f483925d0315 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:55:04 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-475e4cc9-5e7f-43bf-ae2b-f483925d0315 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:55:04 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-475e4cc9-5e7f-43bf-ae2b-f483925d0315 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] 10.0.0.210 "GET /compute/v2.1/servers/37a39f40-d239-4716-91bc-3f562906bd1e/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.163323 Apr 13 16:55:04 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 330/994] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 13 16:55:04 2023] GET /compute/v2.1/servers/37a39f40-d239-4716-91bc-3f562906bd1e/os-interface => generated 282 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:55:05 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-a7139ecd-f573-4614-acd8-ebac4dd3b37a req-bfdf55c7-15f9-4175-b058-f4502d5840e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37a39f40-d239-4716-91bc-3f562906bd1e", "tag": "86b0ae4e-a317-4c75-9033-49325a4399d2"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:55:05 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_cell0:SELECT=2 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:55:05 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_cell0:SELECT=6 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:55:05 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-a7139ecd-f573-4614-acd8-ebac4dd3b37a req-bfdf55c7-15f9-4175-b058-f4502d5840e6 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:55:05 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-a7139ecd-f573-4614-acd8-ebac4dd3b37a req-bfdf55c7-15f9-4175-b058-f4502d5840e6 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:55:05 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-a7139ecd-f573-4614-acd8-ebac4dd3b37a req-bfdf55c7-15f9-4175-b058-f4502d5840e6 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:55:05 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-a7139ecd-f573-4614-acd8-ebac4dd3b37a req-bfdf55c7-15f9-4175-b058-f4502d5840e6 service nova] Creating event network-changed:86b0ae4e-a317-4c75-9033-49325a4399d2 for instance 37a39f40-d239-4716-91bc-3f562906bd1e on user Apr 13 16:55:05 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [req-a7139ecd-f573-4614-acd8-ebac4dd3b37a req-bfdf55c7-15f9-4175-b058-f4502d5840e6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040143 Apr 13 16:55:05 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 333/995] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:55:05 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:55:05 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_cell0:SELECT=2 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:55:05 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-e3d8c3af-9798-4be9-9714-370a7e799878 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:55:05 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-e3d8c3af-9798-4be9-9714-370a7e799878 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:55:05 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-e3d8c3af-9798-4be9-9714-370a7e799878 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:55:05 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-e3d8c3af-9798-4be9-9714-370a7e799878 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:55:05 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-e3d8c3af-9798-4be9-9714-370a7e799878 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:55:05 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-e3d8c3af-9798-4be9-9714-370a7e799878 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:55:05 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-e3d8c3af-9798-4be9-9714-370a7e799878 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:55:05 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-e3d8c3af-9798-4be9-9714-370a7e799878 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:55:05 user devstack@n-api.service[62054]: DEBUG nova.objects.instance [None req-e3d8c3af-9798-4be9-9714-370a7e799878 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lazy-loading 'services' on Instance uuid 37a39f40-d239-4716-91bc-3f562906bd1e {{(pid=62054) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 16:55:05 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-e3d8c3af-9798-4be9-9714-370a7e799878 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/37a39f40-d239-4716-91bc-3f562906bd1e/os-volume_attachments/80224b51-c622-4586-9f20-796024d9cba0" status: 202 len: 0 microversion: 2.1 time: 0.187113 Apr 13 16:55:05 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 333/996] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 16:55:05 2023] DELETE /compute/v2.1/servers/37a39f40-d239-4716-91bc-3f562906bd1e/os-volume_attachments/80224b51-c622-4586-9f20-796024d9cba0 => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 16:55:05 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-f111ac21-eac1-4df4-8960-596bb0e5584e tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:55:05 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-f111ac21-eac1-4df4-8960-596bb0e5584e tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:55:05 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-f111ac21-eac1-4df4-8960-596bb0e5584e tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:55:05 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-f111ac21-eac1-4df4-8960-596bb0e5584e tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:55:05 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-f111ac21-eac1-4df4-8960-596bb0e5584e tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:55:05 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-f111ac21-eac1-4df4-8960-596bb0e5584e tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:55:05 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-f111ac21-eac1-4df4-8960-596bb0e5584e tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:55:05 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-f111ac21-eac1-4df4-8960-596bb0e5584e tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:55:05 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-f111ac21-eac1-4df4-8960-596bb0e5584e tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] 10.0.0.210 "GET /compute/v2.1/servers/37a39f40-d239-4716-91bc-3f562906bd1e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068583 Apr 13 16:55:05 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 331/997] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 16:55:05 2023] GET /compute/v2.1/servers/37a39f40-d239-4716-91bc-3f562906bd1e/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:55:07 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-3a997063-0a15-49ef-a54e-38ce83374236 req-08d01888-b6fb-4d83-82fd-8922fa8b41bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37a39f40-d239-4716-91bc-3f562906bd1e", "tag": "86b0ae4e-a317-4c75-9033-49325a4399d2"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:55:07 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-3a997063-0a15-49ef-a54e-38ce83374236 req-08d01888-b6fb-4d83-82fd-8922fa8b41bb service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:55:07 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-3a997063-0a15-49ef-a54e-38ce83374236 req-08d01888-b6fb-4d83-82fd-8922fa8b41bb service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:55:07 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-3a997063-0a15-49ef-a54e-38ce83374236 req-08d01888-b6fb-4d83-82fd-8922fa8b41bb service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:55:07 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-3a997063-0a15-49ef-a54e-38ce83374236 req-08d01888-b6fb-4d83-82fd-8922fa8b41bb service nova] Creating event network-changed:86b0ae4e-a317-4c75-9033-49325a4399d2 for instance 37a39f40-d239-4716-91bc-3f562906bd1e on user Apr 13 16:55:07 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [req-3a997063-0a15-49ef-a54e-38ce83374236 req-08d01888-b6fb-4d83-82fd-8922fa8b41bb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031659 Apr 13 16:55:07 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 334/998] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:55:07 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:55:44 user devstack@n-api.service[62054]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 13 16:55:44 user devstack@n-api.service[62054]: Thu Apr 13 16:55:44 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e048d6f6-f6aa-4491-ae06-9e22a8ff6691 (ip 10.0.0.210) !!! Apr 13 16:55:44 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_api:SELECT=8 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:55:44 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_cell1:SELECT=11,nova_cell1:INSERT=1 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:55:44 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-7a8b9a22-8f81-49b8-b414-381308b4917d tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:55:44 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-7a8b9a22-8f81-49b8-b414-381308b4917d tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:55:44 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-7a8b9a22-8f81-49b8-b414-381308b4917d tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:55:44 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-7a8b9a22-8f81-49b8-b414-381308b4917d tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:55:44 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-7a8b9a22-8f81-49b8-b414-381308b4917d tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:55:44 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-7a8b9a22-8f81-49b8-b414-381308b4917d tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:55:44 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-7a8b9a22-8f81-49b8-b414-381308b4917d tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:55:44 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-7a8b9a22-8f81-49b8-b414-381308b4917d tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:55:45 user devstack@n-api.service[62054]: DEBUG nova.policy [None req-7a8b9a22-8f81-49b8-b414-381308b4917d tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a450674d7046ae82f5dd182506c85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edf468527d84954a943bb4c1f7ff54d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62054) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:55:45 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-7a8b9a22-8f81-49b8-b414-381308b4917d tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e048d6f6-f6aa-4491-ae06-9e22a8ff6691" status: 200 len: 1536 microversion: 2.1 time: 0.225181 Apr 13 16:55:45 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 334/999] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:55:44 2023] GET /compute/v2.1/servers/e048d6f6-f6aa-4491-ae06-9e22a8ff6691 => generated 1536 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:55:55 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-a9636803-ae3e-4625-bc47-318870788963 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:55:55 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-a9636803-ae3e-4625-bc47-318870788963 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:55:55 user devstack@n-api.service[62055]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 13 16:55:55 user devstack@n-api.service[62055]: Thu Apr 13 16:55:55 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/37a39f40-d239-4716-91bc-3f562906bd1e/os-volume_attachments (ip 10.0.0.210) !!! Apr 13 16:55:55 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=1 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:55:55 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_cell1:SELECT=12 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:55:55 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-a9636803-ae3e-4625-bc47-318870788963 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:55:55 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-a9636803-ae3e-4625-bc47-318870788963 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:55:55 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-a9636803-ae3e-4625-bc47-318870788963 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:55:55 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-a9636803-ae3e-4625-bc47-318870788963 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:55:55 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-a9636803-ae3e-4625-bc47-318870788963 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:55:55 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-a9636803-ae3e-4625-bc47-318870788963 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:55:55 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-a9636803-ae3e-4625-bc47-318870788963 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] 10.0.0.210 "GET /compute/v2.1/servers/37a39f40-d239-4716-91bc-3f562906bd1e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.061069 Apr 13 16:55:55 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 332/1000] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 16:55:55 2023] GET /compute/v2.1/servers/37a39f40-d239-4716-91bc-3f562906bd1e/os-volume_attachments => generated 25 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 13 16:55:55 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=3 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:55:55 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_cell1:SELECT=8 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:55:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-78e3608d-9dca-4a6a-b508-8c1a3ac110f0 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:55:55 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-78e3608d-9dca-4a6a-b508-8c1a3ac110f0 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:55:56 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-78e3608d-9dca-4a6a-b508-8c1a3ac110f0 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:55:56 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-78e3608d-9dca-4a6a-b508-8c1a3ac110f0 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:55:56 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-78e3608d-9dca-4a6a-b508-8c1a3ac110f0 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:55:56 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-78e3608d-9dca-4a6a-b508-8c1a3ac110f0 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:55:56 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-78e3608d-9dca-4a6a-b508-8c1a3ac110f0 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:55:56 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-78e3608d-9dca-4a6a-b508-8c1a3ac110f0 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:55:56 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-78e3608d-9dca-4a6a-b508-8c1a3ac110f0 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Going to try to terminate instance {{(pid=62053) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 16:55:56 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-78e3608d-9dca-4a6a-b508-8c1a3ac110f0 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/37a39f40-d239-4716-91bc-3f562906bd1e" status: 204 len: 0 microversion: 2.1 time: 0.137940 Apr 13 16:55:56 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 335/1001] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 16:55:55 2023] DELETE /compute/v2.1/servers/37a39f40-d239-4716-91bc-3f562906bd1e => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 13 16:55:56 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-089fc7a2-0f5d-4f46-86bf-30a1bd24b9a7 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:55:56 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-089fc7a2-0f5d-4f46-86bf-30a1bd24b9a7 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:55:56 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_api:SELECT=2 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:55:56 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_cell1:SELECT=6 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:55:56 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-089fc7a2-0f5d-4f46-86bf-30a1bd24b9a7 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:55:56 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-089fc7a2-0f5d-4f46-86bf-30a1bd24b9a7 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:55:56 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-089fc7a2-0f5d-4f46-86bf-30a1bd24b9a7 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:55:56 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-089fc7a2-0f5d-4f46-86bf-30a1bd24b9a7 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:55:56 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-089fc7a2-0f5d-4f46-86bf-30a1bd24b9a7 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:55:56 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-089fc7a2-0f5d-4f46-86bf-30a1bd24b9a7 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:55:56 user devstack@n-api.service[62054]: DEBUG nova.policy [None req-089fc7a2-0f5d-4f46-86bf-30a1bd24b9a7 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c7f54723c494e05ada117353c0790cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '846732ecb7e047128b4684972d3cd8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62054) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:55:56 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-089fc7a2-0f5d-4f46-86bf-30a1bd24b9a7 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] 10.0.0.210 "GET /compute/v2.1/servers/37a39f40-d239-4716-91bc-3f562906bd1e" status: 200 len: 1677 microversion: 2.1 time: 0.257699 Apr 13 16:55:56 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 335/1002] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:55:56 2023] GET /compute/v2.1/servers/37a39f40-d239-4716-91bc-3f562906bd1e => generated 1677 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:55:56 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [req-7f605fe5-5fc2-4f72-b6c5-2c7d460ec3d1 req-354b7a80-8d0e-4e94-975b-2bdfccb71842 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37a39f40-d239-4716-91bc-3f562906bd1e", "name": "network-vif-unplugged", "status": "completed", "tag": "86b0ae4e-a317-4c75-9033-49325a4399d2"}]} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:55:56 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-7f605fe5-5fc2-4f72-b6c5-2c7d460ec3d1 req-354b7a80-8d0e-4e94-975b-2bdfccb71842 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:55:56 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-7f605fe5-5fc2-4f72-b6c5-2c7d460ec3d1 req-354b7a80-8d0e-4e94-975b-2bdfccb71842 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:55:56 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-7f605fe5-5fc2-4f72-b6c5-2c7d460ec3d1 req-354b7a80-8d0e-4e94-975b-2bdfccb71842 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:55:56 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-7f605fe5-5fc2-4f72-b6c5-2c7d460ec3d1 req-354b7a80-8d0e-4e94-975b-2bdfccb71842 service nova] Creating event network-vif-unplugged:86b0ae4e-a317-4c75-9033-49325a4399d2 for instance 37a39f40-d239-4716-91bc-3f562906bd1e on user Apr 13 16:55:56 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [req-7f605fe5-5fc2-4f72-b6c5-2c7d460ec3d1 req-354b7a80-8d0e-4e94-975b-2bdfccb71842 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034619 Apr 13 16:55:56 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 333/1003] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:55:56 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:55:57 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-9645009c-e9d6-4b42-90fc-9ff785f2e68f req-0f681085-c671-4371-9d9b-151e97ed5f2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37a39f40-d239-4716-91bc-3f562906bd1e", "name": "network-vif-deleted", "tag": "86b0ae4e-a317-4c75-9033-49325a4399d2"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:55:57 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-9645009c-e9d6-4b42-90fc-9ff785f2e68f req-0f681085-c671-4371-9d9b-151e97ed5f2e service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:55:57 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-9645009c-e9d6-4b42-90fc-9ff785f2e68f req-0f681085-c671-4371-9d9b-151e97ed5f2e service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:55:57 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-9645009c-e9d6-4b42-90fc-9ff785f2e68f req-0f681085-c671-4371-9d9b-151e97ed5f2e service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:55:57 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-9645009c-e9d6-4b42-90fc-9ff785f2e68f req-0f681085-c671-4371-9d9b-151e97ed5f2e service nova] Creating event network-vif-deleted:86b0ae4e-a317-4c75-9033-49325a4399d2 for instance 37a39f40-d239-4716-91bc-3f562906bd1e on user Apr 13 16:55:57 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [req-9645009c-e9d6-4b42-90fc-9ff785f2e68f req-0f681085-c671-4371-9d9b-151e97ed5f2e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032649 Apr 13 16:55:57 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 336/1004] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:55:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:55:58 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-34fed33d-33aa-4bf6-aaf8-f23fff2df60e req-50760a1b-949d-4967-9414-386524e9643f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37a39f40-d239-4716-91bc-3f562906bd1e", "name": "network-vif-plugged", "status": "completed", "tag": "86b0ae4e-a317-4c75-9033-49325a4399d2"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:55:58 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-34fed33d-33aa-4bf6-aaf8-f23fff2df60e req-50760a1b-949d-4967-9414-386524e9643f service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:55:58 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-34fed33d-33aa-4bf6-aaf8-f23fff2df60e req-50760a1b-949d-4967-9414-386524e9643f service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:55:58 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-34fed33d-33aa-4bf6-aaf8-f23fff2df60e req-50760a1b-949d-4967-9414-386524e9643f service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:55:58 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-34fed33d-33aa-4bf6-aaf8-f23fff2df60e req-50760a1b-949d-4967-9414-386524e9643f service nova] Creating event network-vif-plugged:86b0ae4e-a317-4c75-9033-49325a4399d2 for instance 37a39f40-d239-4716-91bc-3f562906bd1e on user Apr 13 16:55:58 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [req-34fed33d-33aa-4bf6-aaf8-f23fff2df60e req-50760a1b-949d-4967-9414-386524e9643f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035570 Apr 13 16:55:58 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 336/1005] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:55:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:56:45 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_api:SELECT=4 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:56:45 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_cell1:SELECT=8 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:56:45 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-44b857c2-16cc-4682-9d03-e4baed287f0c tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:56:45 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-44b857c2-16cc-4682-9d03-e4baed287f0c tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:56:45 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-44b857c2-16cc-4682-9d03-e4baed287f0c tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:56:45 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-44b857c2-16cc-4682-9d03-e4baed287f0c tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:56:45 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-44b857c2-16cc-4682-9d03-e4baed287f0c tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:56:45 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-44b857c2-16cc-4682-9d03-e4baed287f0c tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:56:45 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-44b857c2-16cc-4682-9d03-e4baed287f0c tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:56:45 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-44b857c2-16cc-4682-9d03-e4baed287f0c tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:56:45 user devstack@n-api.service[62055]: DEBUG nova.policy [None req-44b857c2-16cc-4682-9d03-e4baed287f0c tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a450674d7046ae82f5dd182506c85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edf468527d84954a943bb4c1f7ff54d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62055) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:56:45 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-44b857c2-16cc-4682-9d03-e4baed287f0c tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e048d6f6-f6aa-4491-ae06-9e22a8ff6691" status: 200 len: 1536 microversion: 2.1 time: 0.321425 Apr 13 16:56:45 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 334/1006] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:56:45 2023] GET /compute/v2.1/servers/e048d6f6-f6aa-4491-ae06-9e22a8ff6691 => generated 1536 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:56:45 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:56:45 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:56:45 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-2ab08934-ab27-4e1a-9a5f-5c310fdc04e2 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:56:45 user devstack@n-api.service[62053]: DEBUG nova.policy [None req-2ab08934-ab27-4e1a-9a5f-5c310fdc04e2 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '91a450674d7046ae82f5dd182506c85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edf468527d84954a943bb4c1f7ff54d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62053) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:56:45 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-2ab08934-ab27-4e1a-9a5f-5c310fdc04e2 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Searching by: {'deleted': False, 'project_id': '7edf468527d84954a943bb4c1f7ff54d'} {{(pid=62053) get_all /opt/stack/nova/nova/compute/api.py:3019}} Apr 13 16:56:45 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-2ab08934-ab27-4e1a-9a5f-5c310fdc04e2 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:56:45 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-2ab08934-ab27-4e1a-9a5f-5c310fdc04e2 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:56:45 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-2ab08934-ab27-4e1a-9a5f-5c310fdc04e2 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:56:45 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-2ab08934-ab27-4e1a-9a5f-5c310fdc04e2 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:56:45 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-2ab08934-ab27-4e1a-9a5f-5c310fdc04e2 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:56:45 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-2ab08934-ab27-4e1a-9a5f-5c310fdc04e2 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:56:45 user devstack@n-api.service[62053]: DEBUG nova.compute.multi_cell_list [None req-2ab08934-ab27-4e1a-9a5f-5c310fdc04e2 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=62053) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 13 16:56:45 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-2ab08934-ab27-4e1a-9a5f-5c310fdc04e2 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.222693 Apr 13 16:56:45 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 337/1007] 10.0.0.210 () {62 vars in 1202 bytes} [Thu Apr 13 16:56:45 2023] GET /compute/v2.1/servers => generated 341 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:56:45 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_api:SELECT=4 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:56:45 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_cell1:SELECT=8 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:56:45 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-36dd6ddd-9f9f-4163-80ef-b566941c5bda tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:56:45 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-36dd6ddd-9f9f-4163-80ef-b566941c5bda tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:56:45 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-36dd6ddd-9f9f-4163-80ef-b566941c5bda tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:56:45 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-36dd6ddd-9f9f-4163-80ef-b566941c5bda tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:56:45 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-36dd6ddd-9f9f-4163-80ef-b566941c5bda tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:56:45 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-36dd6ddd-9f9f-4163-80ef-b566941c5bda tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:56:45 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-36dd6ddd-9f9f-4163-80ef-b566941c5bda tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:56:45 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-36dd6ddd-9f9f-4163-80ef-b566941c5bda tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:56:45 user devstack@n-api.service[62054]: DEBUG nova.policy [None req-36dd6ddd-9f9f-4163-80ef-b566941c5bda tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a450674d7046ae82f5dd182506c85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edf468527d84954a943bb4c1f7ff54d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62054) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:56:45 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-36dd6ddd-9f9f-4163-80ef-b566941c5bda tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e048d6f6-f6aa-4491-ae06-9e22a8ff6691" status: 200 len: 1536 microversion: 2.1 time: 0.176776 Apr 13 16:56:45 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 337/1008] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:56:45 2023] GET /compute/v2.1/servers/e048d6f6-f6aa-4491-ae06-9e22a8ff6691 => generated 1536 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:56:46 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-f59850a6-7aae-4db6-b635-29897cd5dc36 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:56:46 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-f59850a6-7aae-4db6-b635-29897cd5dc36 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:56:46 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-f59850a6-7aae-4db6-b635-29897cd5dc36 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:56:46 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-f59850a6-7aae-4db6-b635-29897cd5dc36 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:56:46 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-f59850a6-7aae-4db6-b635-29897cd5dc36 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:56:46 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-f59850a6-7aae-4db6-b635-29897cd5dc36 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:56:46 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-f59850a6-7aae-4db6-b635-29897cd5dc36 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:56:46 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-f59850a6-7aae-4db6-b635-29897cd5dc36 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:56:46 user devstack@n-api.service[62055]: INFO nova.api.openstack.wsgi [None req-f59850a6-7aae-4db6-b635-29897cd5dc36 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] HTTP exception thrown: Instance 37a39f40-d239-4716-91bc-3f562906bd1e could not be found. Apr 13 16:56:46 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-f59850a6-7aae-4db6-b635-29897cd5dc36 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Request method failure captured: Apr 13 16:56:46 user devstack@n-api.service[62055]: request: GET /compute/v2.1/servers/37a39f40-d239-4716-91bc-3f562906bd1e HTTP/1.1 Apr 13 16:56:46 user devstack@n-api.service[62055]: Accept: application/json Apr 13 16:56:46 user devstack@n-api.service[62055]: Accept-Encoding: identity Apr 13 16:56:46 user devstack@n-api.service[62055]: Connection: close Apr 13 16:56:46 user devstack@n-api.service[62055]: Content-Length: 0 Apr 13 16:56:46 user devstack@n-api.service[62055]: Content-Type: application/json Apr 13 16:56:46 user devstack@n-api.service[62055]: Host: 10.0.0.210 Apr 13 16:56:46 user devstack@n-api.service[62055]: Openstack-System-Scope: None Apr 13 16:56:46 user devstack@n-api.service[62055]: User-Agent: python-urllib3/1.26.15 Apr 13 16:56:46 user devstack@n-api.service[62055]: X-Auth-Token: gAAAAABkODCU3usXoI1IVebJSthBcEDDnDQRiqRW1FYIxzNbUkDIlDU6UteHgRT6XFjSy--lQKRkgams1V-mY1gd5tPke-vWBOfO2UtdZbzdTxwejYVyhVlXHTvoZAZm9c6SfYSLgZwcZgvQEz-q8fj1HcQgZ7FQjGdabv9rlkNPMhT1A1Ry22g Apr 13 16:56:46 user devstack@n-api.service[62055]: X-Domain-Id: None Apr 13 16:56:46 user devstack@n-api.service[62055]: X-Domain-Name: None Apr 13 16:56:46 user devstack@n-api.service[62055]: X-Identity-Status: Confirmed Apr 13 16:56:46 user devstack@n-api.service[62055]: X-Is-Admin-Project: True Apr 13 16:56:46 user devstack@n-api.service[62055]: X-Project-Domain-Id: default Apr 13 16:56:46 user devstack@n-api.service[62055]: X-Project-Domain-Name: Default Apr 13 16:56:46 user devstack@n-api.service[62055]: X-Project-Id: 846732ecb7e047128b4684972d3cd8c6 Apr 13 16:56:46 user devstack@n-api.service[62055]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-84287455 Apr 13 16:56:46 user devstack@n-api.service[62055]: X-Role: reader,member Apr 13 16:56:46 user devstack@n-api.service[62055]: X-Roles: reader,member Apr 13 16:56:46 user devstack@n-api.service[62055]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/846732ecb7e047128b4684972d3cd8c6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/846732ecb7e047128b4684972d3cd8c6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/846732ecb7e047128b4684972d3cd8c6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 13 16:56:46 user devstack@n-api.service[62055]: X-Tenant: tempest-ServerRescueNegativeTestJSON-84287455 Apr 13 16:56:46 user devstack@n-api.service[62055]: X-Tenant-Id: 846732ecb7e047128b4684972d3cd8c6 Apr 13 16:56:46 user devstack@n-api.service[62055]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-84287455 Apr 13 16:56:46 user devstack@n-api.service[62055]: X-User: tempest-ServerRescueNegativeTestJSON-84287455-project-member Apr 13 16:56:46 user devstack@n-api.service[62055]: X-User-Domain-Id: default Apr 13 16:56:46 user devstack@n-api.service[62055]: X-User-Domain-Name: Default Apr 13 16:56:46 user devstack@n-api.service[62055]: X-User-Id: 0c7f54723c494e05ada117353c0790cb Apr 13 16:56:46 user devstack@n-api.service[62055]: X-User-Name: tempest-ServerRescueNegativeTestJSON-84287455-project-member Apr 13 16:56:46 user devstack@n-api.service[62055]: method: > Apr 13 16:56:46 user devstack@n-api.service[62055]: exception: Instance 37a39f40-d239-4716-91bc-3f562906bd1e could not be found. Apr 13 16:56:46 user devstack@n-api.service[62055]: action_args: {'id': '37a39f40-d239-4716-91bc-3f562906bd1e'} Apr 13 16:56:46 user devstack@n-api.service[62055]: {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 16:56:46 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:56:46 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 16:56:46 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 16:56:46 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 16:56:46 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 16:56:46 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 16:56:46 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 16:56:46 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 16:56:46 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 16:56:46 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37a39f40-d239-4716-91bc-3f562906bd1e could not be found. Apr 13 16:56:46 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:56:46 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:56:46 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:56:46 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:56:46 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 16:56:46 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 16:56:46 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 16:56:46 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 16:56:46 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 16:56:46 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 16:56:46 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 16:56:46 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 16:56:46 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 16:56:46 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 16:56:46 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 16:56:46 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 16:56:46 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37a39f40-d239-4716-91bc-3f562906bd1e could not be found. Apr 13 16:56:46 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:56:46 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:56:46 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:56:46 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:56:46 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 16:56:46 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 16:56:46 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 16:56:46 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 16:56:46 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37a39f40-d239-4716-91bc-3f562906bd1e could not be found. Apr 13 16:56:46 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:56:46 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-f59850a6-7aae-4db6-b635-29897cd5dc36 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Returning 404 to user: Instance 37a39f40-d239-4716-91bc-3f562906bd1e could not be found. {{(pid=62055) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 16:56:46 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-f59850a6-7aae-4db6-b635-29897cd5dc36 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] 10.0.0.210 "GET /compute/v2.1/servers/37a39f40-d239-4716-91bc-3f562906bd1e" status: 404 len: 111 microversion: 2.1 time: 0.029257 Apr 13 16:56:46 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 335/1009] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:56:46 2023] GET /compute/v2.1/servers/37a39f40-d239-4716-91bc-3f562906bd1e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 16:56:46 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-2354d0e1-685e-4d67-8e0e-e1cc370cafde tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Calling method '.version_select at 0x7f96e46f81f0>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:56:46 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-2354d0e1-685e-4d67-8e0e-e1cc370cafde tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1684148765" status: 202 len: 0 microversion: 2.1 time: 0.033363 Apr 13 16:56:46 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 338/1010] 10.0.0.210 () {62 vars in 1298 bytes} [Thu Apr 13 16:56:46 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1684148765 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 16:56:48 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-049a4716-fb58-4d23-8331-9f7c36649f42 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "52d252b7-6e23-4733-bf50-80e9ff903f75"}} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:56:48 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-049a4716-fb58-4d23-8331-9f7c36649f42 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:56:48 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-049a4716-fb58-4d23-8331-9f7c36649f42 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:56:48 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-049a4716-fb58-4d23-8331-9f7c36649f42 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:56:48 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-049a4716-fb58-4d23-8331-9f7c36649f42 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:56:48 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-049a4716-fb58-4d23-8331-9f7c36649f42 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:56:48 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-049a4716-fb58-4d23-8331-9f7c36649f42 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:56:48 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-049a4716-fb58-4d23-8331-9f7c36649f42 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:56:48 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-049a4716-fb58-4d23-8331-9f7c36649f42 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] 10.0.0.210 "POST /compute/v2.1/servers/e048d6f6-f6aa-4491-ae06-9e22a8ff6691/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.291830 Apr 13 16:56:48 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 338/1011] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 16:56:48 2023] POST /compute/v2.1/servers/e048d6f6-f6aa-4491-ae06-9e22a8ff6691/os-volume_attachments => generated 194 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:56:51 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-524f1483-ad93-4989-a202-4e2db84ef9f0 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:56:51 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-524f1483-ad93-4989-a202-4e2db84ef9f0 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: 3af23ff8-4e10-4fbf-a86e-bda842f084ff] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:56:51 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-524f1483-ad93-4989-a202-4e2db84ef9f0 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:56:51 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-524f1483-ad93-4989-a202-4e2db84ef9f0 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:56:51 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-524f1483-ad93-4989-a202-4e2db84ef9f0 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:56:51 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-524f1483-ad93-4989-a202-4e2db84ef9f0 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:56:51 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-524f1483-ad93-4989-a202-4e2db84ef9f0 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:56:51 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-524f1483-ad93-4989-a202-4e2db84ef9f0 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:56:51 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-524f1483-ad93-4989-a202-4e2db84ef9f0 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: 3af23ff8-4e10-4fbf-a86e-bda842f084ff] Going to try to terminate instance {{(pid=62055) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 16:56:51 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-524f1483-ad93-4989-a202-4e2db84ef9f0 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3af23ff8-4e10-4fbf-a86e-bda842f084ff" status: 204 len: 0 microversion: 2.1 time: 0.135786 Apr 13 16:56:51 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 336/1012] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 16:56:51 2023] DELETE /compute/v2.1/servers/3af23ff8-4e10-4fbf-a86e-bda842f084ff => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 16:56:51 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-95a356d5-9c82-4876-8981-8160960f24c0 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:56:51 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-95a356d5-9c82-4876-8981-8160960f24c0 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: 3af23ff8-4e10-4fbf-a86e-bda842f084ff] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:56:51 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-95a356d5-9c82-4876-8981-8160960f24c0 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:56:51 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-95a356d5-9c82-4876-8981-8160960f24c0 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:56:51 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-95a356d5-9c82-4876-8981-8160960f24c0 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:56:51 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-95a356d5-9c82-4876-8981-8160960f24c0 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:56:51 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-95a356d5-9c82-4876-8981-8160960f24c0 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:56:51 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-95a356d5-9c82-4876-8981-8160960f24c0 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:56:52 user devstack@n-api.service[62053]: DEBUG nova.policy [None req-95a356d5-9c82-4876-8981-8160960f24c0 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c7f54723c494e05ada117353c0790cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '846732ecb7e047128b4684972d3cd8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62053) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:56:52 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-95a356d5-9c82-4876-8981-8160960f24c0 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3af23ff8-4e10-4fbf-a86e-bda842f084ff" status: 200 len: 1496 microversion: 2.1 time: 0.230772 Apr 13 16:56:52 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 339/1013] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:56:51 2023] GET /compute/v2.1/servers/3af23ff8-4e10-4fbf-a86e-bda842f084ff => generated 1496 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:56:52 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-72ac5136-aa97-4524-b4f0-022a111cbf41 req-663b4ee0-fe3f-4f3f-99fd-bf390cfed868 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3af23ff8-4e10-4fbf-a86e-bda842f084ff", "name": "network-vif-unplugged", "status": "completed", "tag": "b22086e3-8769-494c-af86-228dba7b3638"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:56:52 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-72ac5136-aa97-4524-b4f0-022a111cbf41 req-663b4ee0-fe3f-4f3f-99fd-bf390cfed868 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:56:52 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-72ac5136-aa97-4524-b4f0-022a111cbf41 req-663b4ee0-fe3f-4f3f-99fd-bf390cfed868 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:56:52 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-72ac5136-aa97-4524-b4f0-022a111cbf41 req-663b4ee0-fe3f-4f3f-99fd-bf390cfed868 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:56:52 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-72ac5136-aa97-4524-b4f0-022a111cbf41 req-663b4ee0-fe3f-4f3f-99fd-bf390cfed868 service nova] Creating event network-vif-unplugged:b22086e3-8769-494c-af86-228dba7b3638 for instance 3af23ff8-4e10-4fbf-a86e-bda842f084ff on user Apr 13 16:56:52 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [req-72ac5136-aa97-4524-b4f0-022a111cbf41 req-663b4ee0-fe3f-4f3f-99fd-bf390cfed868 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.108989 Apr 13 16:56:52 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 339/1014] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:56:52 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:56:53 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [req-2c4e6ace-da4b-4e4a-b014-1f23cbf1a83b req-57b1bfbc-9dcf-4750-ba53-e4728fd7caec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3af23ff8-4e10-4fbf-a86e-bda842f084ff", "name": "network-vif-deleted", "tag": "b22086e3-8769-494c-af86-228dba7b3638"}]} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:56:53 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-2c4e6ace-da4b-4e4a-b014-1f23cbf1a83b req-57b1bfbc-9dcf-4750-ba53-e4728fd7caec service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:56:53 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-2c4e6ace-da4b-4e4a-b014-1f23cbf1a83b req-57b1bfbc-9dcf-4750-ba53-e4728fd7caec service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:56:53 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-2c4e6ace-da4b-4e4a-b014-1f23cbf1a83b req-57b1bfbc-9dcf-4750-ba53-e4728fd7caec service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:56:53 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-2c4e6ace-da4b-4e4a-b014-1f23cbf1a83b req-57b1bfbc-9dcf-4750-ba53-e4728fd7caec service nova] Creating event network-vif-deleted:b22086e3-8769-494c-af86-228dba7b3638 for instance 3af23ff8-4e10-4fbf-a86e-bda842f084ff on user Apr 13 16:56:53 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [req-2c4e6ace-da4b-4e4a-b014-1f23cbf1a83b req-57b1bfbc-9dcf-4750-ba53-e4728fd7caec service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086688 Apr 13 16:56:53 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 337/1015] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:56:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:56:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-919a691f-3969-4750-ab25-656897ec229d req-5be7ec1b-f324-4b91-ada9-d1f89b0ae59a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3af23ff8-4e10-4fbf-a86e-bda842f084ff", "name": "network-vif-plugged", "status": "completed", "tag": "b22086e3-8769-494c-af86-228dba7b3638"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:56:54 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-919a691f-3969-4750-ab25-656897ec229d req-5be7ec1b-f324-4b91-ada9-d1f89b0ae59a service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:56:54 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-919a691f-3969-4750-ab25-656897ec229d req-5be7ec1b-f324-4b91-ada9-d1f89b0ae59a service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:56:54 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-919a691f-3969-4750-ab25-656897ec229d req-5be7ec1b-f324-4b91-ada9-d1f89b0ae59a service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:56:54 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-919a691f-3969-4750-ab25-656897ec229d req-5be7ec1b-f324-4b91-ada9-d1f89b0ae59a service nova] Creating event network-vif-plugged:b22086e3-8769-494c-af86-228dba7b3638 for instance 3af23ff8-4e10-4fbf-a86e-bda842f084ff on user Apr 13 16:56:54 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [req-919a691f-3969-4750-ab25-656897ec229d req-5be7ec1b-f324-4b91-ada9-d1f89b0ae59a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034527 Apr 13 16:56:54 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 340/1016] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:56:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:56:57 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-208a565f-5a09-4ce1-8b47-015e3f5ff50f tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:56:57 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-208a565f-5a09-4ce1-8b47-015e3f5ff50f tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:56:57 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-208a565f-5a09-4ce1-8b47-015e3f5ff50f tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:56:57 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-208a565f-5a09-4ce1-8b47-015e3f5ff50f tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:56:57 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-208a565f-5a09-4ce1-8b47-015e3f5ff50f tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:56:57 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-208a565f-5a09-4ce1-8b47-015e3f5ff50f tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:56:57 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-208a565f-5a09-4ce1-8b47-015e3f5ff50f tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:56:57 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-208a565f-5a09-4ce1-8b47-015e3f5ff50f tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:56:58 user devstack@n-api.service[62054]: DEBUG nova.policy [None req-208a565f-5a09-4ce1-8b47-015e3f5ff50f tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a450674d7046ae82f5dd182506c85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edf468527d84954a943bb4c1f7ff54d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62054) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:56:58 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-208a565f-5a09-4ce1-8b47-015e3f5ff50f tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e048d6f6-f6aa-4491-ae06-9e22a8ff6691" status: 200 len: 1582 microversion: 2.1 time: 0.237768 Apr 13 16:56:58 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 340/1017] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:56:57 2023] GET /compute/v2.1/servers/e048d6f6-f6aa-4491-ae06-9e22a8ff6691 => generated 1582 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:56:59 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [req-82cf2eff-323a-4082-8ef0-25b9a865a437 req-0e232cc2-c451-4e10-99ed-7e3130ae6b95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e048d6f6-f6aa-4491-ae06-9e22a8ff6691", "tag": "4fb36f71-2601-4c01-9eba-514f5f2af95f"}]} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:56:59 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-82cf2eff-323a-4082-8ef0-25b9a865a437 req-0e232cc2-c451-4e10-99ed-7e3130ae6b95 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:56:59 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-82cf2eff-323a-4082-8ef0-25b9a865a437 req-0e232cc2-c451-4e10-99ed-7e3130ae6b95 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:56:59 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-82cf2eff-323a-4082-8ef0-25b9a865a437 req-0e232cc2-c451-4e10-99ed-7e3130ae6b95 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:56:59 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-82cf2eff-323a-4082-8ef0-25b9a865a437 req-0e232cc2-c451-4e10-99ed-7e3130ae6b95 service nova] Creating event network-changed:4fb36f71-2601-4c01-9eba-514f5f2af95f for instance e048d6f6-f6aa-4491-ae06-9e22a8ff6691 on user Apr 13 16:56:59 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [req-82cf2eff-323a-4082-8ef0-25b9a865a437 req-0e232cc2-c451-4e10-99ed-7e3130ae6b95 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030102 Apr 13 16:56:59 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 338/1018] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:56:59 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:57:00 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_cell0:SELECT=2 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:57:00 user devstack@n-api.service[62053]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 13 16:57:00 user devstack@n-api.service[62053]: Thu Apr 13 16:57:00 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e048d6f6-f6aa-4491-ae06-9e22a8ff6691/action (ip 10.0.0.210) !!! Apr 13 16:57:00 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-d4b9e1fe-6c3c-40d9-8909-01053c1ae87b tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1429041745"}} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:57:00 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-d4b9e1fe-6c3c-40d9-8909-01053c1ae87b tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:57:00 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-d4b9e1fe-6c3c-40d9-8909-01053c1ae87b tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:57:00 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-d4b9e1fe-6c3c-40d9-8909-01053c1ae87b tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:57:00 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-d4b9e1fe-6c3c-40d9-8909-01053c1ae87b tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:57:00 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-d4b9e1fe-6c3c-40d9-8909-01053c1ae87b tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:57:00 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-d4b9e1fe-6c3c-40d9-8909-01053c1ae87b tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:57:00 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-d4b9e1fe-6c3c-40d9-8909-01053c1ae87b tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:57:01 user devstack@n-api.service[62053]: INFO nova.network.security_group_api [None req-d4b9e1fe-6c3c-40d9-8909-01053c1ae87b tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Adding security group c99d289c-a3b9-4ce7-9eb1-f4b7862146ca to port 4fb36f71-2601-4c01-9eba-514f5f2af95f Apr 13 16:57:01 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-d4b9e1fe-6c3c-40d9-8909-01053c1ae87b tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] 10.0.0.210 "POST /compute/v2.1/servers/e048d6f6-f6aa-4491-ae06-9e22a8ff6691/action" status: 202 len: 0 microversion: 2.1 time: 0.568799 Apr 13 16:57:01 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 341/1019] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 16:57:00 2023] POST /compute/v2.1/servers/e048d6f6-f6aa-4491-ae06-9e22a8ff6691/action => generated 0 bytes in 571 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 16:57:01 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-31193b10-57ef-4bbe-a3e5-01efe508616b tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:57:01 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-31193b10-57ef-4bbe-a3e5-01efe508616b tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:57:01 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [req-6f2a76c8-6056-4432-a185-18a6100e2b5d req-830c9991-9941-4c4a-9e6d-c3e2151cfe31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e048d6f6-f6aa-4491-ae06-9e22a8ff6691", "tag": "4fb36f71-2601-4c01-9eba-514f5f2af95f"}]} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:57:01 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-31193b10-57ef-4bbe-a3e5-01efe508616b tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:57:01 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-31193b10-57ef-4bbe-a3e5-01efe508616b tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:57:01 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-31193b10-57ef-4bbe-a3e5-01efe508616b tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:57:01 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-31193b10-57ef-4bbe-a3e5-01efe508616b tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:57:01 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-31193b10-57ef-4bbe-a3e5-01efe508616b tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:57:01 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-31193b10-57ef-4bbe-a3e5-01efe508616b tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:57:01 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-6f2a76c8-6056-4432-a185-18a6100e2b5d req-830c9991-9941-4c4a-9e6d-c3e2151cfe31 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:57:01 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-6f2a76c8-6056-4432-a185-18a6100e2b5d req-830c9991-9941-4c4a-9e6d-c3e2151cfe31 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:57:01 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-6f2a76c8-6056-4432-a185-18a6100e2b5d req-830c9991-9941-4c4a-9e6d-c3e2151cfe31 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:57:01 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-6f2a76c8-6056-4432-a185-18a6100e2b5d req-830c9991-9941-4c4a-9e6d-c3e2151cfe31 service nova] Creating event network-changed:4fb36f71-2601-4c01-9eba-514f5f2af95f for instance e048d6f6-f6aa-4491-ae06-9e22a8ff6691 on user Apr 13 16:57:01 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [req-6f2a76c8-6056-4432-a185-18a6100e2b5d req-830c9991-9941-4c4a-9e6d-c3e2151cfe31 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051795 Apr 13 16:57:01 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 339/1020] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:57:01 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:57:01 user devstack@n-api.service[62054]: DEBUG nova.policy [None req-31193b10-57ef-4bbe-a3e5-01efe508616b tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a450674d7046ae82f5dd182506c85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edf468527d84954a943bb4c1f7ff54d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62054) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:57:01 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-31193b10-57ef-4bbe-a3e5-01efe508616b tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e048d6f6-f6aa-4491-ae06-9e22a8ff6691" status: 200 len: 1748 microversion: 2.1 time: 0.189477 Apr 13 16:57:01 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 341/1021] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:57:01 2023] GET /compute/v2.1/servers/e048d6f6-f6aa-4491-ae06-9e22a8ff6691 => generated 1748 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:57:04 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-c7285f7e-a7ed-4856-95ba-e4a5cc5f917e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:57:04 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-c7285f7e-a7ed-4856-95ba-e4a5cc5f917e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:57:04 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-c7285f7e-a7ed-4856-95ba-e4a5cc5f917e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:57:04 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-c7285f7e-a7ed-4856-95ba-e4a5cc5f917e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:57:04 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-c7285f7e-a7ed-4856-95ba-e4a5cc5f917e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:57:04 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-c7285f7e-a7ed-4856-95ba-e4a5cc5f917e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:57:04 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-c7285f7e-a7ed-4856-95ba-e4a5cc5f917e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:57:04 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-c7285f7e-a7ed-4856-95ba-e4a5cc5f917e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:57:04 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-c7285f7e-a7ed-4856-95ba-e4a5cc5f917e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] 10.0.0.210 "POST /compute/v2.1/servers/e048d6f6-f6aa-4491-ae06-9e22a8ff6691/action" status: 202 len: 0 microversion: 2.1 time: 0.092015 Apr 13 16:57:04 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 342/1022] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 16:57:04 2023] POST /compute/v2.1/servers/e048d6f6-f6aa-4491-ae06-9e22a8ff6691/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 16:57:04 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-cd223cda-77f9-4c5b-9bc1-e99176d1a691 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:57:04 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-cd223cda-77f9-4c5b-9bc1-e99176d1a691 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:57:04 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-cd223cda-77f9-4c5b-9bc1-e99176d1a691 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:57:04 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-cd223cda-77f9-4c5b-9bc1-e99176d1a691 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:57:04 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-cd223cda-77f9-4c5b-9bc1-e99176d1a691 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:57:04 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-cd223cda-77f9-4c5b-9bc1-e99176d1a691 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:57:04 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-cd223cda-77f9-4c5b-9bc1-e99176d1a691 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:57:04 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-cd223cda-77f9-4c5b-9bc1-e99176d1a691 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:57:04 user devstack@n-api.service[62055]: DEBUG nova.policy [None req-cd223cda-77f9-4c5b-9bc1-e99176d1a691 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a450674d7046ae82f5dd182506c85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edf468527d84954a943bb4c1f7ff54d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62055) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:57:04 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-cd223cda-77f9-4c5b-9bc1-e99176d1a691 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e048d6f6-f6aa-4491-ae06-9e22a8ff6691" status: 200 len: 1750 microversion: 2.1 time: 0.165849 Apr 13 16:57:04 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 340/1023] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:57:04 2023] GET /compute/v2.1/servers/e048d6f6-f6aa-4491-ae06-9e22a8ff6691 => generated 1750 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:57:04 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-789d1c4f-46fb-43c6-99ca-ba743dc2f27f req-baef706f-fb0d-41ce-aa87-eef68d718b56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e048d6f6-f6aa-4491-ae06-9e22a8ff6691", "name": "network-vif-unplugged", "status": "completed", "tag": "4fb36f71-2601-4c01-9eba-514f5f2af95f"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:57:04 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-789d1c4f-46fb-43c6-99ca-ba743dc2f27f req-baef706f-fb0d-41ce-aa87-eef68d718b56 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:57:04 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-789d1c4f-46fb-43c6-99ca-ba743dc2f27f req-baef706f-fb0d-41ce-aa87-eef68d718b56 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:57:04 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-789d1c4f-46fb-43c6-99ca-ba743dc2f27f req-baef706f-fb0d-41ce-aa87-eef68d718b56 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:57:05 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-789d1c4f-46fb-43c6-99ca-ba743dc2f27f req-baef706f-fb0d-41ce-aa87-eef68d718b56 service nova] Creating event network-vif-unplugged:4fb36f71-2601-4c01-9eba-514f5f2af95f for instance e048d6f6-f6aa-4491-ae06-9e22a8ff6691 on user Apr 13 16:57:05 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [req-789d1c4f-46fb-43c6-99ca-ba743dc2f27f req-baef706f-fb0d-41ce-aa87-eef68d718b56 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044031 Apr 13 16:57:05 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 342/1024] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:57:04 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:57:07 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-17358a4c-6f14-4696-9d41-ecd7fe0a941c req-d9c11365-cf14-40f5-8593-007acd671785 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e048d6f6-f6aa-4491-ae06-9e22a8ff6691", "name": "network-vif-plugged", "status": "completed", "tag": "4fb36f71-2601-4c01-9eba-514f5f2af95f"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:57:07 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-17358a4c-6f14-4696-9d41-ecd7fe0a941c req-d9c11365-cf14-40f5-8593-007acd671785 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:57:07 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-17358a4c-6f14-4696-9d41-ecd7fe0a941c req-d9c11365-cf14-40f5-8593-007acd671785 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:57:07 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-17358a4c-6f14-4696-9d41-ecd7fe0a941c req-d9c11365-cf14-40f5-8593-007acd671785 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:57:07 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-17358a4c-6f14-4696-9d41-ecd7fe0a941c req-d9c11365-cf14-40f5-8593-007acd671785 service nova] Creating event network-vif-plugged:4fb36f71-2601-4c01-9eba-514f5f2af95f for instance e048d6f6-f6aa-4491-ae06-9e22a8ff6691 on user Apr 13 16:57:07 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [req-17358a4c-6f14-4696-9d41-ecd7fe0a941c req-d9c11365-cf14-40f5-8593-007acd671785 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039652 Apr 13 16:57:07 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 343/1025] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:57:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:57:09 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [req-b4cf6389-abd9-42dd-b809-991e1713cd27 req-3827ac1a-b6b1-491d-8cbd-f51e3d0ab946 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e048d6f6-f6aa-4491-ae06-9e22a8ff6691", "name": "network-vif-plugged", "status": "completed", "tag": "4fb36f71-2601-4c01-9eba-514f5f2af95f"}]} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:57:09 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-b4cf6389-abd9-42dd-b809-991e1713cd27 req-3827ac1a-b6b1-491d-8cbd-f51e3d0ab946 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:57:09 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-b4cf6389-abd9-42dd-b809-991e1713cd27 req-3827ac1a-b6b1-491d-8cbd-f51e3d0ab946 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:57:09 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-b4cf6389-abd9-42dd-b809-991e1713cd27 req-3827ac1a-b6b1-491d-8cbd-f51e3d0ab946 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:57:09 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-b4cf6389-abd9-42dd-b809-991e1713cd27 req-3827ac1a-b6b1-491d-8cbd-f51e3d0ab946 service nova] Creating event network-vif-plugged:4fb36f71-2601-4c01-9eba-514f5f2af95f for instance e048d6f6-f6aa-4491-ae06-9e22a8ff6691 on user Apr 13 16:57:09 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [req-b4cf6389-abd9-42dd-b809-991e1713cd27 req-3827ac1a-b6b1-491d-8cbd-f51e3d0ab946 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043282 Apr 13 16:57:09 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 341/1026] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:57:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:57:11 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-1a06d75f-0f3a-4968-86c2-661c155492c6 req-abd1ef8f-9bbf-4b17-aa39-fd4f8a9d20a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e048d6f6-f6aa-4491-ae06-9e22a8ff6691", "name": "network-vif-plugged", "status": "completed", "tag": "4fb36f71-2601-4c01-9eba-514f5f2af95f"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:57:11 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-1a06d75f-0f3a-4968-86c2-661c155492c6 req-abd1ef8f-9bbf-4b17-aa39-fd4f8a9d20a5 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:57:11 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-1a06d75f-0f3a-4968-86c2-661c155492c6 req-abd1ef8f-9bbf-4b17-aa39-fd4f8a9d20a5 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:57:11 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-1a06d75f-0f3a-4968-86c2-661c155492c6 req-abd1ef8f-9bbf-4b17-aa39-fd4f8a9d20a5 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:57:11 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-1a06d75f-0f3a-4968-86c2-661c155492c6 req-abd1ef8f-9bbf-4b17-aa39-fd4f8a9d20a5 service nova] Creating event network-vif-plugged:4fb36f71-2601-4c01-9eba-514f5f2af95f for instance e048d6f6-f6aa-4491-ae06-9e22a8ff6691 on user Apr 13 16:57:11 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [req-1a06d75f-0f3a-4968-86c2-661c155492c6 req-abd1ef8f-9bbf-4b17-aa39-fd4f8a9d20a5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032941 Apr 13 16:57:11 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 343/1027] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:57:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:57:42 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_api:SELECT=15,nova_api:DELETE=1 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:57:42 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:57:42 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-0d6f1556-d8f8-4045-b4e8-0d89be9b6c80 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:57:42 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-0d6f1556-d8f8-4045-b4e8-0d89be9b6c80 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: 3af23ff8-4e10-4fbf-a86e-bda842f084ff] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:57:42 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-0d6f1556-d8f8-4045-b4e8-0d89be9b6c80 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:57:42 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-0d6f1556-d8f8-4045-b4e8-0d89be9b6c80 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:57:42 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-0d6f1556-d8f8-4045-b4e8-0d89be9b6c80 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:57:42 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-0d6f1556-d8f8-4045-b4e8-0d89be9b6c80 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:57:42 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-0d6f1556-d8f8-4045-b4e8-0d89be9b6c80 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:57:42 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-0d6f1556-d8f8-4045-b4e8-0d89be9b6c80 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:57:42 user devstack@n-api.service[62053]: INFO nova.api.openstack.wsgi [None req-0d6f1556-d8f8-4045-b4e8-0d89be9b6c80 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] HTTP exception thrown: Instance 3af23ff8-4e10-4fbf-a86e-bda842f084ff could not be found. Apr 13 16:57:42 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-0d6f1556-d8f8-4045-b4e8-0d89be9b6c80 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Request method failure captured: Apr 13 16:57:42 user devstack@n-api.service[62053]: request: GET /compute/v2.1/servers/3af23ff8-4e10-4fbf-a86e-bda842f084ff HTTP/1.1 Apr 13 16:57:42 user devstack@n-api.service[62053]: Accept: application/json Apr 13 16:57:42 user devstack@n-api.service[62053]: Accept-Encoding: identity Apr 13 16:57:42 user devstack@n-api.service[62053]: Connection: close Apr 13 16:57:42 user devstack@n-api.service[62053]: Content-Length: 0 Apr 13 16:57:42 user devstack@n-api.service[62053]: Content-Type: application/json Apr 13 16:57:42 user devstack@n-api.service[62053]: Host: 10.0.0.210 Apr 13 16:57:42 user devstack@n-api.service[62053]: Openstack-System-Scope: None Apr 13 16:57:42 user devstack@n-api.service[62053]: User-Agent: python-urllib3/1.26.15 Apr 13 16:57:42 user devstack@n-api.service[62053]: X-Auth-Token: gAAAAABkODCU3usXoI1IVebJSthBcEDDnDQRiqRW1FYIxzNbUkDIlDU6UteHgRT6XFjSy--lQKRkgams1V-mY1gd5tPke-vWBOfO2UtdZbzdTxwejYVyhVlXHTvoZAZm9c6SfYSLgZwcZgvQEz-q8fj1HcQgZ7FQjGdabv9rlkNPMhT1A1Ry22g Apr 13 16:57:42 user devstack@n-api.service[62053]: X-Domain-Id: None Apr 13 16:57:42 user devstack@n-api.service[62053]: X-Domain-Name: None Apr 13 16:57:42 user devstack@n-api.service[62053]: X-Identity-Status: Confirmed Apr 13 16:57:42 user devstack@n-api.service[62053]: X-Is-Admin-Project: True Apr 13 16:57:42 user devstack@n-api.service[62053]: X-Project-Domain-Id: default Apr 13 16:57:42 user devstack@n-api.service[62053]: X-Project-Domain-Name: Default Apr 13 16:57:42 user devstack@n-api.service[62053]: X-Project-Id: 846732ecb7e047128b4684972d3cd8c6 Apr 13 16:57:42 user devstack@n-api.service[62053]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-84287455 Apr 13 16:57:42 user devstack@n-api.service[62053]: X-Role: reader,member Apr 13 16:57:42 user devstack@n-api.service[62053]: X-Roles: reader,member Apr 13 16:57:42 user devstack@n-api.service[62053]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/846732ecb7e047128b4684972d3cd8c6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/846732ecb7e047128b4684972d3cd8c6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/846732ecb7e047128b4684972d3cd8c6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 13 16:57:42 user devstack@n-api.service[62053]: X-Tenant: tempest-ServerRescueNegativeTestJSON-84287455 Apr 13 16:57:42 user devstack@n-api.service[62053]: X-Tenant-Id: 846732ecb7e047128b4684972d3cd8c6 Apr 13 16:57:42 user devstack@n-api.service[62053]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-84287455 Apr 13 16:57:42 user devstack@n-api.service[62053]: X-User: tempest-ServerRescueNegativeTestJSON-84287455-project-member Apr 13 16:57:42 user devstack@n-api.service[62053]: X-User-Domain-Id: default Apr 13 16:57:42 user devstack@n-api.service[62053]: X-User-Domain-Name: Default Apr 13 16:57:42 user devstack@n-api.service[62053]: X-User-Id: 0c7f54723c494e05ada117353c0790cb Apr 13 16:57:42 user devstack@n-api.service[62053]: X-User-Name: tempest-ServerRescueNegativeTestJSON-84287455-project-member Apr 13 16:57:42 user devstack@n-api.service[62053]: method: > Apr 13 16:57:42 user devstack@n-api.service[62053]: exception: Instance 3af23ff8-4e10-4fbf-a86e-bda842f084ff could not be found. Apr 13 16:57:42 user devstack@n-api.service[62053]: action_args: {'id': '3af23ff8-4e10-4fbf-a86e-bda842f084ff'} Apr 13 16:57:42 user devstack@n-api.service[62053]: {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 16:57:42 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:57:42 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 16:57:42 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 16:57:42 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 16:57:42 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 16:57:42 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 16:57:42 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 16:57:42 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 16:57:42 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 16:57:42 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3af23ff8-4e10-4fbf-a86e-bda842f084ff could not be found. Apr 13 16:57:42 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:57:42 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:57:42 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:57:42 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:57:42 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 16:57:42 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 16:57:42 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 16:57:42 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 16:57:42 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 16:57:42 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 16:57:42 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 16:57:42 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 16:57:42 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 16:57:42 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 16:57:42 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 16:57:42 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 16:57:42 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3af23ff8-4e10-4fbf-a86e-bda842f084ff could not be found. Apr 13 16:57:42 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:57:42 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:57:42 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:57:42 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:57:42 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 16:57:42 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 16:57:42 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 16:57:42 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 16:57:42 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3af23ff8-4e10-4fbf-a86e-bda842f084ff could not be found. Apr 13 16:57:42 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:57:42 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-0d6f1556-d8f8-4045-b4e8-0d89be9b6c80 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Returning 404 to user: Instance 3af23ff8-4e10-4fbf-a86e-bda842f084ff could not be found. {{(pid=62053) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 16:57:42 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-0d6f1556-d8f8-4045-b4e8-0d89be9b6c80 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3af23ff8-4e10-4fbf-a86e-bda842f084ff" status: 404 len: 111 microversion: 2.1 time: 0.137430 Apr 13 16:57:42 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 344/1028] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:57:42 2023] GET /compute/v2.1/servers/3af23ff8-4e10-4fbf-a86e-bda842f084ff => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 16:57:42 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-a91e8543-1c94-4e83-af31-69ae10a983f6 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:57:42 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-a91e8543-1c94-4e83-af31-69ae10a983f6 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:57:42 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:57:42 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:57:42 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-a91e8543-1c94-4e83-af31-69ae10a983f6 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:57:42 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-a91e8543-1c94-4e83-af31-69ae10a983f6 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:57:42 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-a91e8543-1c94-4e83-af31-69ae10a983f6 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:57:42 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-a91e8543-1c94-4e83-af31-69ae10a983f6 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:57:42 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-a91e8543-1c94-4e83-af31-69ae10a983f6 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:57:42 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-a91e8543-1c94-4e83-af31-69ae10a983f6 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:57:42 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-a91e8543-1c94-4e83-af31-69ae10a983f6 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] Going to try to terminate instance {{(pid=62055) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 16:57:42 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-a91e8543-1c94-4e83-af31-69ae10a983f6 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b2d55cdd-c89c-4c59-afe1-49a33225af22" status: 204 len: 0 microversion: 2.1 time: 0.119426 Apr 13 16:57:42 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 342/1029] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 16:57:42 2023] DELETE /compute/v2.1/servers/b2d55cdd-c89c-4c59-afe1-49a33225af22 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 16:57:42 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_api:SELECT=14 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:57:42 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:57:42 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-41b94708-6706-4e8a-9688-2bac5066907b tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:57:42 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-41b94708-6706-4e8a-9688-2bac5066907b tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:57:42 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-41b94708-6706-4e8a-9688-2bac5066907b tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:57:42 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-41b94708-6706-4e8a-9688-2bac5066907b tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:57:42 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-41b94708-6706-4e8a-9688-2bac5066907b tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:57:42 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-41b94708-6706-4e8a-9688-2bac5066907b tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:57:42 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-41b94708-6706-4e8a-9688-2bac5066907b tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:57:42 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-41b94708-6706-4e8a-9688-2bac5066907b tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:57:42 user devstack@n-api.service[62054]: DEBUG nova.policy [None req-41b94708-6706-4e8a-9688-2bac5066907b tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c7f54723c494e05ada117353c0790cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '846732ecb7e047128b4684972d3cd8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62054) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:57:42 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-41b94708-6706-4e8a-9688-2bac5066907b tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b2d55cdd-c89c-4c59-afe1-49a33225af22" status: 200 len: 1510 microversion: 2.1 time: 0.206029 Apr 13 16:57:42 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 344/1030] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:57:42 2023] GET /compute/v2.1/servers/b2d55cdd-c89c-4c59-afe1-49a33225af22 => generated 1510 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:57:42 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-7c4dfd37-4973-4671-838a-f8d268e56e9c req-9c5556d2-1228-4043-91e6-d7496c8fbcc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2d55cdd-c89c-4c59-afe1-49a33225af22", "name": "network-vif-unplugged", "status": "completed", "tag": "31e1957f-9bd1-42ae-a2ac-954b49ca15f1"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:57:42 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-7c4dfd37-4973-4671-838a-f8d268e56e9c req-9c5556d2-1228-4043-91e6-d7496c8fbcc8 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:57:42 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-7c4dfd37-4973-4671-838a-f8d268e56e9c req-9c5556d2-1228-4043-91e6-d7496c8fbcc8 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:57:42 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-7c4dfd37-4973-4671-838a-f8d268e56e9c req-9c5556d2-1228-4043-91e6-d7496c8fbcc8 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:57:42 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-7c4dfd37-4973-4671-838a-f8d268e56e9c req-9c5556d2-1228-4043-91e6-d7496c8fbcc8 service nova] Creating event network-vif-unplugged:31e1957f-9bd1-42ae-a2ac-954b49ca15f1 for instance b2d55cdd-c89c-4c59-afe1-49a33225af22 on user Apr 13 16:57:42 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [req-7c4dfd37-4973-4671-838a-f8d268e56e9c req-9c5556d2-1228-4043-91e6-d7496c8fbcc8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.092159 Apr 13 16:57:42 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 345/1031] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:57:42 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:57:43 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [req-b0b8511a-9df4-406c-8db5-468ea3d06e14 req-35ba8fae-ae10-4f7f-ad9d-d4e2992c51fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2d55cdd-c89c-4c59-afe1-49a33225af22", "name": "network-vif-deleted", "tag": "31e1957f-9bd1-42ae-a2ac-954b49ca15f1"}]} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:57:43 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-b0b8511a-9df4-406c-8db5-468ea3d06e14 req-35ba8fae-ae10-4f7f-ad9d-d4e2992c51fd service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:57:43 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-b0b8511a-9df4-406c-8db5-468ea3d06e14 req-35ba8fae-ae10-4f7f-ad9d-d4e2992c51fd service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:57:43 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-b0b8511a-9df4-406c-8db5-468ea3d06e14 req-35ba8fae-ae10-4f7f-ad9d-d4e2992c51fd service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:57:43 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-b0b8511a-9df4-406c-8db5-468ea3d06e14 req-35ba8fae-ae10-4f7f-ad9d-d4e2992c51fd service nova] Creating event network-vif-deleted:31e1957f-9bd1-42ae-a2ac-954b49ca15f1 for instance b2d55cdd-c89c-4c59-afe1-49a33225af22 on user Apr 13 16:57:43 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [req-b0b8511a-9df4-406c-8db5-468ea3d06e14 req-35ba8fae-ae10-4f7f-ad9d-d4e2992c51fd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034521 Apr 13 16:57:43 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 343/1032] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:57:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:57:44 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-2267bf14-5467-4e72-8b08-12e66f4d436f req-3d0fb384-91a7-4ff9-a904-1ea196e85ac2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2d55cdd-c89c-4c59-afe1-49a33225af22", "name": "network-vif-plugged", "status": "completed", "tag": "31e1957f-9bd1-42ae-a2ac-954b49ca15f1"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:57:44 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-2267bf14-5467-4e72-8b08-12e66f4d436f req-3d0fb384-91a7-4ff9-a904-1ea196e85ac2 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:57:44 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-2267bf14-5467-4e72-8b08-12e66f4d436f req-3d0fb384-91a7-4ff9-a904-1ea196e85ac2 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:57:44 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-2267bf14-5467-4e72-8b08-12e66f4d436f req-3d0fb384-91a7-4ff9-a904-1ea196e85ac2 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:57:44 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-2267bf14-5467-4e72-8b08-12e66f4d436f req-3d0fb384-91a7-4ff9-a904-1ea196e85ac2 service nova] Creating event network-vif-plugged:31e1957f-9bd1-42ae-a2ac-954b49ca15f1 for instance b2d55cdd-c89c-4c59-afe1-49a33225af22 on user Apr 13 16:57:44 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [req-2267bf14-5467-4e72-8b08-12e66f4d436f req-3d0fb384-91a7-4ff9-a904-1ea196e85ac2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030882 Apr 13 16:57:44 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 345/1033] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:57:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:57:54 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_api:SELECT=4 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:57:54 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_cell1:SELECT=4 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:57:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-7638ca4f-f709-4519-a90b-97233f606939 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:57:54 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-7638ca4f-f709-4519-a90b-97233f606939 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:57:54 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-7638ca4f-f709-4519-a90b-97233f606939 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:57:54 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-7638ca4f-f709-4519-a90b-97233f606939 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:57:54 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-7638ca4f-f709-4519-a90b-97233f606939 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:57:54 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-7638ca4f-f709-4519-a90b-97233f606939 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:57:54 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-7638ca4f-f709-4519-a90b-97233f606939 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:57:54 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-7638ca4f-f709-4519-a90b-97233f606939 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:57:54 user devstack@n-api.service[62053]: DEBUG nova.policy [None req-7638ca4f-f709-4519-a90b-97233f606939 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a450674d7046ae82f5dd182506c85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edf468527d84954a943bb4c1f7ff54d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62053) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:57:54 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-7638ca4f-f709-4519-a90b-97233f606939 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e048d6f6-f6aa-4491-ae06-9e22a8ff6691" status: 200 len: 1748 microversion: 2.1 time: 0.562642 Apr 13 16:57:54 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 346/1034] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:57:54 2023] GET /compute/v2.1/servers/e048d6f6-f6aa-4491-ae06-9e22a8ff6691 => generated 1748 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:58:32 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:58:32 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:58:32 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-11fc7d06-3071-47e5-9fb0-86a0c0d87df4 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:58:32 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-11fc7d06-3071-47e5-9fb0-86a0c0d87df4 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:58:32 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-11fc7d06-3071-47e5-9fb0-86a0c0d87df4 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:58:32 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-11fc7d06-3071-47e5-9fb0-86a0c0d87df4 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:58:32 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-11fc7d06-3071-47e5-9fb0-86a0c0d87df4 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:58:32 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-11fc7d06-3071-47e5-9fb0-86a0c0d87df4 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:58:32 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-11fc7d06-3071-47e5-9fb0-86a0c0d87df4 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:58:32 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-11fc7d06-3071-47e5-9fb0-86a0c0d87df4 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:58:32 user devstack@n-api.service[62055]: INFO nova.api.openstack.wsgi [None req-11fc7d06-3071-47e5-9fb0-86a0c0d87df4 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] HTTP exception thrown: Instance b2d55cdd-c89c-4c59-afe1-49a33225af22 could not be found. Apr 13 16:58:32 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-11fc7d06-3071-47e5-9fb0-86a0c0d87df4 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Request method failure captured: Apr 13 16:58:32 user devstack@n-api.service[62055]: request: GET /compute/v2.1/servers/b2d55cdd-c89c-4c59-afe1-49a33225af22 HTTP/1.1 Apr 13 16:58:32 user devstack@n-api.service[62055]: Accept: application/json Apr 13 16:58:32 user devstack@n-api.service[62055]: Accept-Encoding: identity Apr 13 16:58:32 user devstack@n-api.service[62055]: Connection: close Apr 13 16:58:32 user devstack@n-api.service[62055]: Content-Length: 0 Apr 13 16:58:32 user devstack@n-api.service[62055]: Content-Type: application/json Apr 13 16:58:32 user devstack@n-api.service[62055]: Host: 10.0.0.210 Apr 13 16:58:32 user devstack@n-api.service[62055]: Openstack-System-Scope: None Apr 13 16:58:32 user devstack@n-api.service[62055]: User-Agent: python-urllib3/1.26.15 Apr 13 16:58:32 user devstack@n-api.service[62055]: X-Auth-Token: gAAAAABkODCU3usXoI1IVebJSthBcEDDnDQRiqRW1FYIxzNbUkDIlDU6UteHgRT6XFjSy--lQKRkgams1V-mY1gd5tPke-vWBOfO2UtdZbzdTxwejYVyhVlXHTvoZAZm9c6SfYSLgZwcZgvQEz-q8fj1HcQgZ7FQjGdabv9rlkNPMhT1A1Ry22g Apr 13 16:58:32 user devstack@n-api.service[62055]: X-Domain-Id: None Apr 13 16:58:32 user devstack@n-api.service[62055]: X-Domain-Name: None Apr 13 16:58:32 user devstack@n-api.service[62055]: X-Identity-Status: Confirmed Apr 13 16:58:32 user devstack@n-api.service[62055]: X-Is-Admin-Project: True Apr 13 16:58:32 user devstack@n-api.service[62055]: X-Project-Domain-Id: default Apr 13 16:58:32 user devstack@n-api.service[62055]: X-Project-Domain-Name: Default Apr 13 16:58:32 user devstack@n-api.service[62055]: X-Project-Id: 846732ecb7e047128b4684972d3cd8c6 Apr 13 16:58:32 user devstack@n-api.service[62055]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-84287455 Apr 13 16:58:32 user devstack@n-api.service[62055]: X-Role: reader,member Apr 13 16:58:32 user devstack@n-api.service[62055]: X-Roles: reader,member Apr 13 16:58:32 user devstack@n-api.service[62055]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/846732ecb7e047128b4684972d3cd8c6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/846732ecb7e047128b4684972d3cd8c6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/846732ecb7e047128b4684972d3cd8c6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 13 16:58:32 user devstack@n-api.service[62055]: X-Tenant: tempest-ServerRescueNegativeTestJSON-84287455 Apr 13 16:58:32 user devstack@n-api.service[62055]: X-Tenant-Id: 846732ecb7e047128b4684972d3cd8c6 Apr 13 16:58:32 user devstack@n-api.service[62055]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-84287455 Apr 13 16:58:32 user devstack@n-api.service[62055]: X-User: tempest-ServerRescueNegativeTestJSON-84287455-project-member Apr 13 16:58:32 user devstack@n-api.service[62055]: X-User-Domain-Id: default Apr 13 16:58:32 user devstack@n-api.service[62055]: X-User-Domain-Name: Default Apr 13 16:58:32 user devstack@n-api.service[62055]: X-User-Id: 0c7f54723c494e05ada117353c0790cb Apr 13 16:58:32 user devstack@n-api.service[62055]: X-User-Name: tempest-ServerRescueNegativeTestJSON-84287455-project-member Apr 13 16:58:32 user devstack@n-api.service[62055]: method: > Apr 13 16:58:32 user devstack@n-api.service[62055]: exception: Instance b2d55cdd-c89c-4c59-afe1-49a33225af22 could not be found. Apr 13 16:58:32 user devstack@n-api.service[62055]: action_args: {'id': 'b2d55cdd-c89c-4c59-afe1-49a33225af22'} Apr 13 16:58:32 user devstack@n-api.service[62055]: {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 16:58:32 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:58:32 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 16:58:32 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 16:58:32 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 16:58:32 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 16:58:32 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 16:58:32 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 16:58:32 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 16:58:32 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 16:58:32 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2d55cdd-c89c-4c59-afe1-49a33225af22 could not be found. Apr 13 16:58:32 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:58:32 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:58:32 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:58:32 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:58:32 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 16:58:32 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 16:58:32 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 16:58:32 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 16:58:32 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 16:58:32 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 16:58:32 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 16:58:32 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 16:58:32 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 16:58:32 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 16:58:32 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 16:58:32 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 16:58:32 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2d55cdd-c89c-4c59-afe1-49a33225af22 could not be found. Apr 13 16:58:32 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:58:32 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:58:32 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:58:32 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:58:32 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 16:58:32 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 16:58:32 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 16:58:32 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 16:58:32 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2d55cdd-c89c-4c59-afe1-49a33225af22 could not be found. Apr 13 16:58:32 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 16:58:32 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-11fc7d06-3071-47e5-9fb0-86a0c0d87df4 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Returning 404 to user: Instance b2d55cdd-c89c-4c59-afe1-49a33225af22 could not be found. {{(pid=62055) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 16:58:32 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-11fc7d06-3071-47e5-9fb0-86a0c0d87df4 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b2d55cdd-c89c-4c59-afe1-49a33225af22" status: 404 len: 111 microversion: 2.1 time: 0.037802 Apr 13 16:58:32 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 344/1035] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:58:32 2023] GET /compute/v2.1/servers/b2d55cdd-c89c-4c59-afe1-49a33225af22 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 16:58:43 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_api:SELECT=4 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:58:43 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_cell1:SELECT=8 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:58:44 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-ef694cb4-0198-4626-8ffd-f5340a2e03d8 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Action: 'create', calling method: .version_select at 0x7f96e4849cf0>, body: {"keypair": {"name": "tempest-keypair-812505684", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDxnreQ3oNJolzetbWWAWXzlquIXNhkVGKnwbC0EAq0bWPFtp/dD5+5IVTDgaPUae2PSPpek/Lb6EaNCplv8swLuJDV95U7xYBvyFjedyTNKkhRNn1viozORpvkUgnZNmw=="}} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:58:44 user devstack@n-api.service[62054]: DEBUG nova.quota [None req-ef694cb4-0198-4626-8ffd-f5340a2e03d8 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Getting quotas for project 097b15faad8249c9bf45623d0c3ab518. Resources: {'key_pairs'} {{(pid=62054) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 16:58:44 user devstack@n-api.service[62054]: DEBUG nova.quota [None req-ef694cb4-0198-4626-8ffd-f5340a2e03d8 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Getting quotas for user a08b0caad23045c1822cdd0b3ae0769f and project 097b15faad8249c9bf45623d0c3ab518. Resources: {'key_pairs'} {{(pid=62054) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 16:58:44 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-ef694cb4-0198-4626-8ffd-f5340a2e03d8 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.165246 Apr 13 16:58:44 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 346/1036] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 13 16:58:43 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:58:45 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-92aff2a1-0565-4b49-8875-ec3d159ce5a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-927136914", "imageRef": "708622a9-7465-4492-ade8-b827198f7e30", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "436011a9-c48b-4f33-a576-a245b344dd72"}], "security_groups": [{"name": "tempest-securitygroup--329589174"}], "key_name": "tempest-keypair-812505684", "user_data": "}} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:58:45 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_api:SELECT=2 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:58:45 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_cell1:SELECT=6 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:58:45 user devstack@n-api.service[62053]: DEBUG nova.network.neutron [None req-92aff2a1-0565-4b49-8875-ec3d159ce5a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] validate_networks() for [('436011a9-c48b-4f33-a576-a245b344dd72', None, None, None, None, None)] {{(pid=62053) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 16:58:45 user devstack@n-api.service[62053]: DEBUG nova.virt.hardware [None req-92aff2a1-0565-4b49-8875-ec3d159ce5a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Flavor limits 0:0:0 {{(pid=62053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 16:58:45 user devstack@n-api.service[62053]: DEBUG nova.virt.hardware [None req-92aff2a1-0565-4b49-8875-ec3d159ce5a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Image limits 0:0:0 {{(pid=62053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 16:58:45 user devstack@n-api.service[62053]: DEBUG nova.virt.hardware [None req-92aff2a1-0565-4b49-8875-ec3d159ce5a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Flavor pref 0:0:0 {{(pid=62053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 16:58:45 user devstack@n-api.service[62053]: DEBUG nova.virt.hardware [None req-92aff2a1-0565-4b49-8875-ec3d159ce5a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Image pref 0:0:0 {{(pid=62053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 16:58:45 user devstack@n-api.service[62053]: DEBUG nova.virt.hardware [None req-92aff2a1-0565-4b49-8875-ec3d159ce5a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62053) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 16:58:45 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-92aff2a1-0565-4b49-8875-ec3d159ce5a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:58:45 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-92aff2a1-0565-4b49-8875-ec3d159ce5a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:58:45 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-92aff2a1-0565-4b49-8875-ec3d159ce5a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:58:45 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-92aff2a1-0565-4b49-8875-ec3d159ce5a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:58:45 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-92aff2a1-0565-4b49-8875-ec3d159ce5a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:58:45 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-92aff2a1-0565-4b49-8875-ec3d159ce5a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:58:46 user devstack@n-api.service[62053]: DEBUG nova.quota [None req-92aff2a1-0565-4b49-8875-ec3d159ce5a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Getting quotas for project 097b15faad8249c9bf45623d0c3ab518. Resources: {'instances', 'cores', 'ram'} {{(pid=62053) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 16:58:46 user devstack@n-api.service[62053]: DEBUG nova.quota [None req-92aff2a1-0565-4b49-8875-ec3d159ce5a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Getting quotas for user a08b0caad23045c1822cdd0b3ae0769f and project 097b15faad8249c9bf45623d0c3ab518. Resources: {'instances', 'cores', 'ram'} {{(pid=62053) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 16:58:46 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-92aff2a1-0565-4b49-8875-ec3d159ce5a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Going to run 1 instances... {{(pid=62053) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 16:58:46 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-92aff2a1-0565-4b49-8875-ec3d159ce5a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='708622a9-7465-4492-ade8-b827198f7e30',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=62053) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 16:58:46 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-92aff2a1-0565-4b49-8875-ec3d159ce5a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 0.594089 Apr 13 16:58:46 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 347/1037] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 16:58:45 2023] POST /compute/v2.1/servers => generated 399 bytes in 596 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 16:58:46 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-f49d80f7-2374-4e5c-8125-4a98696287ce tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:58:46 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-f49d80f7-2374-4e5c-8125-4a98696287ce tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:58:46 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_api:SELECT=2 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:58:46 user devstack@n-api.service[62055]: DEBUG nova.policy [None req-f49d80f7-2374-4e5c-8125-4a98696287ce tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a08b0caad23045c1822cdd0b3ae0769f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097b15faad8249c9bf45623d0c3ab518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62055) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:58:46 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-f49d80f7-2374-4e5c-8125-4a98696287ce tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c" status: 200 len: 1234 microversion: 2.1 time: 0.073646 Apr 13 16:58:46 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 345/1038] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:58:46 2023] GET /compute/v2.1/servers/b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c => generated 1234 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:58:48 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-f20d19be-1052-4af8-93eb-3586f98f5201 req-9703e1fd-9f57-44cf-a2d3-4f02851a1053 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c", "tag": "70f91af6-4a58-4b9d-a132-93537d398c24"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:58:48 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-f20d19be-1052-4af8-93eb-3586f98f5201 req-9703e1fd-9f57-44cf-a2d3-4f02851a1053 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:58:48 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-f20d19be-1052-4af8-93eb-3586f98f5201 req-9703e1fd-9f57-44cf-a2d3-4f02851a1053 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:58:48 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-f20d19be-1052-4af8-93eb-3586f98f5201 req-9703e1fd-9f57-44cf-a2d3-4f02851a1053 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:58:48 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-f20d19be-1052-4af8-93eb-3586f98f5201 req-9703e1fd-9f57-44cf-a2d3-4f02851a1053 service nova] Creating event network-changed:70f91af6-4a58-4b9d-a132-93537d398c24 for instance b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c on user Apr 13 16:58:48 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [req-f20d19be-1052-4af8-93eb-3586f98f5201 req-9703e1fd-9f57-44cf-a2d3-4f02851a1053 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032149 Apr 13 16:58:48 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 347/1039] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:58:48 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:58:50 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-dad4a201-6a36-4ad2-84c9-d14a013e64da req-e90eabc8-3637-4b23-ad35-ef99d0ebe5eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c", "name": "network-vif-plugged", "status": "completed", "tag": "70f91af6-4a58-4b9d-a132-93537d398c24"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:58:50 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-dad4a201-6a36-4ad2-84c9-d14a013e64da req-e90eabc8-3637-4b23-ad35-ef99d0ebe5eb service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:58:50 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-dad4a201-6a36-4ad2-84c9-d14a013e64da req-e90eabc8-3637-4b23-ad35-ef99d0ebe5eb service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:58:50 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-dad4a201-6a36-4ad2-84c9-d14a013e64da req-e90eabc8-3637-4b23-ad35-ef99d0ebe5eb service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:58:50 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-dad4a201-6a36-4ad2-84c9-d14a013e64da req-e90eabc8-3637-4b23-ad35-ef99d0ebe5eb service nova] Creating event network-vif-plugged:70f91af6-4a58-4b9d-a132-93537d398c24 for instance b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c on user Apr 13 16:58:50 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [req-dad4a201-6a36-4ad2-84c9-d14a013e64da req-e90eabc8-3637-4b23-ad35-ef99d0ebe5eb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031358 Apr 13 16:58:50 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 348/1040] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:58:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:58:52 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [req-6acb532d-910e-4c2e-b1ae-211c984998fd req-f166570e-5cd6-46eb-87ef-9e1de797ade0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c", "name": "network-vif-plugged", "status": "completed", "tag": "70f91af6-4a58-4b9d-a132-93537d398c24"}]} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:58:52 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-6acb532d-910e-4c2e-b1ae-211c984998fd req-f166570e-5cd6-46eb-87ef-9e1de797ade0 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:58:52 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-6acb532d-910e-4c2e-b1ae-211c984998fd req-f166570e-5cd6-46eb-87ef-9e1de797ade0 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:58:52 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-6acb532d-910e-4c2e-b1ae-211c984998fd req-f166570e-5cd6-46eb-87ef-9e1de797ade0 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:58:52 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-6acb532d-910e-4c2e-b1ae-211c984998fd req-f166570e-5cd6-46eb-87ef-9e1de797ade0 service nova] Creating event network-vif-plugged:70f91af6-4a58-4b9d-a132-93537d398c24 for instance b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c on user Apr 13 16:58:52 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [req-6acb532d-910e-4c2e-b1ae-211c984998fd req-f166570e-5cd6-46eb-87ef-9e1de797ade0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030352 Apr 13 16:58:52 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 346/1041] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:58:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:58:55 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_cell0:SELECT=4 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:58:55 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-b73166db-1fd1-4adb-84f8-039bb087f2d7 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1429041745"}} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:58:55 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-b73166db-1fd1-4adb-84f8-039bb087f2d7 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:58:55 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-b73166db-1fd1-4adb-84f8-039bb087f2d7 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:58:55 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-b73166db-1fd1-4adb-84f8-039bb087f2d7 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:58:55 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-b73166db-1fd1-4adb-84f8-039bb087f2d7 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:58:55 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-b73166db-1fd1-4adb-84f8-039bb087f2d7 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:58:55 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-b73166db-1fd1-4adb-84f8-039bb087f2d7 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:58:55 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-b73166db-1fd1-4adb-84f8-039bb087f2d7 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:58:55 user devstack@n-api.service[62054]: INFO nova.network.security_group_api [None req-b73166db-1fd1-4adb-84f8-039bb087f2d7 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Removing security group c99d289c-a3b9-4ce7-9eb1-f4b7862146ca from port 4fb36f71-2601-4c01-9eba-514f5f2af95f Apr 13 16:58:55 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-b73166db-1fd1-4adb-84f8-039bb087f2d7 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] 10.0.0.210 "POST /compute/v2.1/servers/e048d6f6-f6aa-4491-ae06-9e22a8ff6691/action" status: 202 len: 0 microversion: 2.1 time: 0.689864 Apr 13 16:58:55 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 348/1042] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 16:58:55 2023] POST /compute/v2.1/servers/e048d6f6-f6aa-4491-ae06-9e22a8ff6691/action => generated 0 bytes in 692 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 16:58:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-80b16901-6597-41e9-a4e1-17a623138cd2 req-d3c5f340-c3fc-4fc1-b29c-9f0f6ff38d26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e048d6f6-f6aa-4491-ae06-9e22a8ff6691", "tag": "4fb36f71-2601-4c01-9eba-514f5f2af95f"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:58:55 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-80b16901-6597-41e9-a4e1-17a623138cd2 req-d3c5f340-c3fc-4fc1-b29c-9f0f6ff38d26 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:58:55 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-80b16901-6597-41e9-a4e1-17a623138cd2 req-d3c5f340-c3fc-4fc1-b29c-9f0f6ff38d26 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:58:55 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-80b16901-6597-41e9-a4e1-17a623138cd2 req-d3c5f340-c3fc-4fc1-b29c-9f0f6ff38d26 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:58:55 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-80b16901-6597-41e9-a4e1-17a623138cd2 req-d3c5f340-c3fc-4fc1-b29c-9f0f6ff38d26 service nova] Creating event network-changed:4fb36f71-2601-4c01-9eba-514f5f2af95f for instance e048d6f6-f6aa-4491-ae06-9e22a8ff6691 on user Apr 13 16:58:55 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [req-80b16901-6597-41e9-a4e1-17a623138cd2 req-d3c5f340-c3fc-4fc1-b29c-9f0f6ff38d26 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030810 Apr 13 16:58:55 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 349/1043] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:58:55 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:58:56 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_cell0:SELECT=2 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:58:56 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [req-182d68d2-c23b-4b7b-94b0-a4fdce3b3c33 req-d7a1a027-9ace-41b3-a467-fafafd8a7771 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e048d6f6-f6aa-4491-ae06-9e22a8ff6691", "tag": "4fb36f71-2601-4c01-9eba-514f5f2af95f"}]} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:58:56 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-182d68d2-c23b-4b7b-94b0-a4fdce3b3c33 req-d7a1a027-9ace-41b3-a467-fafafd8a7771 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:58:56 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-182d68d2-c23b-4b7b-94b0-a4fdce3b3c33 req-d7a1a027-9ace-41b3-a467-fafafd8a7771 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:58:56 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-182d68d2-c23b-4b7b-94b0-a4fdce3b3c33 req-d7a1a027-9ace-41b3-a467-fafafd8a7771 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:58:56 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-182d68d2-c23b-4b7b-94b0-a4fdce3b3c33 req-d7a1a027-9ace-41b3-a467-fafafd8a7771 service nova] Creating event network-changed:4fb36f71-2601-4c01-9eba-514f5f2af95f for instance e048d6f6-f6aa-4491-ae06-9e22a8ff6691 on user Apr 13 16:58:56 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [req-182d68d2-c23b-4b7b-94b0-a4fdce3b3c33 req-d7a1a027-9ace-41b3-a467-fafafd8a7771 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034475 Apr 13 16:58:56 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 347/1044] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:58:56 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:58:56 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-d150fc3c-a03c-492a-bb6c-7b73009adf5b tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:58:56 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-d150fc3c-a03c-492a-bb6c-7b73009adf5b tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:58:56 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-d150fc3c-a03c-492a-bb6c-7b73009adf5b tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:58:56 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-d150fc3c-a03c-492a-bb6c-7b73009adf5b tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:58:56 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-d150fc3c-a03c-492a-bb6c-7b73009adf5b tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:58:56 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-d150fc3c-a03c-492a-bb6c-7b73009adf5b tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:58:56 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-d150fc3c-a03c-492a-bb6c-7b73009adf5b tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:58:56 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-d150fc3c-a03c-492a-bb6c-7b73009adf5b tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:58:57 user devstack@n-api.service[62054]: DEBUG nova.objects.instance [None req-d150fc3c-a03c-492a-bb6c-7b73009adf5b tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lazy-loading 'services' on Instance uuid e048d6f6-f6aa-4491-ae06-9e22a8ff6691 {{(pid=62054) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 16:58:57 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-d150fc3c-a03c-492a-bb6c-7b73009adf5b tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e048d6f6-f6aa-4491-ae06-9e22a8ff6691/os-volume_attachments/52d252b7-6e23-4733-bf50-80e9ff903f75" status: 202 len: 0 microversion: 2.1 time: 0.186409 Apr 13 16:58:57 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 349/1045] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 16:58:56 2023] DELETE /compute/v2.1/servers/e048d6f6-f6aa-4491-ae06-9e22a8ff6691/os-volume_attachments/52d252b7-6e23-4733-bf50-80e9ff903f75 => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 16:58:57 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_cell0:SELECT=2 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:58:57 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_cell0:SELECT=6 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:58:57 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-20594ac0-9163-4e7f-b7af-83602d59a108 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:58:57 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-20594ac0-9163-4e7f-b7af-83602d59a108 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:58:57 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-20594ac0-9163-4e7f-b7af-83602d59a108 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:58:57 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-20594ac0-9163-4e7f-b7af-83602d59a108 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:58:57 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-20594ac0-9163-4e7f-b7af-83602d59a108 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:58:57 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-20594ac0-9163-4e7f-b7af-83602d59a108 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:58:57 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-20594ac0-9163-4e7f-b7af-83602d59a108 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:58:57 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-20594ac0-9163-4e7f-b7af-83602d59a108 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:58:57 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-20594ac0-9163-4e7f-b7af-83602d59a108 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e048d6f6-f6aa-4491-ae06-9e22a8ff6691/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053756 Apr 13 16:58:57 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 350/1046] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 16:58:57 2023] GET /compute/v2.1/servers/e048d6f6-f6aa-4491-ae06-9e22a8ff6691/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:59:36 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_api:SELECT=8 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:59:36 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_cell1:SELECT=6 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:59:36 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-863befdb-ead6-4389-ae42-41982636cb6e tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:59:36 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-863befdb-ead6-4389-ae42-41982636cb6e tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:59:36 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-863befdb-ead6-4389-ae42-41982636cb6e tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:59:36 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-863befdb-ead6-4389-ae42-41982636cb6e tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:59:36 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-863befdb-ead6-4389-ae42-41982636cb6e tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:59:36 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-863befdb-ead6-4389-ae42-41982636cb6e tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:59:36 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-863befdb-ead6-4389-ae42-41982636cb6e tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:59:36 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-863befdb-ead6-4389-ae42-41982636cb6e tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:59:36 user devstack@n-api.service[62055]: DEBUG nova.policy [None req-863befdb-ead6-4389-ae42-41982636cb6e tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a08b0caad23045c1822cdd0b3ae0769f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097b15faad8249c9bf45623d0c3ab518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62055) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:59:36 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-863befdb-ead6-4389-ae42-41982636cb6e tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c" status: 200 len: 1542 microversion: 2.1 time: 0.215851 Apr 13 16:59:36 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 348/1047] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:59:36 2023] GET /compute/v2.1/servers/b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c => generated 1542 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:59:47 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=1 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:59:47 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_cell1:SELECT=15,nova_cell1:INSERT=1 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:59:47 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-5992d248-3dcf-431c-94f3-c4bb2b7a6004 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:59:47 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-5992d248-3dcf-431c-94f3-c4bb2b7a6004 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:59:47 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-5992d248-3dcf-431c-94f3-c4bb2b7a6004 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:59:47 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-5992d248-3dcf-431c-94f3-c4bb2b7a6004 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:59:47 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-5992d248-3dcf-431c-94f3-c4bb2b7a6004 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:59:47 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-5992d248-3dcf-431c-94f3-c4bb2b7a6004 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:59:47 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-5992d248-3dcf-431c-94f3-c4bb2b7a6004 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:59:47 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-5992d248-3dcf-431c-94f3-c4bb2b7a6004 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:59:47 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-5992d248-3dcf-431c-94f3-c4bb2b7a6004 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e048d6f6-f6aa-4491-ae06-9e22a8ff6691/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051025 Apr 13 16:59:47 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 350/1048] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 16:59:47 2023] GET /compute/v2.1/servers/e048d6f6-f6aa-4491-ae06-9e22a8ff6691/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 16:59:47 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-f63a81ec-bae4-4b48-874d-6df2bbcb3bd2 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:59:47 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-f63a81ec-bae4-4b48-874d-6df2bbcb3bd2 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:59:47 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=3 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:59:47 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_cell1:SELECT=12 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:59:47 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-f63a81ec-bae4-4b48-874d-6df2bbcb3bd2 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:59:47 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-f63a81ec-bae4-4b48-874d-6df2bbcb3bd2 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:59:47 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-f63a81ec-bae4-4b48-874d-6df2bbcb3bd2 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:59:47 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-f63a81ec-bae4-4b48-874d-6df2bbcb3bd2 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:59:47 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-f63a81ec-bae4-4b48-874d-6df2bbcb3bd2 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:59:47 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-f63a81ec-bae4-4b48-874d-6df2bbcb3bd2 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:59:47 user devstack@n-api.service[62053]: INFO nova.api.openstack.wsgi [None req-f63a81ec-bae4-4b48-874d-6df2bbcb3bd2 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] HTTP exception thrown: Instance e048d6f6-f6aa-4491-ae06-9e22a8ff6691 is not attached to volume 52d252b7-6e23-4733-bf50-80e9ff903f75 Apr 13 16:59:47 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-f63a81ec-bae4-4b48-874d-6df2bbcb3bd2 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Request method failure captured: Apr 13 16:59:47 user devstack@n-api.service[62053]: request: DELETE /compute/v2.1/servers/e048d6f6-f6aa-4491-ae06-9e22a8ff6691/os-volume_attachments/52d252b7-6e23-4733-bf50-80e9ff903f75 HTTP/1.1 Apr 13 16:59:47 user devstack@n-api.service[62053]: Accept: application/json Apr 13 16:59:47 user devstack@n-api.service[62053]: Accept-Encoding: identity Apr 13 16:59:47 user devstack@n-api.service[62053]: Connection: close Apr 13 16:59:47 user devstack@n-api.service[62053]: Content-Length: 0 Apr 13 16:59:47 user devstack@n-api.service[62053]: Content-Type: application/json Apr 13 16:59:47 user devstack@n-api.service[62053]: Host: 10.0.0.210 Apr 13 16:59:47 user devstack@n-api.service[62053]: Openstack-System-Scope: None Apr 13 16:59:47 user devstack@n-api.service[62053]: User-Agent: python-urllib3/1.26.15 Apr 13 16:59:47 user devstack@n-api.service[62053]: X-Auth-Token: gAAAAABkODPVZkeqC78r2AGy79LSBx3fRrtpJlQEYWqdQv0kHqzTKfD040BAVw1Ts_OoFgw1yRX2IY3isBZjM91jXVkSN2VNuTwKVCRh4GCrHG232553q0rBQw_GIe18_OXNzLHCCx1Vq6yuQ4UZvddLINfXsS4quZAHEv300O1gXfeEUjGMJu4 Apr 13 16:59:47 user devstack@n-api.service[62053]: X-Domain-Id: None Apr 13 16:59:47 user devstack@n-api.service[62053]: X-Domain-Name: None Apr 13 16:59:47 user devstack@n-api.service[62053]: X-Identity-Status: Confirmed Apr 13 16:59:47 user devstack@n-api.service[62053]: X-Is-Admin-Project: True Apr 13 16:59:47 user devstack@n-api.service[62053]: X-Project-Domain-Id: default Apr 13 16:59:47 user devstack@n-api.service[62053]: X-Project-Domain-Name: Default Apr 13 16:59:47 user devstack@n-api.service[62053]: X-Project-Id: 7edf468527d84954a943bb4c1f7ff54d Apr 13 16:59:47 user devstack@n-api.service[62053]: X-Project-Name: tempest-TestMinimumBasicScenario-419032150 Apr 13 16:59:47 user devstack@n-api.service[62053]: X-Role: reader,member Apr 13 16:59:47 user devstack@n-api.service[62053]: X-Roles: reader,member Apr 13 16:59:47 user devstack@n-api.service[62053]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/7edf468527d84954a943bb4c1f7ff54d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7edf468527d84954a943bb4c1f7ff54d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7edf468527d84954a943bb4c1f7ff54d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 13 16:59:47 user devstack@n-api.service[62053]: X-Tenant: tempest-TestMinimumBasicScenario-419032150 Apr 13 16:59:47 user devstack@n-api.service[62053]: X-Tenant-Id: 7edf468527d84954a943bb4c1f7ff54d Apr 13 16:59:47 user devstack@n-api.service[62053]: X-Tenant-Name: tempest-TestMinimumBasicScenario-419032150 Apr 13 16:59:47 user devstack@n-api.service[62053]: X-User: tempest-TestMinimumBasicScenario-419032150-project-member Apr 13 16:59:47 user devstack@n-api.service[62053]: X-User-Domain-Id: default Apr 13 16:59:47 user devstack@n-api.service[62053]: X-User-Domain-Name: Default Apr 13 16:59:47 user devstack@n-api.service[62053]: X-User-Id: 91a450674d7046ae82f5dd182506c85b Apr 13 16:59:47 user devstack@n-api.service[62053]: X-User-Name: tempest-TestMinimumBasicScenario-419032150-project-member Apr 13 16:59:47 user devstack@n-api.service[62053]: method: > Apr 13 16:59:47 user devstack@n-api.service[62053]: exception: Instance e048d6f6-f6aa-4491-ae06-9e22a8ff6691 is not attached to volume 52d252b7-6e23-4733-bf50-80e9ff903f75 Apr 13 16:59:47 user devstack@n-api.service[62053]: action_args: {'server_id': 'e048d6f6-f6aa-4491-ae06-9e22a8ff6691', 'id': '52d252b7-6e23-4733-bf50-80e9ff903f75'} Apr 13 16:59:47 user devstack@n-api.service[62053]: {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 16:59:47 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:59:47 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Apr 13 16:59:47 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Apr 13 16:59:47 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Apr 13 16:59:47 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Apr 13 16:59:47 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Apr 13 16:59:47 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Apr 13 16:59:47 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 52d252b7-6e23-4733-bf50-80e9ff903f75. Apr 13 16:59:47 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:59:47 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:59:47 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:59:47 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:59:47 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 16:59:47 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 16:59:47 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 16:59:47 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 16:59:47 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 16:59:47 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 16:59:47 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Apr 13 16:59:47 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Apr 13 16:59:47 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e048d6f6-f6aa-4491-ae06-9e22a8ff6691 is not attached to volume 52d252b7-6e23-4733-bf50-80e9ff903f75 Apr 13 16:59:47 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:59:47 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 16:59:47 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:59:47 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 16:59:47 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 16:59:47 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 16:59:47 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 16:59:47 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 16:59:47 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e048d6f6-f6aa-4491-ae06-9e22a8ff6691 is not attached to volume 52d252b7-6e23-4733-bf50-80e9ff903f75 Apr 13 16:59:47 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 16:59:47 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-f63a81ec-bae4-4b48-874d-6df2bbcb3bd2 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Returning 404 to user: Instance e048d6f6-f6aa-4491-ae06-9e22a8ff6691 is not attached to volume 52d252b7-6e23-4733-bf50-80e9ff903f75 {{(pid=62053) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 16:59:47 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-f63a81ec-bae4-4b48-874d-6df2bbcb3bd2 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e048d6f6-f6aa-4491-ae06-9e22a8ff6691/os-volume_attachments/52d252b7-6e23-4733-bf50-80e9ff903f75" status: 404 len: 154 microversion: 2.1 time: 0.108800 Apr 13 16:59:47 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 351/1049] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 16:59:47 2023] DELETE /compute/v2.1/servers/e048d6f6-f6aa-4491-ae06-9e22a8ff6691/os-volume_attachments/52d252b7-6e23-4733-bf50-80e9ff903f75 => generated 154 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 16:59:49 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-9e7e7d7e-ade4-411b-a7c1-6eb3c65a4bf3 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:59:49 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-9e7e7d7e-ade4-411b-a7c1-6eb3c65a4bf3 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:59:49 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_api:SELECT=2 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:59:49 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_cell1:SELECT=6 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 16:59:49 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-9e7e7d7e-ade4-411b-a7c1-6eb3c65a4bf3 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:59:49 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-9e7e7d7e-ade4-411b-a7c1-6eb3c65a4bf3 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:59:49 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-9e7e7d7e-ade4-411b-a7c1-6eb3c65a4bf3 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:59:49 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-9e7e7d7e-ade4-411b-a7c1-6eb3c65a4bf3 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:59:49 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-9e7e7d7e-ade4-411b-a7c1-6eb3c65a4bf3 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:59:49 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-9e7e7d7e-ade4-411b-a7c1-6eb3c65a4bf3 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:59:49 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-9e7e7d7e-ade4-411b-a7c1-6eb3c65a4bf3 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Going to try to terminate instance {{(pid=62055) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 16:59:49 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-9e7e7d7e-ade4-411b-a7c1-6eb3c65a4bf3 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e048d6f6-f6aa-4491-ae06-9e22a8ff6691" status: 204 len: 0 microversion: 2.1 time: 0.152402 Apr 13 16:59:49 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 349/1050] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 16:59:49 2023] DELETE /compute/v2.1/servers/e048d6f6-f6aa-4491-ae06-9e22a8ff6691 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 16:59:49 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-26c213a0-9a90-4daa-b370-041ad25ce4bb tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 16:59:49 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-26c213a0-9a90-4daa-b370-041ad25ce4bb tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 16:59:49 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-26c213a0-9a90-4daa-b370-041ad25ce4bb tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:59:49 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-26c213a0-9a90-4daa-b370-041ad25ce4bb tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:59:49 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-26c213a0-9a90-4daa-b370-041ad25ce4bb tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:59:49 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-26c213a0-9a90-4daa-b370-041ad25ce4bb tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:59:49 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-26c213a0-9a90-4daa-b370-041ad25ce4bb tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:59:49 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-26c213a0-9a90-4daa-b370-041ad25ce4bb tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:59:49 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-d42d0b05-7171-4afb-a6c5-9de1a03c7221 req-a044e13d-f955-4fea-82c0-562dacc99e03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e048d6f6-f6aa-4491-ae06-9e22a8ff6691", "name": "network-vif-unplugged", "status": "completed", "tag": "4fb36f71-2601-4c01-9eba-514f5f2af95f"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:59:49 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-d42d0b05-7171-4afb-a6c5-9de1a03c7221 req-a044e13d-f955-4fea-82c0-562dacc99e03 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:59:49 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-d42d0b05-7171-4afb-a6c5-9de1a03c7221 req-a044e13d-f955-4fea-82c0-562dacc99e03 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:59:49 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-d42d0b05-7171-4afb-a6c5-9de1a03c7221 req-a044e13d-f955-4fea-82c0-562dacc99e03 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:59:49 user devstack@n-api.service[62054]: DEBUG nova.policy [None req-26c213a0-9a90-4daa-b370-041ad25ce4bb tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a450674d7046ae82f5dd182506c85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edf468527d84954a943bb4c1f7ff54d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62054) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 16:59:49 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-26c213a0-9a90-4daa-b370-041ad25ce4bb tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e048d6f6-f6aa-4491-ae06-9e22a8ff6691" status: 200 len: 1542 microversion: 2.1 time: 0.270280 Apr 13 16:59:49 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 351/1051] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 16:59:49 2023] GET /compute/v2.1/servers/e048d6f6-f6aa-4491-ae06-9e22a8ff6691 => generated 1542 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 16:59:49 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-d42d0b05-7171-4afb-a6c5-9de1a03c7221 req-a044e13d-f955-4fea-82c0-562dacc99e03 service nova] Creating event network-vif-unplugged:4fb36f71-2601-4c01-9eba-514f5f2af95f for instance e048d6f6-f6aa-4491-ae06-9e22a8ff6691 on user Apr 13 16:59:50 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [req-d42d0b05-7171-4afb-a6c5-9de1a03c7221 req-a044e13d-f955-4fea-82c0-562dacc99e03 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.075502 Apr 13 16:59:50 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 352/1052] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:59:49 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 16:59:51 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [req-65ef16fd-6dc8-44b8-82c1-063eed800437 req-b3c51858-0450-4d64-8c47-de7586eba2c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e048d6f6-f6aa-4491-ae06-9e22a8ff6691", "name": "network-vif-deleted", "tag": "4fb36f71-2601-4c01-9eba-514f5f2af95f"}]} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:59:51 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-65ef16fd-6dc8-44b8-82c1-063eed800437 req-b3c51858-0450-4d64-8c47-de7586eba2c5 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:59:51 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-65ef16fd-6dc8-44b8-82c1-063eed800437 req-b3c51858-0450-4d64-8c47-de7586eba2c5 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:59:51 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-65ef16fd-6dc8-44b8-82c1-063eed800437 req-b3c51858-0450-4d64-8c47-de7586eba2c5 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:59:51 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-65ef16fd-6dc8-44b8-82c1-063eed800437 req-b3c51858-0450-4d64-8c47-de7586eba2c5 service nova] Creating event network-vif-deleted:4fb36f71-2601-4c01-9eba-514f5f2af95f for instance e048d6f6-f6aa-4491-ae06-9e22a8ff6691 on user Apr 13 16:59:51 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [req-65ef16fd-6dc8-44b8-82c1-063eed800437 req-b3c51858-0450-4d64-8c47-de7586eba2c5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034942 Apr 13 16:59:51 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 350/1053] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:59:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 16:59:52 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-86aa0ada-3b89-4a5f-8420-a5996c0bc818 req-f8fc670a-8dc4-4e64-9a38-d93ea8a3f4ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e048d6f6-f6aa-4491-ae06-9e22a8ff6691", "name": "network-vif-plugged", "status": "completed", "tag": "4fb36f71-2601-4c01-9eba-514f5f2af95f"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 16:59:52 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-86aa0ada-3b89-4a5f-8420-a5996c0bc818 req-f8fc670a-8dc4-4e64-9a38-d93ea8a3f4ab service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 16:59:52 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-86aa0ada-3b89-4a5f-8420-a5996c0bc818 req-f8fc670a-8dc4-4e64-9a38-d93ea8a3f4ab service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 16:59:52 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-86aa0ada-3b89-4a5f-8420-a5996c0bc818 req-f8fc670a-8dc4-4e64-9a38-d93ea8a3f4ab service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 16:59:52 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-86aa0ada-3b89-4a5f-8420-a5996c0bc818 req-f8fc670a-8dc4-4e64-9a38-d93ea8a3f4ab service nova] Creating event network-vif-plugged:4fb36f71-2601-4c01-9eba-514f5f2af95f for instance e048d6f6-f6aa-4491-ae06-9e22a8ff6691 on user Apr 13 16:59:52 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [req-86aa0ada-3b89-4a5f-8420-a5996c0bc818 req-f8fc670a-8dc4-4e64-9a38-d93ea8a3f4ab service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030880 Apr 13 16:59:52 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 352/1054] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 16:59:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:00:36 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-1f69ad23-5aec-4a8a-a029-85d405fb2231 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:00:36 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-1f69ad23-5aec-4a8a-a029-85d405fb2231 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:00:36 user devstack@n-api.service[62053]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f769d44c-a0ce-4038-a872-8a5b800691cd] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 13 17:00:36 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_api:SELECT=4 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:00:36 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_cell1:SELECT=8 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:00:36 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-1f69ad23-5aec-4a8a-a029-85d405fb2231 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:00:36 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-1f69ad23-5aec-4a8a-a029-85d405fb2231 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:00:36 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-1f69ad23-5aec-4a8a-a029-85d405fb2231 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:00:36 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-1f69ad23-5aec-4a8a-a029-85d405fb2231 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:00:36 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-1f69ad23-5aec-4a8a-a029-85d405fb2231 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:00:36 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-1f69ad23-5aec-4a8a-a029-85d405fb2231 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:00:36 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-1f69ad23-5aec-4a8a-a029-85d405fb2231 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.140013 Apr 13 17:00:36 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 353/1055] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 13 17:00:36 2023] GET /compute/v2.1/servers/b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c/os-interface => generated 282 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:00:37 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:00:37 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:00:37 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [req-de4cd14b-e328-40a1-acf8-ea415c838af2 req-07ccdd8e-6eb4-40dd-bc01-1105f7410278 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c", "tag": "70f91af6-4a58-4b9d-a132-93537d398c24"}]} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:00:37 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-de4cd14b-e328-40a1-acf8-ea415c838af2 req-07ccdd8e-6eb4-40dd-bc01-1105f7410278 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:00:37 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-de4cd14b-e328-40a1-acf8-ea415c838af2 req-07ccdd8e-6eb4-40dd-bc01-1105f7410278 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:00:37 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-de4cd14b-e328-40a1-acf8-ea415c838af2 req-07ccdd8e-6eb4-40dd-bc01-1105f7410278 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:00:37 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-de4cd14b-e328-40a1-acf8-ea415c838af2 req-07ccdd8e-6eb4-40dd-bc01-1105f7410278 service nova] Creating event network-changed:70f91af6-4a58-4b9d-a132-93537d398c24 for instance b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c on user Apr 13 17:00:37 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [req-de4cd14b-e328-40a1-acf8-ea415c838af2 req-07ccdd8e-6eb4-40dd-bc01-1105f7410278 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036033 Apr 13 17:00:37 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 351/1056] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:00:37 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:00:37 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_api:SELECT=6 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:00:37 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_cell1:SELECT=14 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:00:37 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-da1599cf-7157-4803-b3f5-2ad21ecbc7a1 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:00:37 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-da1599cf-7157-4803-b3f5-2ad21ecbc7a1 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:00:37 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-da1599cf-7157-4803-b3f5-2ad21ecbc7a1 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:00:37 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-da1599cf-7157-4803-b3f5-2ad21ecbc7a1 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:00:37 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-da1599cf-7157-4803-b3f5-2ad21ecbc7a1 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:00:37 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-da1599cf-7157-4803-b3f5-2ad21ecbc7a1 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:00:37 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-da1599cf-7157-4803-b3f5-2ad21ecbc7a1 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:00:37 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-da1599cf-7157-4803-b3f5-2ad21ecbc7a1 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:00:37 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-da1599cf-7157-4803-b3f5-2ad21ecbc7a1 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c/ips" status: 200 len: 107 microversion: 2.1 time: 0.039822 Apr 13 17:00:37 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 353/1057] 10.0.0.210 () {62 vars in 1325 bytes} [Thu Apr 13 17:00:37 2023] GET /compute/v2.1/servers/b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c/ips => generated 107 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:00:39 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-77d40c55-df7d-46ee-ada5-e45bacc50674 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e13dd7bb-01d3-41fb-b768-048792640d52"}} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:00:39 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-77d40c55-df7d-46ee-ada5-e45bacc50674 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:00:39 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-77d40c55-df7d-46ee-ada5-e45bacc50674 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:00:39 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-77d40c55-df7d-46ee-ada5-e45bacc50674 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:00:39 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-77d40c55-df7d-46ee-ada5-e45bacc50674 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:00:39 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-77d40c55-df7d-46ee-ada5-e45bacc50674 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:00:39 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-77d40c55-df7d-46ee-ada5-e45bacc50674 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:00:39 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-77d40c55-df7d-46ee-ada5-e45bacc50674 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:00:39 user devstack@n-api.service[62053]: INFO oslo.messaging._drivers.impl_rabbit [-] [f769d44c-a0ce-4038-a872-8a5b800691cd] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 36968. Apr 13 17:00:39 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-77d40c55-df7d-46ee-ada5-e45bacc50674 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] 10.0.0.210 "POST /compute/v2.1/servers/b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.293070 Apr 13 17:00:39 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 354/1058] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 17:00:39 2023] POST /compute/v2.1/servers/b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c/os-volume_attachments => generated 194 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:00:40 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-b9315896-da6b-4191-a161-876355edb573 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:00:40 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-b9315896-da6b-4191-a161-876355edb573 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:00:40 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-b9315896-da6b-4191-a161-876355edb573 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:00:40 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-b9315896-da6b-4191-a161-876355edb573 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:00:40 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-b9315896-da6b-4191-a161-876355edb573 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:00:40 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-b9315896-da6b-4191-a161-876355edb573 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:00:40 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-b9315896-da6b-4191-a161-876355edb573 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:00:40 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-b9315896-da6b-4191-a161-876355edb573 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:00:40 user devstack@n-api.service[62055]: INFO nova.api.openstack.wsgi [None req-b9315896-da6b-4191-a161-876355edb573 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] HTTP exception thrown: Instance e048d6f6-f6aa-4491-ae06-9e22a8ff6691 could not be found. Apr 13 17:00:40 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-b9315896-da6b-4191-a161-876355edb573 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Request method failure captured: Apr 13 17:00:40 user devstack@n-api.service[62055]: request: GET /compute/v2.1/servers/e048d6f6-f6aa-4491-ae06-9e22a8ff6691 HTTP/1.1 Apr 13 17:00:40 user devstack@n-api.service[62055]: Accept: application/json Apr 13 17:00:40 user devstack@n-api.service[62055]: Accept-Encoding: identity Apr 13 17:00:40 user devstack@n-api.service[62055]: Connection: close Apr 13 17:00:40 user devstack@n-api.service[62055]: Content-Length: 0 Apr 13 17:00:40 user devstack@n-api.service[62055]: Content-Type: application/json Apr 13 17:00:40 user devstack@n-api.service[62055]: Host: 10.0.0.210 Apr 13 17:00:40 user devstack@n-api.service[62055]: Openstack-System-Scope: None Apr 13 17:00:40 user devstack@n-api.service[62055]: User-Agent: python-urllib3/1.26.15 Apr 13 17:00:40 user devstack@n-api.service[62055]: X-Auth-Token: gAAAAABkODPVZkeqC78r2AGy79LSBx3fRrtpJlQEYWqdQv0kHqzTKfD040BAVw1Ts_OoFgw1yRX2IY3isBZjM91jXVkSN2VNuTwKVCRh4GCrHG232553q0rBQw_GIe18_OXNzLHCCx1Vq6yuQ4UZvddLINfXsS4quZAHEv300O1gXfeEUjGMJu4 Apr 13 17:00:40 user devstack@n-api.service[62055]: X-Domain-Id: None Apr 13 17:00:40 user devstack@n-api.service[62055]: X-Domain-Name: None Apr 13 17:00:40 user devstack@n-api.service[62055]: X-Identity-Status: Confirmed Apr 13 17:00:40 user devstack@n-api.service[62055]: X-Is-Admin-Project: True Apr 13 17:00:40 user devstack@n-api.service[62055]: X-Project-Domain-Id: default Apr 13 17:00:40 user devstack@n-api.service[62055]: X-Project-Domain-Name: Default Apr 13 17:00:40 user devstack@n-api.service[62055]: X-Project-Id: 7edf468527d84954a943bb4c1f7ff54d Apr 13 17:00:40 user devstack@n-api.service[62055]: X-Project-Name: tempest-TestMinimumBasicScenario-419032150 Apr 13 17:00:40 user devstack@n-api.service[62055]: X-Role: reader,member Apr 13 17:00:40 user devstack@n-api.service[62055]: X-Roles: reader,member Apr 13 17:00:40 user devstack@n-api.service[62055]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/7edf468527d84954a943bb4c1f7ff54d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7edf468527d84954a943bb4c1f7ff54d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7edf468527d84954a943bb4c1f7ff54d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 13 17:00:40 user devstack@n-api.service[62055]: X-Tenant: tempest-TestMinimumBasicScenario-419032150 Apr 13 17:00:40 user devstack@n-api.service[62055]: X-Tenant-Id: 7edf468527d84954a943bb4c1f7ff54d Apr 13 17:00:40 user devstack@n-api.service[62055]: X-Tenant-Name: tempest-TestMinimumBasicScenario-419032150 Apr 13 17:00:40 user devstack@n-api.service[62055]: X-User: tempest-TestMinimumBasicScenario-419032150-project-member Apr 13 17:00:40 user devstack@n-api.service[62055]: X-User-Domain-Id: default Apr 13 17:00:40 user devstack@n-api.service[62055]: X-User-Domain-Name: Default Apr 13 17:00:40 user devstack@n-api.service[62055]: X-User-Id: 91a450674d7046ae82f5dd182506c85b Apr 13 17:00:40 user devstack@n-api.service[62055]: X-User-Name: tempest-TestMinimumBasicScenario-419032150-project-member Apr 13 17:00:40 user devstack@n-api.service[62055]: method: > Apr 13 17:00:40 user devstack@n-api.service[62055]: exception: Instance e048d6f6-f6aa-4491-ae06-9e22a8ff6691 could not be found. Apr 13 17:00:40 user devstack@n-api.service[62055]: action_args: {'id': 'e048d6f6-f6aa-4491-ae06-9e22a8ff6691'} Apr 13 17:00:40 user devstack@n-api.service[62055]: {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 17:00:40 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:00:40 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 17:00:40 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 17:00:40 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 17:00:40 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 17:00:40 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 17:00:40 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 17:00:40 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 17:00:40 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 17:00:40 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e048d6f6-f6aa-4491-ae06-9e22a8ff6691 could not be found. Apr 13 17:00:40 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 17:00:40 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:00:40 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 17:00:40 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:00:40 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 17:00:40 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 17:00:40 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 17:00:40 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 17:00:40 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 17:00:40 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 17:00:40 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 17:00:40 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 17:00:40 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 17:00:40 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 17:00:40 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 17:00:40 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 17:00:40 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e048d6f6-f6aa-4491-ae06-9e22a8ff6691 could not be found. Apr 13 17:00:40 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 17:00:40 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:00:40 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 17:00:40 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:00:40 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 17:00:40 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 17:00:40 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 17:00:40 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 17:00:40 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e048d6f6-f6aa-4491-ae06-9e22a8ff6691 could not be found. Apr 13 17:00:40 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 17:00:40 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-b9315896-da6b-4191-a161-876355edb573 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Returning 404 to user: Instance e048d6f6-f6aa-4491-ae06-9e22a8ff6691 could not be found. {{(pid=62055) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 17:00:40 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-b9315896-da6b-4191-a161-876355edb573 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e048d6f6-f6aa-4491-ae06-9e22a8ff6691" status: 404 len: 111 microversion: 2.1 time: 0.141259 Apr 13 17:00:40 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 352/1059] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:00:40 2023] GET /compute/v2.1/servers/e048d6f6-f6aa-4491-ae06-9e22a8ff6691 => generated 111 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 17:00:40 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-084cb8a1-4bb4-4cc7-a7ad-cbe266934608 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Calling method '.version_select at 0x7f96e4849c60>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:00:40 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-084cb8a1-4bb4-4cc7-a7ad-cbe266934608 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-810545990" status: 202 len: 0 microversion: 2.1 time: 0.026028 Apr 13 17:00:40 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 354/1060] 10.0.0.210 () {62 vars in 1346 bytes} [Thu Apr 13 17:00:40 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-810545990 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 17:00:42 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-ab556a01-fdff-4bc7-ba1e-5897762a468e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Action: 'create', calling method: .version_select at 0x7f96e4ce76d0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-646311077", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLTT5rrYLPrICtrmRV6uZ+f3Amb/NKgabEiTvK/SQIBpINNqaHEfiYg1i3f6zZiVzFJ2qudJHtaG2Ihj81v7dqZamVZwx3H3EBr/5cGqhXpc8pjW8XQjSOCjYuKj4Jtgow=="}} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:00:42 user devstack@n-api.service[62053]: DEBUG nova.quota [None req-ab556a01-fdff-4bc7-ba1e-5897762a468e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Getting quotas for project 7edf468527d84954a943bb4c1f7ff54d. Resources: {'key_pairs'} {{(pid=62053) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 17:00:42 user devstack@n-api.service[62053]: DEBUG nova.quota [None req-ab556a01-fdff-4bc7-ba1e-5897762a468e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Getting quotas for user 91a450674d7046ae82f5dd182506c85b and project 7edf468527d84954a943bb4c1f7ff54d. Resources: {'key_pairs'} {{(pid=62053) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 17:00:42 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-ab556a01-fdff-4bc7-ba1e-5897762a468e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.048571 Apr 13 17:00:42 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 355/1061] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 13 17:00:42 2023] POST /compute/v2.1/os-keypairs => generated 402 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:00:42 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-18a6fac5-9793-4205-a384-6e1bd8603efa tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1210397582", "imageRef": "40bf0b81-a3f7-4702-b16f-bc02b4ffa120", "flavorRef": "42", "key_name": "tempest-TestMinimumBasicScenario-646311077", "networks": [{"uuid": "0c6a5f46-e53b-4b4c-806e-b2617ba3ef35"}]}} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:00:42 user devstack@n-api.service[62055]: DEBUG nova.network.neutron [None req-18a6fac5-9793-4205-a384-6e1bd8603efa tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] validate_networks() for [('0c6a5f46-e53b-4b4c-806e-b2617ba3ef35', None, None, None, None, None)] {{(pid=62055) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 17:00:43 user devstack@n-api.service[62055]: DEBUG nova.virt.hardware [None req-18a6fac5-9793-4205-a384-6e1bd8603efa tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Flavor limits 0:0:0 {{(pid=62055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 17:00:43 user devstack@n-api.service[62055]: DEBUG nova.virt.hardware [None req-18a6fac5-9793-4205-a384-6e1bd8603efa tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Image limits 0:0:0 {{(pid=62055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 17:00:43 user devstack@n-api.service[62055]: DEBUG nova.virt.hardware [None req-18a6fac5-9793-4205-a384-6e1bd8603efa tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Flavor pref 0:0:0 {{(pid=62055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 17:00:43 user devstack@n-api.service[62055]: DEBUG nova.virt.hardware [None req-18a6fac5-9793-4205-a384-6e1bd8603efa tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Image pref 0:0:0 {{(pid=62055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 17:00:43 user devstack@n-api.service[62055]: DEBUG nova.virt.hardware [None req-18a6fac5-9793-4205-a384-6e1bd8603efa tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 17:00:43 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-18a6fac5-9793-4205-a384-6e1bd8603efa tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:00:43 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-18a6fac5-9793-4205-a384-6e1bd8603efa tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:00:43 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-18a6fac5-9793-4205-a384-6e1bd8603efa tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:00:43 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-18a6fac5-9793-4205-a384-6e1bd8603efa tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:00:43 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-18a6fac5-9793-4205-a384-6e1bd8603efa tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:00:43 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-18a6fac5-9793-4205-a384-6e1bd8603efa tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:00:43 user devstack@n-api.service[62055]: DEBUG nova.quota [None req-18a6fac5-9793-4205-a384-6e1bd8603efa tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Getting quotas for project 7edf468527d84954a943bb4c1f7ff54d. Resources: {'instances', 'cores', 'ram'} {{(pid=62055) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 17:00:43 user devstack@n-api.service[62055]: DEBUG nova.quota [None req-18a6fac5-9793-4205-a384-6e1bd8603efa tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Getting quotas for user 91a450674d7046ae82f5dd182506c85b and project 7edf468527d84954a943bb4c1f7ff54d. Resources: {'instances', 'cores', 'ram'} {{(pid=62055) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 17:00:43 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-18a6fac5-9793-4205-a384-6e1bd8603efa tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Going to run 1 instances... {{(pid=62055) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 17:00:43 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-18a6fac5-9793-4205-a384-6e1bd8603efa tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='40bf0b81-a3f7-4702-b16f-bc02b4ffa120',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=62055) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 17:00:43 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-18a6fac5-9793-4205-a384-6e1bd8603efa tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.551023 Apr 13 17:00:43 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 353/1062] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 17:00:42 2023] POST /compute/v2.1/servers => generated 378 bytes in 553 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 17:00:43 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-ddc55e9d-6001-414e-ba2a-115f0b484d6b tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:00:43 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-ddc55e9d-6001-414e-ba2a-115f0b484d6b tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:00:43 user devstack@n-api.service[62054]: DEBUG nova.policy [None req-ddc55e9d-6001-414e-ba2a-115f0b484d6b tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a450674d7046ae82f5dd182506c85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edf468527d84954a943bb4c1f7ff54d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62054) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:00:43 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-ddc55e9d-6001-414e-ba2a-115f0b484d6b tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] 10.0.0.210 "GET /compute/v2.1/servers/652e59f0-b9be-4f45-bb79-2340d9564000" status: 200 len: 1252 microversion: 2.1 time: 0.073252 Apr 13 17:00:43 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 355/1063] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:00:43 2023] GET /compute/v2.1/servers/652e59f0-b9be-4f45-bb79-2340d9564000 => generated 1252 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:00:46 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-11b4e632-73b6-4825-b44a-a6bb1f14be54 req-d19f1d04-5fd0-4ba8-abbb-ab9bf0355569 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "652e59f0-b9be-4f45-bb79-2340d9564000", "tag": "6047b3aa-607c-4b10-904a-8497d9a2f82b"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:00:46 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-11b4e632-73b6-4825-b44a-a6bb1f14be54 req-d19f1d04-5fd0-4ba8-abbb-ab9bf0355569 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:00:46 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-11b4e632-73b6-4825-b44a-a6bb1f14be54 req-d19f1d04-5fd0-4ba8-abbb-ab9bf0355569 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:00:46 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-11b4e632-73b6-4825-b44a-a6bb1f14be54 req-d19f1d04-5fd0-4ba8-abbb-ab9bf0355569 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:00:46 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-11b4e632-73b6-4825-b44a-a6bb1f14be54 req-d19f1d04-5fd0-4ba8-abbb-ab9bf0355569 service nova] Creating event network-changed:6047b3aa-607c-4b10-904a-8497d9a2f82b for instance 652e59f0-b9be-4f45-bb79-2340d9564000 on user Apr 13 17:00:46 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [req-11b4e632-73b6-4825-b44a-a6bb1f14be54 req-d19f1d04-5fd0-4ba8-abbb-ab9bf0355569 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030975 Apr 13 17:00:46 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 356/1064] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:00:46 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:00:46 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-412fc6fb-dbc1-43e7-9c3a-a192afd0a761 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Action: 'create', calling method: .version_select at 0x7f96dc6c45e0>, body: {"keypair": {"name": "tempest-keypair-1663561865", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK/PPAxTx4h8wKULYE+NmhML0XVzgcuD2CI5i2nijjbKEY4lk93mBS7lo+7L0CmeBrgi6HQncBfHbPaPbq9kFxHeS9dKrt+RaVlLcssm1Y2vqIwfwXE++AutJHrwid+LSg=="}} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:00:46 user devstack@n-api.service[62055]: DEBUG nova.quota [None req-412fc6fb-dbc1-43e7-9c3a-a192afd0a761 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Getting quotas for project 097b15faad8249c9bf45623d0c3ab518. Resources: {'key_pairs'} {{(pid=62055) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 17:00:46 user devstack@n-api.service[62055]: DEBUG nova.quota [None req-412fc6fb-dbc1-43e7-9c3a-a192afd0a761 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Getting quotas for user a08b0caad23045c1822cdd0b3ae0769f and project 097b15faad8249c9bf45623d0c3ab518. Resources: {'key_pairs'} {{(pid=62055) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 17:00:46 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-412fc6fb-dbc1-43e7-9c3a-a192afd0a761 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.054077 Apr 13 17:00:46 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 354/1065] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 13 17:00:46 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:00:48 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-cb45f9d8-7da0-43f5-bb88-559eeafe64e7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2144426413", "imageRef": "708622a9-7465-4492-ade8-b827198f7e30", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "436011a9-c48b-4f33-a576-a245b344dd72"}], "security_groups": [{"name": "tempest-securitygroup--184568105"}], "key_name": "tempest-keypair-1663561865", "user_data": "}} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:00:48 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_cell1:SELECT=4 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:00:48 user devstack@n-api.service[62054]: DEBUG nova.network.neutron [None req-cb45f9d8-7da0-43f5-bb88-559eeafe64e7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] validate_networks() for [('436011a9-c48b-4f33-a576-a245b344dd72', None, None, None, None, None)] {{(pid=62054) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 17:00:48 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-a7ea5b37-6e88-49fc-a5ba-5dd8ace48424 req-34e1c722-8cf6-4bd2-bf6a-5caf3d06bb68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "652e59f0-b9be-4f45-bb79-2340d9564000", "name": "network-vif-plugged", "status": "completed", "tag": "6047b3aa-607c-4b10-904a-8497d9a2f82b"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:00:48 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-a7ea5b37-6e88-49fc-a5ba-5dd8ace48424 req-34e1c722-8cf6-4bd2-bf6a-5caf3d06bb68 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:00:48 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-a7ea5b37-6e88-49fc-a5ba-5dd8ace48424 req-34e1c722-8cf6-4bd2-bf6a-5caf3d06bb68 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:00:48 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-a7ea5b37-6e88-49fc-a5ba-5dd8ace48424 req-34e1c722-8cf6-4bd2-bf6a-5caf3d06bb68 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:00:48 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-a7ea5b37-6e88-49fc-a5ba-5dd8ace48424 req-34e1c722-8cf6-4bd2-bf6a-5caf3d06bb68 service nova] Creating event network-vif-plugged:6047b3aa-607c-4b10-904a-8497d9a2f82b for instance 652e59f0-b9be-4f45-bb79-2340d9564000 on user Apr 13 17:00:48 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [req-a7ea5b37-6e88-49fc-a5ba-5dd8ace48424 req-34e1c722-8cf6-4bd2-bf6a-5caf3d06bb68 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029529 Apr 13 17:00:48 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 357/1066] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:00:48 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:00:49 user devstack@n-api.service[62054]: DEBUG nova.virt.hardware [None req-cb45f9d8-7da0-43f5-bb88-559eeafe64e7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Flavor limits 0:0:0 {{(pid=62054) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 17:00:49 user devstack@n-api.service[62054]: DEBUG nova.virt.hardware [None req-cb45f9d8-7da0-43f5-bb88-559eeafe64e7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Image limits 0:0:0 {{(pid=62054) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 17:00:49 user devstack@n-api.service[62054]: DEBUG nova.virt.hardware [None req-cb45f9d8-7da0-43f5-bb88-559eeafe64e7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Flavor pref 0:0:0 {{(pid=62054) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 17:00:49 user devstack@n-api.service[62054]: DEBUG nova.virt.hardware [None req-cb45f9d8-7da0-43f5-bb88-559eeafe64e7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Image pref 0:0:0 {{(pid=62054) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 17:00:49 user devstack@n-api.service[62054]: DEBUG nova.virt.hardware [None req-cb45f9d8-7da0-43f5-bb88-559eeafe64e7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62054) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 17:00:49 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-cb45f9d8-7da0-43f5-bb88-559eeafe64e7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:00:49 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-cb45f9d8-7da0-43f5-bb88-559eeafe64e7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:00:49 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-cb45f9d8-7da0-43f5-bb88-559eeafe64e7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:00:49 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-cb45f9d8-7da0-43f5-bb88-559eeafe64e7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:00:49 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-cb45f9d8-7da0-43f5-bb88-559eeafe64e7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:00:49 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-cb45f9d8-7da0-43f5-bb88-559eeafe64e7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:00:49 user devstack@n-api.service[62054]: DEBUG nova.quota [None req-cb45f9d8-7da0-43f5-bb88-559eeafe64e7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Getting quotas for project 097b15faad8249c9bf45623d0c3ab518. Resources: {'instances', 'cores', 'ram'} {{(pid=62054) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 17:00:49 user devstack@n-api.service[62054]: DEBUG nova.quota [None req-cb45f9d8-7da0-43f5-bb88-559eeafe64e7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Getting quotas for user a08b0caad23045c1822cdd0b3ae0769f and project 097b15faad8249c9bf45623d0c3ab518. Resources: {'instances', 'cores', 'ram'} {{(pid=62054) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 17:00:49 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-cb45f9d8-7da0-43f5-bb88-559eeafe64e7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Going to run 1 instances... {{(pid=62054) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 17:00:49 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-cb45f9d8-7da0-43f5-bb88-559eeafe64e7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: e101522a-965b-43da-9408-07e341a9103a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='708622a9-7465-4492-ade8-b827198f7e30',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=62054) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 17:00:49 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-cb45f9d8-7da0-43f5-bb88-559eeafe64e7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 0.965910 Apr 13 17:00:49 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 356/1067] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 17:00:48 2023] POST /compute/v2.1/servers => generated 399 bytes in 968 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 17:00:49 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-09409395-1f97-4351-abeb-68dd755e1fe6 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:00:49 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-09409395-1f97-4351-abeb-68dd755e1fe6 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: e101522a-965b-43da-9408-07e341a9103a] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:00:49 user devstack@n-api.service[62055]: DEBUG nova.policy [None req-09409395-1f97-4351-abeb-68dd755e1fe6 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a08b0caad23045c1822cdd0b3ae0769f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097b15faad8249c9bf45623d0c3ab518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62055) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:00:49 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-09409395-1f97-4351-abeb-68dd755e1fe6 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e101522a-965b-43da-9408-07e341a9103a" status: 200 len: 1236 microversion: 2.1 time: 0.063341 Apr 13 17:00:49 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 355/1068] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:00:49 2023] GET /compute/v2.1/servers/e101522a-965b-43da-9408-07e341a9103a => generated 1236 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:00:50 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-1455404c-1611-4756-b67f-0a6928406608 req-1d8e48eb-5cf4-4887-ad6c-5dc6498c27bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "652e59f0-b9be-4f45-bb79-2340d9564000", "name": "network-vif-plugged", "status": "completed", "tag": "6047b3aa-607c-4b10-904a-8497d9a2f82b"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:00:50 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-1455404c-1611-4756-b67f-0a6928406608 req-1d8e48eb-5cf4-4887-ad6c-5dc6498c27bb service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:00:50 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-1455404c-1611-4756-b67f-0a6928406608 req-1d8e48eb-5cf4-4887-ad6c-5dc6498c27bb service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:00:50 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-1455404c-1611-4756-b67f-0a6928406608 req-1d8e48eb-5cf4-4887-ad6c-5dc6498c27bb service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:00:50 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-1455404c-1611-4756-b67f-0a6928406608 req-1d8e48eb-5cf4-4887-ad6c-5dc6498c27bb service nova] Creating event network-vif-plugged:6047b3aa-607c-4b10-904a-8497d9a2f82b for instance 652e59f0-b9be-4f45-bb79-2340d9564000 on user Apr 13 17:00:50 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [req-1455404c-1611-4756-b67f-0a6928406608 req-1d8e48eb-5cf4-4887-ad6c-5dc6498c27bb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032084 Apr 13 17:00:50 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 358/1069] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:00:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:00:51 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-a554ec72-cc12-47c4-8de2-8d47fd2d0b69 req-7b3b7edd-94bd-46da-892f-f810e28daa0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e101522a-965b-43da-9408-07e341a9103a", "tag": "8356a603-9c08-4a58-8735-2d4b58654a18"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:00:51 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-a554ec72-cc12-47c4-8de2-8d47fd2d0b69 req-7b3b7edd-94bd-46da-892f-f810e28daa0f service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:00:51 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-a554ec72-cc12-47c4-8de2-8d47fd2d0b69 req-7b3b7edd-94bd-46da-892f-f810e28daa0f service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:00:51 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-a554ec72-cc12-47c4-8de2-8d47fd2d0b69 req-7b3b7edd-94bd-46da-892f-f810e28daa0f service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:00:51 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-a554ec72-cc12-47c4-8de2-8d47fd2d0b69 req-7b3b7edd-94bd-46da-892f-f810e28daa0f service nova] Creating event network-changed:8356a603-9c08-4a58-8735-2d4b58654a18 for instance e101522a-965b-43da-9408-07e341a9103a on user Apr 13 17:00:51 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [req-a554ec72-cc12-47c4-8de2-8d47fd2d0b69 req-7b3b7edd-94bd-46da-892f-f810e28daa0f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033629 Apr 13 17:00:51 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 357/1070] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:00:51 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:00:53 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [req-1b8436b6-4fec-4f2e-bd2e-64346afb85b7 req-b14685e6-c885-4ec5-9f50-d258e6ea31b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e101522a-965b-43da-9408-07e341a9103a", "name": "network-vif-plugged", "status": "completed", "tag": "8356a603-9c08-4a58-8735-2d4b58654a18"}]} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:00:53 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_cell0:SELECT=2 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:00:53 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_cell1:SELECT=6 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:00:53 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-1b8436b6-4fec-4f2e-bd2e-64346afb85b7 req-b14685e6-c885-4ec5-9f50-d258e6ea31b1 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:00:53 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-1b8436b6-4fec-4f2e-bd2e-64346afb85b7 req-b14685e6-c885-4ec5-9f50-d258e6ea31b1 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:00:53 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-1b8436b6-4fec-4f2e-bd2e-64346afb85b7 req-b14685e6-c885-4ec5-9f50-d258e6ea31b1 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:00:53 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-1b8436b6-4fec-4f2e-bd2e-64346afb85b7 req-b14685e6-c885-4ec5-9f50-d258e6ea31b1 service nova] Creating event network-vif-plugged:8356a603-9c08-4a58-8735-2d4b58654a18 for instance e101522a-965b-43da-9408-07e341a9103a on user Apr 13 17:00:53 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [req-1b8436b6-4fec-4f2e-bd2e-64346afb85b7 req-b14685e6-c885-4ec5-9f50-d258e6ea31b1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039829 Apr 13 17:00:53 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 356/1071] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:00:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:00:55 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_cell0:SELECT=4 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:00:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-c075ccb4-d094-47e1-b067-7d7b35342b84 req-90a502c8-e6eb-44c5-a43f-29e5d996f5e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e101522a-965b-43da-9408-07e341a9103a", "name": "network-vif-plugged", "status": "completed", "tag": "8356a603-9c08-4a58-8735-2d4b58654a18"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:00:55 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-c075ccb4-d094-47e1-b067-7d7b35342b84 req-90a502c8-e6eb-44c5-a43f-29e5d996f5e8 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:00:55 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-c075ccb4-d094-47e1-b067-7d7b35342b84 req-90a502c8-e6eb-44c5-a43f-29e5d996f5e8 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:00:55 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-c075ccb4-d094-47e1-b067-7d7b35342b84 req-90a502c8-e6eb-44c5-a43f-29e5d996f5e8 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:00:55 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-c075ccb4-d094-47e1-b067-7d7b35342b84 req-90a502c8-e6eb-44c5-a43f-29e5d996f5e8 service nova] Creating event network-vif-plugged:8356a603-9c08-4a58-8735-2d4b58654a18 for instance e101522a-965b-43da-9408-07e341a9103a on user Apr 13 17:00:55 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [req-c075ccb4-d094-47e1-b067-7d7b35342b84 req-90a502c8-e6eb-44c5-a43f-29e5d996f5e8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035409 Apr 13 17:00:55 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 359/1072] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:00:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:01:33 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_cell0:SELECT=2 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:01:33 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_cell0:SELECT=8 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:01:33 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_api:SELECT=26,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:01:33 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_cell1:SELECT=4 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:01:33 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-ad9bd6f2-7fea-41a7-9a01-b6dec8ea756f tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:01:33 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-ad9bd6f2-7fea-41a7-9a01-b6dec8ea756f tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:01:33 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-ad9bd6f2-7fea-41a7-9a01-b6dec8ea756f tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:01:33 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-ad9bd6f2-7fea-41a7-9a01-b6dec8ea756f tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:01:33 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-ad9bd6f2-7fea-41a7-9a01-b6dec8ea756f tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:01:33 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-ad9bd6f2-7fea-41a7-9a01-b6dec8ea756f tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:01:33 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-ad9bd6f2-7fea-41a7-9a01-b6dec8ea756f tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:01:33 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-ad9bd6f2-7fea-41a7-9a01-b6dec8ea756f tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:01:33 user devstack@n-api.service[62054]: DEBUG nova.policy [None req-ad9bd6f2-7fea-41a7-9a01-b6dec8ea756f tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a450674d7046ae82f5dd182506c85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edf468527d84954a943bb4c1f7ff54d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62054) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:01:33 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-ad9bd6f2-7fea-41a7-9a01-b6dec8ea756f tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] 10.0.0.210 "GET /compute/v2.1/servers/652e59f0-b9be-4f45-bb79-2340d9564000" status: 200 len: 1536 microversion: 2.1 time: 0.205362 Apr 13 17:01:33 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 358/1073] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:01:33 2023] GET /compute/v2.1/servers/652e59f0-b9be-4f45-bb79-2340d9564000 => generated 1536 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:01:39 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-3297e064-31ad-4a9a-8bdb-9737ae409bff tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:01:39 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-3297e064-31ad-4a9a-8bdb-9737ae409bff tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: e101522a-965b-43da-9408-07e341a9103a] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:01:39 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_cell0:SELECT=12 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:01:39 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=4 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:01:39 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_cell1:SELECT=2 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:01:39 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-3297e064-31ad-4a9a-8bdb-9737ae409bff tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:01:39 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-3297e064-31ad-4a9a-8bdb-9737ae409bff tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:01:39 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-3297e064-31ad-4a9a-8bdb-9737ae409bff tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:01:39 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-3297e064-31ad-4a9a-8bdb-9737ae409bff tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:01:39 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-3297e064-31ad-4a9a-8bdb-9737ae409bff tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:01:39 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-3297e064-31ad-4a9a-8bdb-9737ae409bff tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:01:39 user devstack@n-api.service[62055]: DEBUG nova.policy [None req-3297e064-31ad-4a9a-8bdb-9737ae409bff tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a08b0caad23045c1822cdd0b3ae0769f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097b15faad8249c9bf45623d0c3ab518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62055) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:01:39 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-3297e064-31ad-4a9a-8bdb-9737ae409bff tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e101522a-965b-43da-9408-07e341a9103a" status: 200 len: 1544 microversion: 2.1 time: 0.170740 Apr 13 17:01:39 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 357/1074] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:01:39 2023] GET /compute/v2.1/servers/e101522a-965b-43da-9408-07e341a9103a => generated 1544 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:02:33 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_api:SELECT=23,nova_api:INSERT=1 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:02:33 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:02:33 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-61687cb7-9ca9-4310-8a23-b86a539663b1 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:02:33 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-61687cb7-9ca9-4310-8a23-b86a539663b1 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:02:33 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-61687cb7-9ca9-4310-8a23-b86a539663b1 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:02:33 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-61687cb7-9ca9-4310-8a23-b86a539663b1 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:02:33 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-61687cb7-9ca9-4310-8a23-b86a539663b1 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:02:33 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-61687cb7-9ca9-4310-8a23-b86a539663b1 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:02:33 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-61687cb7-9ca9-4310-8a23-b86a539663b1 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:02:33 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-61687cb7-9ca9-4310-8a23-b86a539663b1 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:02:33 user devstack@n-api.service[62053]: DEBUG nova.policy [None req-61687cb7-9ca9-4310-8a23-b86a539663b1 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a450674d7046ae82f5dd182506c85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edf468527d84954a943bb4c1f7ff54d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62053) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:02:33 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-61687cb7-9ca9-4310-8a23-b86a539663b1 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] 10.0.0.210 "GET /compute/v2.1/servers/652e59f0-b9be-4f45-bb79-2340d9564000" status: 200 len: 1536 microversion: 2.1 time: 0.314476 Apr 13 17:02:33 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 360/1075] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:02:33 2023] GET /compute/v2.1/servers/652e59f0-b9be-4f45-bb79-2340d9564000 => generated 1536 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:02:33 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_api:SELECT=2 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:02:33 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_cell1:SELECT=6 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:02:33 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-f9ca7faf-e2ae-42ba-b22c-83a068a1c224 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:02:33 user devstack@n-api.service[62054]: DEBUG nova.policy [None req-f9ca7faf-e2ae-42ba-b22c-83a068a1c224 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '91a450674d7046ae82f5dd182506c85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edf468527d84954a943bb4c1f7ff54d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62054) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:02:33 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-f9ca7faf-e2ae-42ba-b22c-83a068a1c224 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Searching by: {'deleted': False, 'project_id': '7edf468527d84954a943bb4c1f7ff54d'} {{(pid=62054) get_all /opt/stack/nova/nova/compute/api.py:3019}} Apr 13 17:02:33 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-f9ca7faf-e2ae-42ba-b22c-83a068a1c224 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:02:33 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-f9ca7faf-e2ae-42ba-b22c-83a068a1c224 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:02:33 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-f9ca7faf-e2ae-42ba-b22c-83a068a1c224 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:02:33 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-f9ca7faf-e2ae-42ba-b22c-83a068a1c224 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:02:33 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-f9ca7faf-e2ae-42ba-b22c-83a068a1c224 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:02:33 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-f9ca7faf-e2ae-42ba-b22c-83a068a1c224 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:02:34 user devstack@n-api.service[62054]: DEBUG nova.compute.multi_cell_list [None req-f9ca7faf-e2ae-42ba-b22c-83a068a1c224 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=62054) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 13 17:02:34 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-f9ca7faf-e2ae-42ba-b22c-83a068a1c224 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.217972 Apr 13 17:02:34 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 359/1076] 10.0.0.210 () {62 vars in 1202 bytes} [Thu Apr 13 17:02:33 2023] GET /compute/v2.1/servers => generated 341 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:02:34 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-a7265b1d-3e3c-44f2-acd5-15dac7af12db tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:02:34 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-a7265b1d-3e3c-44f2-acd5-15dac7af12db tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:02:34 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_api:SELECT=2 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:02:34 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_cell1:SELECT=6 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:02:34 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-a7265b1d-3e3c-44f2-acd5-15dac7af12db tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:02:34 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-a7265b1d-3e3c-44f2-acd5-15dac7af12db tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:02:34 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-a7265b1d-3e3c-44f2-acd5-15dac7af12db tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:02:34 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-a7265b1d-3e3c-44f2-acd5-15dac7af12db tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:02:34 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-a7265b1d-3e3c-44f2-acd5-15dac7af12db tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:02:34 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-a7265b1d-3e3c-44f2-acd5-15dac7af12db tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:02:34 user devstack@n-api.service[62055]: DEBUG nova.policy [None req-a7265b1d-3e3c-44f2-acd5-15dac7af12db tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a450674d7046ae82f5dd182506c85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edf468527d84954a943bb4c1f7ff54d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62055) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:02:34 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-a7265b1d-3e3c-44f2-acd5-15dac7af12db tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] 10.0.0.210 "GET /compute/v2.1/servers/652e59f0-b9be-4f45-bb79-2340d9564000" status: 200 len: 1536 microversion: 2.1 time: 0.265897 Apr 13 17:02:34 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 358/1077] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:02:34 2023] GET /compute/v2.1/servers/652e59f0-b9be-4f45-bb79-2340d9564000 => generated 1536 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:02:36 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-1a209ab3-4cd9-45ed-ac29-59507b6f4cb7 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "db618723-a806-41ad-ade9-ea9a7ebbb110"}} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:02:36 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-1a209ab3-4cd9-45ed-ac29-59507b6f4cb7 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:02:36 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-1a209ab3-4cd9-45ed-ac29-59507b6f4cb7 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:02:36 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-1a209ab3-4cd9-45ed-ac29-59507b6f4cb7 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:02:36 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-1a209ab3-4cd9-45ed-ac29-59507b6f4cb7 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:02:36 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-1a209ab3-4cd9-45ed-ac29-59507b6f4cb7 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:02:36 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-1a209ab3-4cd9-45ed-ac29-59507b6f4cb7 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:02:36 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-1a209ab3-4cd9-45ed-ac29-59507b6f4cb7 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:02:36 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-1a209ab3-4cd9-45ed-ac29-59507b6f4cb7 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] 10.0.0.210 "POST /compute/v2.1/servers/652e59f0-b9be-4f45-bb79-2340d9564000/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.303122 Apr 13 17:02:36 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 361/1078] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 17:02:36 2023] POST /compute/v2.1/servers/652e59f0-b9be-4f45-bb79-2340d9564000/os-volume_attachments => generated 194 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:02:39 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-5c61f620-3bb5-4cd8-a391-33ea27208f8e tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:02:39 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-5c61f620-3bb5-4cd8-a391-33ea27208f8e tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: e101522a-965b-43da-9408-07e341a9103a] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:02:39 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-5c61f620-3bb5-4cd8-a391-33ea27208f8e tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:02:39 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-5c61f620-3bb5-4cd8-a391-33ea27208f8e tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:02:39 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-5c61f620-3bb5-4cd8-a391-33ea27208f8e tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:02:39 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-5c61f620-3bb5-4cd8-a391-33ea27208f8e tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:02:39 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-5c61f620-3bb5-4cd8-a391-33ea27208f8e tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:02:39 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-5c61f620-3bb5-4cd8-a391-33ea27208f8e tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:02:39 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-5c61f620-3bb5-4cd8-a391-33ea27208f8e tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e101522a-965b-43da-9408-07e341a9103a/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.113692 Apr 13 17:02:39 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 360/1079] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 13 17:02:39 2023] GET /compute/v2.1/servers/e101522a-965b-43da-9408-07e341a9103a/os-interface => generated 282 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:02:41 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-f57da384-c2b6-409f-8052-c967cf217eda tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:02:41 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-f57da384-c2b6-409f-8052-c967cf217eda tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: e101522a-965b-43da-9408-07e341a9103a] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:02:41 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-f57da384-c2b6-409f-8052-c967cf217eda tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:02:41 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [req-9f1402ee-05ef-41d2-98af-5fac78c7b870 req-d4587c9e-ed04-4b26-95ae-88a5fe2153c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e101522a-965b-43da-9408-07e341a9103a", "tag": "8356a603-9c08-4a58-8735-2d4b58654a18"}]} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:02:41 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-f57da384-c2b6-409f-8052-c967cf217eda tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:02:41 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-f57da384-c2b6-409f-8052-c967cf217eda tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:02:41 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-f57da384-c2b6-409f-8052-c967cf217eda tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:02:41 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-f57da384-c2b6-409f-8052-c967cf217eda tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:02:41 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-f57da384-c2b6-409f-8052-c967cf217eda tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:02:41 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-9f1402ee-05ef-41d2-98af-5fac78c7b870 req-d4587c9e-ed04-4b26-95ae-88a5fe2153c0 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:02:41 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-9f1402ee-05ef-41d2-98af-5fac78c7b870 req-d4587c9e-ed04-4b26-95ae-88a5fe2153c0 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:02:41 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-9f1402ee-05ef-41d2-98af-5fac78c7b870 req-d4587c9e-ed04-4b26-95ae-88a5fe2153c0 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:02:41 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-9f1402ee-05ef-41d2-98af-5fac78c7b870 req-d4587c9e-ed04-4b26-95ae-88a5fe2153c0 service nova] Creating event network-changed:8356a603-9c08-4a58-8735-2d4b58654a18 for instance e101522a-965b-43da-9408-07e341a9103a on user Apr 13 17:02:41 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [req-9f1402ee-05ef-41d2-98af-5fac78c7b870 req-d4587c9e-ed04-4b26-95ae-88a5fe2153c0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083122 Apr 13 17:02:41 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 359/1080] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:02:41 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:02:41 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-f57da384-c2b6-409f-8052-c967cf217eda tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e101522a-965b-43da-9408-07e341a9103a/ips" status: 200 len: 107 microversion: 2.1 time: 0.045747 Apr 13 17:02:41 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 362/1081] 10.0.0.210 () {62 vars in 1325 bytes} [Thu Apr 13 17:02:41 2023] GET /compute/v2.1/servers/e101522a-965b-43da-9408-07e341a9103a/ips => generated 107 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:02:41 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-e6ada86f-33f4-4ba9-9ce0-368b86c8fa9a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e13dd7bb-01d3-41fb-b768-048792640d52"}} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:02:41 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-e6ada86f-33f4-4ba9-9ce0-368b86c8fa9a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: e101522a-965b-43da-9408-07e341a9103a] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:02:41 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-e6ada86f-33f4-4ba9-9ce0-368b86c8fa9a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:02:41 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-e6ada86f-33f4-4ba9-9ce0-368b86c8fa9a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:02:41 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-e6ada86f-33f4-4ba9-9ce0-368b86c8fa9a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:02:41 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-e6ada86f-33f4-4ba9-9ce0-368b86c8fa9a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:02:41 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-e6ada86f-33f4-4ba9-9ce0-368b86c8fa9a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:02:41 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-e6ada86f-33f4-4ba9-9ce0-368b86c8fa9a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:02:41 user devstack@n-api.service[62054]: INFO nova.api.openstack.wsgi [None req-e6ada86f-33f4-4ba9-9ce0-368b86c8fa9a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] HTTP exception thrown: Invalid volume: volume e13dd7bb-01d3-41fb-b768-048792640d52 is already attached to instances: b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c Apr 13 17:02:41 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-e6ada86f-33f4-4ba9-9ce0-368b86c8fa9a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Request method failure captured: Apr 13 17:02:41 user devstack@n-api.service[62054]: request: POST /compute/v2.1/servers/e101522a-965b-43da-9408-07e341a9103a/os-volume_attachments HTTP/1.1 Apr 13 17:02:41 user devstack@n-api.service[62054]: Accept: application/json Apr 13 17:02:41 user devstack@n-api.service[62054]: Accept-Encoding: identity Apr 13 17:02:41 user devstack@n-api.service[62054]: Connection: close Apr 13 17:02:41 user devstack@n-api.service[62054]: Content-Length: 74 Apr 13 17:02:41 user devstack@n-api.service[62054]: Content-Type: application/json Apr 13 17:02:41 user devstack@n-api.service[62054]: Host: 10.0.0.210 Apr 13 17:02:41 user devstack@n-api.service[62054]: Openstack-System-Scope: None Apr 13 17:02:41 user devstack@n-api.service[62054]: User-Agent: python-urllib3/1.26.15 Apr 13 17:02:41 user devstack@n-api.service[62054]: X-Auth-Token: gAAAAABkODTDp_J_kOKBdnfqcv57bez4t7SdSp5UwD5DaWQ0e7zYTV516bQ2tGNSMsgSMmjRAeEnvh6eyS2dpIcxQ87aMcZmL4sydtZG6naQIt5z18MsjMDJtaVZWdqVQVJRdnFvavY9T2LJZWcSrFdkSSE2bAqoVJKrPExVvG6GOh-2JZvqC00 Apr 13 17:02:41 user devstack@n-api.service[62054]: X-Domain-Id: None Apr 13 17:02:41 user devstack@n-api.service[62054]: X-Domain-Name: None Apr 13 17:02:41 user devstack@n-api.service[62054]: X-Identity-Status: Confirmed Apr 13 17:02:41 user devstack@n-api.service[62054]: X-Is-Admin-Project: True Apr 13 17:02:41 user devstack@n-api.service[62054]: X-Project-Domain-Id: default Apr 13 17:02:41 user devstack@n-api.service[62054]: X-Project-Domain-Name: Default Apr 13 17:02:41 user devstack@n-api.service[62054]: X-Project-Id: 097b15faad8249c9bf45623d0c3ab518 Apr 13 17:02:41 user devstack@n-api.service[62054]: X-Project-Name: tempest-AttachVolumeNegativeTest-236067262 Apr 13 17:02:41 user devstack@n-api.service[62054]: X-Role: reader,member Apr 13 17:02:41 user devstack@n-api.service[62054]: X-Roles: reader,member Apr 13 17:02:41 user devstack@n-api.service[62054]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/097b15faad8249c9bf45623d0c3ab518"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/097b15faad8249c9bf45623d0c3ab518"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/097b15faad8249c9bf45623d0c3ab518"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 13 17:02:41 user devstack@n-api.service[62054]: X-Tenant: tempest-AttachVolumeNegativeTest-236067262 Apr 13 17:02:41 user devstack@n-api.service[62054]: X-Tenant-Id: 097b15faad8249c9bf45623d0c3ab518 Apr 13 17:02:41 user devstack@n-api.service[62054]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-236067262 Apr 13 17:02:41 user devstack@n-api.service[62054]: X-User: tempest-AttachVolumeNegativeTest-236067262-project-member Apr 13 17:02:41 user devstack@n-api.service[62054]: X-User-Domain-Id: default Apr 13 17:02:41 user devstack@n-api.service[62054]: X-User-Domain-Name: Default Apr 13 17:02:41 user devstack@n-api.service[62054]: X-User-Id: a08b0caad23045c1822cdd0b3ae0769f Apr 13 17:02:41 user devstack@n-api.service[62054]: X-User-Name: tempest-AttachVolumeNegativeTest-236067262-project-member Apr 13 17:02:41 user devstack@n-api.service[62054]: Apr 13 17:02:41 user devstack@n-api.service[62054]: {"volumeAttachment": {"volumeId": "e13dd7bb-01d3-41fb-b768-048792640d52"}} Apr 13 17:02:41 user devstack@n-api.service[62054]: method: > Apr 13 17:02:41 user devstack@n-api.service[62054]: exception: Invalid volume: volume e13dd7bb-01d3-41fb-b768-048792640d52 is already attached to instances: b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c Apr 13 17:02:41 user devstack@n-api.service[62054]: action_args: {'server_id': 'e101522a-965b-43da-9408-07e341a9103a', 'body': {'volumeAttachment': {'volumeId': 'e13dd7bb-01d3-41fb-b768-048792640d52'}}} Apr 13 17:02:41 user devstack@n-api.service[62054]: {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 17:02:41 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:02:41 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Apr 13 17:02:41 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Apr 13 17:02:41 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 13 17:02:41 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 13 17:02:41 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Apr 13 17:02:41 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Apr 13 17:02:41 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5139, in attach_volume Apr 13 17:02:41 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Apr 13 17:02:41 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4979, in _check_volume_already_attached Apr 13 17:02:41 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Apr 13 17:02:41 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume e13dd7bb-01d3-41fb-b768-048792640d52 is already attached to instances: b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c Apr 13 17:02:41 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 17:02:41 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:02:41 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 17:02:41 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:02:41 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 17:02:41 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 17:02:41 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 17:02:41 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 17:02:41 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 17:02:41 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 17:02:41 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 13 17:02:41 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 17:02:41 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 13 17:02:41 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 17:02:41 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 13 17:02:41 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 17:02:41 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Apr 13 17:02:41 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Apr 13 17:02:41 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume e13dd7bb-01d3-41fb-b768-048792640d52 is already attached to instances: b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c Apr 13 17:02:41 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 17:02:41 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:02:41 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 17:02:41 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:02:41 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 17:02:41 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 17:02:41 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 17:02:41 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 17:02:41 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume e13dd7bb-01d3-41fb-b768-048792640d52 is already attached to instances: b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c Apr 13 17:02:41 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 17:02:41 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-e6ada86f-33f4-4ba9-9ce0-368b86c8fa9a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Returning 400 to user: Invalid volume: volume e13dd7bb-01d3-41fb-b768-048792640d52 is already attached to instances: b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c {{(pid=62054) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 17:02:41 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-e6ada86f-33f4-4ba9-9ce0-368b86c8fa9a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] 10.0.0.210 "POST /compute/v2.1/servers/e101522a-965b-43da-9408-07e341a9103a/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.113500 Apr 13 17:02:41 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 361/1082] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 17:02:41 2023] POST /compute/v2.1/servers/e101522a-965b-43da-9408-07e341a9103a/os-volume_attachments => generated 174 bytes in 115 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 13 17:02:41 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-e34f5abc-5ea3-4a11-bf1a-ffd37cd80fdd tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:02:41 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-e34f5abc-5ea3-4a11-bf1a-ffd37cd80fdd tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: e101522a-965b-43da-9408-07e341a9103a] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:02:41 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-e34f5abc-5ea3-4a11-bf1a-ffd37cd80fdd tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:02:41 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-e34f5abc-5ea3-4a11-bf1a-ffd37cd80fdd tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:02:41 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-e34f5abc-5ea3-4a11-bf1a-ffd37cd80fdd tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:02:41 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-e34f5abc-5ea3-4a11-bf1a-ffd37cd80fdd tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:02:41 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-e34f5abc-5ea3-4a11-bf1a-ffd37cd80fdd tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:02:41 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-e34f5abc-5ea3-4a11-bf1a-ffd37cd80fdd tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:02:41 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-e34f5abc-5ea3-4a11-bf1a-ffd37cd80fdd tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: e101522a-965b-43da-9408-07e341a9103a] Going to try to terminate instance {{(pid=62055) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 17:02:41 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-e34f5abc-5ea3-4a11-bf1a-ffd37cd80fdd tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e101522a-965b-43da-9408-07e341a9103a" status: 204 len: 0 microversion: 2.1 time: 0.138085 Apr 13 17:02:41 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 360/1083] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 17:02:41 2023] DELETE /compute/v2.1/servers/e101522a-965b-43da-9408-07e341a9103a => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 17:02:41 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-df733835-bc80-4cdd-a7cf-bba2b9dd032d tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:02:41 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-df733835-bc80-4cdd-a7cf-bba2b9dd032d tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: e101522a-965b-43da-9408-07e341a9103a] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:02:41 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-df733835-bc80-4cdd-a7cf-bba2b9dd032d tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:02:41 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-df733835-bc80-4cdd-a7cf-bba2b9dd032d tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:02:41 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-df733835-bc80-4cdd-a7cf-bba2b9dd032d tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:02:41 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-df733835-bc80-4cdd-a7cf-bba2b9dd032d tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:02:41 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-df733835-bc80-4cdd-a7cf-bba2b9dd032d tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:02:41 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-df733835-bc80-4cdd-a7cf-bba2b9dd032d tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:02:42 user devstack@n-api.service[62053]: DEBUG nova.policy [None req-df733835-bc80-4cdd-a7cf-bba2b9dd032d tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a08b0caad23045c1822cdd0b3ae0769f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097b15faad8249c9bf45623d0c3ab518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62053) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:02:42 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-df733835-bc80-4cdd-a7cf-bba2b9dd032d tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e101522a-965b-43da-9408-07e341a9103a" status: 200 len: 1550 microversion: 2.1 time: 0.468249 Apr 13 17:02:42 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 363/1084] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:02:41 2023] GET /compute/v2.1/servers/e101522a-965b-43da-9408-07e341a9103a => generated 1550 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:02:43 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-5d218b0c-bfb8-483b-a52a-ebfdf594ecc2 req-9300cd59-1fb3-48da-aacd-055f51be7718 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e101522a-965b-43da-9408-07e341a9103a", "name": "network-vif-deleted", "tag": "8356a603-9c08-4a58-8735-2d4b58654a18"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:02:43 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-5d218b0c-bfb8-483b-a52a-ebfdf594ecc2 req-9300cd59-1fb3-48da-aacd-055f51be7718 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:02:43 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-5d218b0c-bfb8-483b-a52a-ebfdf594ecc2 req-9300cd59-1fb3-48da-aacd-055f51be7718 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:02:43 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-5d218b0c-bfb8-483b-a52a-ebfdf594ecc2 req-9300cd59-1fb3-48da-aacd-055f51be7718 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:02:43 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-5d218b0c-bfb8-483b-a52a-ebfdf594ecc2 req-9300cd59-1fb3-48da-aacd-055f51be7718 service nova] Creating event network-vif-deleted:8356a603-9c08-4a58-8735-2d4b58654a18 for instance e101522a-965b-43da-9408-07e341a9103a on user Apr 13 17:02:43 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [req-5d218b0c-bfb8-483b-a52a-ebfdf594ecc2 req-9300cd59-1fb3-48da-aacd-055f51be7718 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101143 Apr 13 17:02:43 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 362/1085] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:02:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 17:02:43 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [req-4f4b2e3f-e0fd-4102-bb1a-23f191139c8f req-467d6ad1-a73f-40be-b527-5f568823742e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e101522a-965b-43da-9408-07e341a9103a", "name": "network-vif-unplugged", "status": "completed", "tag": "8356a603-9c08-4a58-8735-2d4b58654a18"}, {"server_uuid": "e101522a-965b-43da-9408-07e341a9103a", "name": "network-vif-plugged", "status": "completed", "tag": "8356a603-9c08-4a58-8735-2d4b58654a18"}]} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:02:43 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-4f4b2e3f-e0fd-4102-bb1a-23f191139c8f req-467d6ad1-a73f-40be-b527-5f568823742e service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:02:43 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-4f4b2e3f-e0fd-4102-bb1a-23f191139c8f req-467d6ad1-a73f-40be-b527-5f568823742e service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:02:43 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-4f4b2e3f-e0fd-4102-bb1a-23f191139c8f req-467d6ad1-a73f-40be-b527-5f568823742e service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:02:43 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-4f4b2e3f-e0fd-4102-bb1a-23f191139c8f req-467d6ad1-a73f-40be-b527-5f568823742e service nova] Creating event network-vif-unplugged:8356a603-9c08-4a58-8735-2d4b58654a18 for instance e101522a-965b-43da-9408-07e341a9103a on user Apr 13 17:02:43 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-4f4b2e3f-e0fd-4102-bb1a-23f191139c8f req-467d6ad1-a73f-40be-b527-5f568823742e service nova] Creating event network-vif-plugged:8356a603-9c08-4a58-8735-2d4b58654a18 for instance e101522a-965b-43da-9408-07e341a9103a on user Apr 13 17:02:43 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [req-4f4b2e3f-e0fd-4102-bb1a-23f191139c8f req-467d6ad1-a73f-40be-b527-5f568823742e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.030249 Apr 13 17:02:43 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 361/1086] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:02:43 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:02:44 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-5ad093d8-06d7-4a34-b0c3-7ceeab5e62fd tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:02:44 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-5ad093d8-06d7-4a34-b0c3-7ceeab5e62fd tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:02:44 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-5ad093d8-06d7-4a34-b0c3-7ceeab5e62fd tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:02:44 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-5ad093d8-06d7-4a34-b0c3-7ceeab5e62fd tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:02:44 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-5ad093d8-06d7-4a34-b0c3-7ceeab5e62fd tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:02:44 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-5ad093d8-06d7-4a34-b0c3-7ceeab5e62fd tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:02:44 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-5ad093d8-06d7-4a34-b0c3-7ceeab5e62fd tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:02:44 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-5ad093d8-06d7-4a34-b0c3-7ceeab5e62fd tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:02:44 user devstack@n-api.service[62053]: DEBUG nova.policy [None req-5ad093d8-06d7-4a34-b0c3-7ceeab5e62fd tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a450674d7046ae82f5dd182506c85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edf468527d84954a943bb4c1f7ff54d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62053) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:02:44 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-5ad093d8-06d7-4a34-b0c3-7ceeab5e62fd tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] 10.0.0.210 "GET /compute/v2.1/servers/652e59f0-b9be-4f45-bb79-2340d9564000" status: 200 len: 1582 microversion: 2.1 time: 0.149538 Apr 13 17:02:44 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 364/1087] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:02:44 2023] GET /compute/v2.1/servers/652e59f0-b9be-4f45-bb79-2340d9564000 => generated 1582 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:02:46 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_cell0:SELECT=2 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:02:46 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-b0afa432-84de-49c0-9d37-7689a55ac75b req-5ed765e9-f1c4-47a8-b3b5-55e4de5884a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "652e59f0-b9be-4f45-bb79-2340d9564000", "tag": "6047b3aa-607c-4b10-904a-8497d9a2f82b"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:02:46 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-b0afa432-84de-49c0-9d37-7689a55ac75b req-5ed765e9-f1c4-47a8-b3b5-55e4de5884a5 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:02:46 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-b0afa432-84de-49c0-9d37-7689a55ac75b req-5ed765e9-f1c4-47a8-b3b5-55e4de5884a5 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:02:46 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-b0afa432-84de-49c0-9d37-7689a55ac75b req-5ed765e9-f1c4-47a8-b3b5-55e4de5884a5 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:02:46 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-b0afa432-84de-49c0-9d37-7689a55ac75b req-5ed765e9-f1c4-47a8-b3b5-55e4de5884a5 service nova] Creating event network-changed:6047b3aa-607c-4b10-904a-8497d9a2f82b for instance 652e59f0-b9be-4f45-bb79-2340d9564000 on user Apr 13 17:02:46 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [req-b0afa432-84de-49c0-9d37-7689a55ac75b req-5ed765e9-f1c4-47a8-b3b5-55e4de5884a5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038528 Apr 13 17:02:46 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 363/1088] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:02:45 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 17:02:47 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-0c456d61-8ec5-4814-9f60-118209f794c1 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1385929483"}} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:02:47 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-0c456d61-8ec5-4814-9f60-118209f794c1 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:02:47 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-0c456d61-8ec5-4814-9f60-118209f794c1 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:02:47 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-0c456d61-8ec5-4814-9f60-118209f794c1 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:02:47 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-0c456d61-8ec5-4814-9f60-118209f794c1 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:02:47 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-0c456d61-8ec5-4814-9f60-118209f794c1 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:02:47 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-0c456d61-8ec5-4814-9f60-118209f794c1 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:02:47 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-0c456d61-8ec5-4814-9f60-118209f794c1 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:02:47 user devstack@n-api.service[62055]: INFO nova.network.security_group_api [None req-0c456d61-8ec5-4814-9f60-118209f794c1 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Adding security group dfd17880-d2de-4078-a281-534db33c04ee to port 6047b3aa-607c-4b10-904a-8497d9a2f82b Apr 13 17:02:48 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-0c456d61-8ec5-4814-9f60-118209f794c1 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] 10.0.0.210 "POST /compute/v2.1/servers/652e59f0-b9be-4f45-bb79-2340d9564000/action" status: 202 len: 0 microversion: 2.1 time: 0.636293 Apr 13 17:02:48 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 362/1089] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 17:02:47 2023] POST /compute/v2.1/servers/652e59f0-b9be-4f45-bb79-2340d9564000/action => generated 0 bytes in 638 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 17:02:48 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-36735a08-a864-4731-b926-6efe0fd36fdc req-20c4109e-d32c-4e4f-9174-6b1b38f1c591 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "652e59f0-b9be-4f45-bb79-2340d9564000", "tag": "6047b3aa-607c-4b10-904a-8497d9a2f82b"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:02:48 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-edc9da58-4d77-402e-8fe6-7657eda9d17b tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:02:48 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-edc9da58-4d77-402e-8fe6-7657eda9d17b tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:02:48 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-edc9da58-4d77-402e-8fe6-7657eda9d17b tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:02:48 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-36735a08-a864-4731-b926-6efe0fd36fdc req-20c4109e-d32c-4e4f-9174-6b1b38f1c591 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:02:48 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-edc9da58-4d77-402e-8fe6-7657eda9d17b tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:02:48 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-36735a08-a864-4731-b926-6efe0fd36fdc req-20c4109e-d32c-4e4f-9174-6b1b38f1c591 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:02:48 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-edc9da58-4d77-402e-8fe6-7657eda9d17b tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:02:48 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-36735a08-a864-4731-b926-6efe0fd36fdc req-20c4109e-d32c-4e4f-9174-6b1b38f1c591 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:02:48 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-edc9da58-4d77-402e-8fe6-7657eda9d17b tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:02:48 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-edc9da58-4d77-402e-8fe6-7657eda9d17b tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:02:48 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-edc9da58-4d77-402e-8fe6-7657eda9d17b tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:02:48 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-36735a08-a864-4731-b926-6efe0fd36fdc req-20c4109e-d32c-4e4f-9174-6b1b38f1c591 service nova] Creating event network-changed:6047b3aa-607c-4b10-904a-8497d9a2f82b for instance 652e59f0-b9be-4f45-bb79-2340d9564000 on user Apr 13 17:02:48 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [req-36735a08-a864-4731-b926-6efe0fd36fdc req-20c4109e-d32c-4e4f-9174-6b1b38f1c591 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031025 Apr 13 17:02:48 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 365/1090] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:02:48 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:02:48 user devstack@n-api.service[62054]: DEBUG nova.policy [None req-edc9da58-4d77-402e-8fe6-7657eda9d17b tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a450674d7046ae82f5dd182506c85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edf468527d84954a943bb4c1f7ff54d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62054) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:02:48 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-edc9da58-4d77-402e-8fe6-7657eda9d17b tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] 10.0.0.210 "GET /compute/v2.1/servers/652e59f0-b9be-4f45-bb79-2340d9564000" status: 200 len: 1748 microversion: 2.1 time: 0.170110 Apr 13 17:02:48 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 364/1091] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:02:48 2023] GET /compute/v2.1/servers/652e59f0-b9be-4f45-bb79-2340d9564000 => generated 1748 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:02:48 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-899a9c1a-a5d0-43f3-98e4-98086fb21f3e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:02:48 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-899a9c1a-a5d0-43f3-98e4-98086fb21f3e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:02:48 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-899a9c1a-a5d0-43f3-98e4-98086fb21f3e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:02:48 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-899a9c1a-a5d0-43f3-98e4-98086fb21f3e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:02:48 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-899a9c1a-a5d0-43f3-98e4-98086fb21f3e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:02:48 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-899a9c1a-a5d0-43f3-98e4-98086fb21f3e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:02:48 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-899a9c1a-a5d0-43f3-98e4-98086fb21f3e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:02:48 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-899a9c1a-a5d0-43f3-98e4-98086fb21f3e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:02:48 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-899a9c1a-a5d0-43f3-98e4-98086fb21f3e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] 10.0.0.210 "POST /compute/v2.1/servers/652e59f0-b9be-4f45-bb79-2340d9564000/action" status: 202 len: 0 microversion: 2.1 time: 0.162818 Apr 13 17:02:48 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 363/1092] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 17:02:48 2023] POST /compute/v2.1/servers/652e59f0-b9be-4f45-bb79-2340d9564000/action => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 17:02:48 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-617222ca-8cd2-42ce-a19c-a527aa3fb77e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:02:48 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-617222ca-8cd2-42ce-a19c-a527aa3fb77e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:02:48 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-617222ca-8cd2-42ce-a19c-a527aa3fb77e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:02:48 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-617222ca-8cd2-42ce-a19c-a527aa3fb77e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:02:48 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-617222ca-8cd2-42ce-a19c-a527aa3fb77e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:02:48 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-617222ca-8cd2-42ce-a19c-a527aa3fb77e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:02:48 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-617222ca-8cd2-42ce-a19c-a527aa3fb77e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:02:48 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-617222ca-8cd2-42ce-a19c-a527aa3fb77e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:02:48 user devstack@n-api.service[62053]: DEBUG nova.policy [None req-617222ca-8cd2-42ce-a19c-a527aa3fb77e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a450674d7046ae82f5dd182506c85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edf468527d84954a943bb4c1f7ff54d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62053) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:02:48 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-617222ca-8cd2-42ce-a19c-a527aa3fb77e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] 10.0.0.210 "GET /compute/v2.1/servers/652e59f0-b9be-4f45-bb79-2340d9564000" status: 200 len: 1740 microversion: 2.1 time: 0.220152 Apr 13 17:02:48 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 366/1093] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:02:48 2023] GET /compute/v2.1/servers/652e59f0-b9be-4f45-bb79-2340d9564000 => generated 1740 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:02:51 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-0c587ea2-fc2c-4b2f-9676-e1a76cfd4f7a req-a01ca80a-df4a-4c04-a9e8-24bab457bb07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "652e59f0-b9be-4f45-bb79-2340d9564000", "name": "network-vif-unplugged", "status": "completed", "tag": "6047b3aa-607c-4b10-904a-8497d9a2f82b"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:02:51 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-0c587ea2-fc2c-4b2f-9676-e1a76cfd4f7a req-a01ca80a-df4a-4c04-a9e8-24bab457bb07 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:02:51 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-0c587ea2-fc2c-4b2f-9676-e1a76cfd4f7a req-a01ca80a-df4a-4c04-a9e8-24bab457bb07 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:02:51 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-0c587ea2-fc2c-4b2f-9676-e1a76cfd4f7a req-a01ca80a-df4a-4c04-a9e8-24bab457bb07 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:02:51 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-0c587ea2-fc2c-4b2f-9676-e1a76cfd4f7a req-a01ca80a-df4a-4c04-a9e8-24bab457bb07 service nova] Creating event network-vif-unplugged:6047b3aa-607c-4b10-904a-8497d9a2f82b for instance 652e59f0-b9be-4f45-bb79-2340d9564000 on user Apr 13 17:02:51 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [req-0c587ea2-fc2c-4b2f-9676-e1a76cfd4f7a req-a01ca80a-df4a-4c04-a9e8-24bab457bb07 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.088720 Apr 13 17:02:51 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 365/1094] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:02:51 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:02:53 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [req-57c1d6ce-7765-413e-9960-16aa7cbcea89 req-31fed2dc-6e44-405c-a1fd-fe051138158f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "652e59f0-b9be-4f45-bb79-2340d9564000", "name": "network-vif-plugged", "status": "completed", "tag": "6047b3aa-607c-4b10-904a-8497d9a2f82b"}]} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:02:53 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-57c1d6ce-7765-413e-9960-16aa7cbcea89 req-31fed2dc-6e44-405c-a1fd-fe051138158f service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:02:53 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-57c1d6ce-7765-413e-9960-16aa7cbcea89 req-31fed2dc-6e44-405c-a1fd-fe051138158f service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:02:53 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-57c1d6ce-7765-413e-9960-16aa7cbcea89 req-31fed2dc-6e44-405c-a1fd-fe051138158f service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:02:53 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-57c1d6ce-7765-413e-9960-16aa7cbcea89 req-31fed2dc-6e44-405c-a1fd-fe051138158f service nova] Creating event network-vif-plugged:6047b3aa-607c-4b10-904a-8497d9a2f82b for instance 652e59f0-b9be-4f45-bb79-2340d9564000 on user Apr 13 17:02:53 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [req-57c1d6ce-7765-413e-9960-16aa7cbcea89 req-31fed2dc-6e44-405c-a1fd-fe051138158f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044433 Apr 13 17:02:53 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 364/1095] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:02:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:02:55 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-9e6661f0-208a-46fe-ab97-38a48490abd0 req-8a29b742-7454-40ed-b1b5-09845b2a0b5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "652e59f0-b9be-4f45-bb79-2340d9564000", "name": "network-vif-plugged", "status": "completed", "tag": "6047b3aa-607c-4b10-904a-8497d9a2f82b"}, {"server_uuid": "652e59f0-b9be-4f45-bb79-2340d9564000", "name": "network-vif-plugged", "status": "completed", "tag": "6047b3aa-607c-4b10-904a-8497d9a2f82b"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:02:55 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-9e6661f0-208a-46fe-ab97-38a48490abd0 req-8a29b742-7454-40ed-b1b5-09845b2a0b5e service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:02:55 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-9e6661f0-208a-46fe-ab97-38a48490abd0 req-8a29b742-7454-40ed-b1b5-09845b2a0b5e service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:02:55 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-9e6661f0-208a-46fe-ab97-38a48490abd0 req-8a29b742-7454-40ed-b1b5-09845b2a0b5e service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:02:55 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-9e6661f0-208a-46fe-ab97-38a48490abd0 req-8a29b742-7454-40ed-b1b5-09845b2a0b5e service nova] Creating event network-vif-plugged:6047b3aa-607c-4b10-904a-8497d9a2f82b for instance 652e59f0-b9be-4f45-bb79-2340d9564000 on user Apr 13 17:02:55 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-9e6661f0-208a-46fe-ab97-38a48490abd0 req-8a29b742-7454-40ed-b1b5-09845b2a0b5e service nova] Creating event network-vif-plugged:6047b3aa-607c-4b10-904a-8497d9a2f82b for instance 652e59f0-b9be-4f45-bb79-2340d9564000 on user Apr 13 17:02:55 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [req-9e6661f0-208a-46fe-ab97-38a48490abd0 req-8a29b742-7454-40ed-b1b5-09845b2a0b5e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.050299 Apr 13 17:02:55 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 367/1096] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:02:55 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:03:32 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_api:SELECT=14 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:03:32 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_cell1:SELECT=30 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:03:32 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-80942407-c1a2-40fe-9411-430680481c97 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:03:32 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-80942407-c1a2-40fe-9411-430680481c97 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: e101522a-965b-43da-9408-07e341a9103a] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:03:32 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-80942407-c1a2-40fe-9411-430680481c97 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:03:32 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-80942407-c1a2-40fe-9411-430680481c97 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:03:32 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-80942407-c1a2-40fe-9411-430680481c97 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:03:32 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-80942407-c1a2-40fe-9411-430680481c97 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:03:32 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-80942407-c1a2-40fe-9411-430680481c97 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:03:32 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-80942407-c1a2-40fe-9411-430680481c97 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:03:32 user devstack@n-api.service[62054]: INFO nova.api.openstack.wsgi [None req-80942407-c1a2-40fe-9411-430680481c97 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] HTTP exception thrown: Instance e101522a-965b-43da-9408-07e341a9103a could not be found. Apr 13 17:03:32 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-80942407-c1a2-40fe-9411-430680481c97 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Request method failure captured: Apr 13 17:03:32 user devstack@n-api.service[62054]: request: GET /compute/v2.1/servers/e101522a-965b-43da-9408-07e341a9103a HTTP/1.1 Apr 13 17:03:32 user devstack@n-api.service[62054]: Accept: application/json Apr 13 17:03:32 user devstack@n-api.service[62054]: Accept-Encoding: identity Apr 13 17:03:32 user devstack@n-api.service[62054]: Connection: close Apr 13 17:03:32 user devstack@n-api.service[62054]: Content-Length: 0 Apr 13 17:03:32 user devstack@n-api.service[62054]: Content-Type: application/json Apr 13 17:03:32 user devstack@n-api.service[62054]: Host: 10.0.0.210 Apr 13 17:03:32 user devstack@n-api.service[62054]: Openstack-System-Scope: None Apr 13 17:03:32 user devstack@n-api.service[62054]: User-Agent: python-urllib3/1.26.15 Apr 13 17:03:32 user devstack@n-api.service[62054]: X-Auth-Token: gAAAAABkODTDp_J_kOKBdnfqcv57bez4t7SdSp5UwD5DaWQ0e7zYTV516bQ2tGNSMsgSMmjRAeEnvh6eyS2dpIcxQ87aMcZmL4sydtZG6naQIt5z18MsjMDJtaVZWdqVQVJRdnFvavY9T2LJZWcSrFdkSSE2bAqoVJKrPExVvG6GOh-2JZvqC00 Apr 13 17:03:32 user devstack@n-api.service[62054]: X-Domain-Id: None Apr 13 17:03:32 user devstack@n-api.service[62054]: X-Domain-Name: None Apr 13 17:03:32 user devstack@n-api.service[62054]: X-Identity-Status: Confirmed Apr 13 17:03:32 user devstack@n-api.service[62054]: X-Is-Admin-Project: True Apr 13 17:03:32 user devstack@n-api.service[62054]: X-Project-Domain-Id: default Apr 13 17:03:32 user devstack@n-api.service[62054]: X-Project-Domain-Name: Default Apr 13 17:03:32 user devstack@n-api.service[62054]: X-Project-Id: 097b15faad8249c9bf45623d0c3ab518 Apr 13 17:03:32 user devstack@n-api.service[62054]: X-Project-Name: tempest-AttachVolumeNegativeTest-236067262 Apr 13 17:03:32 user devstack@n-api.service[62054]: X-Role: reader,member Apr 13 17:03:32 user devstack@n-api.service[62054]: X-Roles: reader,member Apr 13 17:03:32 user devstack@n-api.service[62054]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/097b15faad8249c9bf45623d0c3ab518"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/097b15faad8249c9bf45623d0c3ab518"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/097b15faad8249c9bf45623d0c3ab518"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 13 17:03:32 user devstack@n-api.service[62054]: X-Tenant: tempest-AttachVolumeNegativeTest-236067262 Apr 13 17:03:32 user devstack@n-api.service[62054]: X-Tenant-Id: 097b15faad8249c9bf45623d0c3ab518 Apr 13 17:03:32 user devstack@n-api.service[62054]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-236067262 Apr 13 17:03:32 user devstack@n-api.service[62054]: X-User: tempest-AttachVolumeNegativeTest-236067262-project-member Apr 13 17:03:32 user devstack@n-api.service[62054]: X-User-Domain-Id: default Apr 13 17:03:32 user devstack@n-api.service[62054]: X-User-Domain-Name: Default Apr 13 17:03:32 user devstack@n-api.service[62054]: X-User-Id: a08b0caad23045c1822cdd0b3ae0769f Apr 13 17:03:32 user devstack@n-api.service[62054]: X-User-Name: tempest-AttachVolumeNegativeTest-236067262-project-member Apr 13 17:03:32 user devstack@n-api.service[62054]: method: > Apr 13 17:03:32 user devstack@n-api.service[62054]: exception: Instance e101522a-965b-43da-9408-07e341a9103a could not be found. Apr 13 17:03:32 user devstack@n-api.service[62054]: action_args: {'id': 'e101522a-965b-43da-9408-07e341a9103a'} Apr 13 17:03:32 user devstack@n-api.service[62054]: {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 17:03:32 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:03:32 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 17:03:32 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 17:03:32 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 17:03:32 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 17:03:32 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 17:03:32 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 17:03:32 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 17:03:32 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 17:03:32 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e101522a-965b-43da-9408-07e341a9103a could not be found. Apr 13 17:03:32 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 17:03:32 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:03:32 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 17:03:32 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:03:32 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 17:03:32 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 17:03:32 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 17:03:32 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 17:03:32 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 17:03:32 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 17:03:32 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 17:03:32 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 17:03:32 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 17:03:32 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 17:03:32 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 17:03:32 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 17:03:32 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e101522a-965b-43da-9408-07e341a9103a could not be found. Apr 13 17:03:32 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 17:03:32 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:03:32 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 17:03:32 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:03:32 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 17:03:32 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 17:03:32 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 17:03:32 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 17:03:32 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e101522a-965b-43da-9408-07e341a9103a could not be found. Apr 13 17:03:32 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 17:03:32 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-80942407-c1a2-40fe-9411-430680481c97 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Returning 404 to user: Instance e101522a-965b-43da-9408-07e341a9103a could not be found. {{(pid=62054) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 17:03:32 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-80942407-c1a2-40fe-9411-430680481c97 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e101522a-965b-43da-9408-07e341a9103a" status: 404 len: 111 microversion: 2.1 time: 0.045994 Apr 13 17:03:32 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 366/1097] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:03:32 2023] GET /compute/v2.1/servers/e101522a-965b-43da-9408-07e341a9103a => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 17:03:32 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_api:SELECT=19,nova_api:UPDATE=1 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:03:32 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:03:32 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-8ca9c5b0-cf64-4338-ab97-401c87ec732a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Calling method '.version_select at 0x7f96dc6401f0>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:03:32 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-8ca9c5b0-cf64-4338-ab97-401c87ec732a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1663561865" status: 202 len: 0 microversion: 2.1 time: 0.046866 Apr 13 17:03:32 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 365/1098] 10.0.0.210 () {62 vars in 1298 bytes} [Thu Apr 13 17:03:32 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1663561865 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 17:03:32 user devstack@n-api.service[62053]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Apr 13 17:03:32 user devstack@n-api.service[62053]: Thu Apr 13 17:03:32 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c/os-volume_attachments/e13dd7bb-01d3-41fb-b768-048792640d52 (ip 10.0.0.210) !!! Apr 13 17:03:32 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_api:SELECT=16 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:03:32 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:03:32 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-2b0b8b64-5df5-43de-9908-06259785d76d tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:03:32 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-2b0b8b64-5df5-43de-9908-06259785d76d tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:03:32 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-2b0b8b64-5df5-43de-9908-06259785d76d tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:03:32 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-2b0b8b64-5df5-43de-9908-06259785d76d tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:03:32 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-2b0b8b64-5df5-43de-9908-06259785d76d tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:03:32 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-2b0b8b64-5df5-43de-9908-06259785d76d tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:03:32 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-2b0b8b64-5df5-43de-9908-06259785d76d tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:03:32 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-2b0b8b64-5df5-43de-9908-06259785d76d tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:03:32 user devstack@n-api.service[62053]: DEBUG nova.objects.instance [None req-2b0b8b64-5df5-43de-9908-06259785d76d tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lazy-loading 'services' on Instance uuid b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c {{(pid=62053) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 17:03:33 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-2b0b8b64-5df5-43de-9908-06259785d76d tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c/os-volume_attachments/e13dd7bb-01d3-41fb-b768-048792640d52" status: 202 len: 0 microversion: 2.1 time: 0.191895 Apr 13 17:03:33 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 368/1099] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 17:03:32 2023] DELETE /compute/v2.1/servers/b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c/os-volume_attachments/e13dd7bb-01d3-41fb-b768-048792640d52 => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 13 17:03:33 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-e7cf4ba4-4707-437d-978c-061898147f29 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:03:33 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-e7cf4ba4-4707-437d-978c-061898147f29 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:03:33 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-e7cf4ba4-4707-437d-978c-061898147f29 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:03:33 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-e7cf4ba4-4707-437d-978c-061898147f29 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:03:33 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-e7cf4ba4-4707-437d-978c-061898147f29 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:03:33 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-e7cf4ba4-4707-437d-978c-061898147f29 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:03:33 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-e7cf4ba4-4707-437d-978c-061898147f29 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:03:33 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-e7cf4ba4-4707-437d-978c-061898147f29 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:03:33 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-e7cf4ba4-4707-437d-978c-061898147f29 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050137 Apr 13 17:03:33 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 367/1100] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 17:03:33 2023] GET /compute/v2.1/servers/b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:03:38 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-ef5ced4c-0f96-4277-89f8-89e458e7563c tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:03:38 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-ef5ced4c-0f96-4277-89f8-89e458e7563c tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:03:38 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-ef5ced4c-0f96-4277-89f8-89e458e7563c tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:03:38 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-ef5ced4c-0f96-4277-89f8-89e458e7563c tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:03:38 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-ef5ced4c-0f96-4277-89f8-89e458e7563c tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:03:38 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-ef5ced4c-0f96-4277-89f8-89e458e7563c tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:03:38 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-ef5ced4c-0f96-4277-89f8-89e458e7563c tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:03:38 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-ef5ced4c-0f96-4277-89f8-89e458e7563c tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:03:39 user devstack@n-api.service[62055]: DEBUG nova.policy [None req-ef5ced4c-0f96-4277-89f8-89e458e7563c tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a450674d7046ae82f5dd182506c85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edf468527d84954a943bb4c1f7ff54d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62055) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:03:39 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-ef5ced4c-0f96-4277-89f8-89e458e7563c tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] 10.0.0.210 "GET /compute/v2.1/servers/652e59f0-b9be-4f45-bb79-2340d9564000" status: 200 len: 1748 microversion: 2.1 time: 0.172415 Apr 13 17:03:39 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 366/1101] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:03:38 2023] GET /compute/v2.1/servers/652e59f0-b9be-4f45-bb79-2340d9564000 => generated 1748 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:04:23 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_api:SELECT=2 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:04:23 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:04:23 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-25c8a5c7-f7c3-44be-9689-63f83486790d tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:04:23 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-25c8a5c7-f7c3-44be-9689-63f83486790d tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:04:23 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-25c8a5c7-f7c3-44be-9689-63f83486790d tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:04:23 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-25c8a5c7-f7c3-44be-9689-63f83486790d tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:04:23 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-25c8a5c7-f7c3-44be-9689-63f83486790d tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:04:23 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-25c8a5c7-f7c3-44be-9689-63f83486790d tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:04:23 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-25c8a5c7-f7c3-44be-9689-63f83486790d tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:04:23 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-25c8a5c7-f7c3-44be-9689-63f83486790d tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:04:23 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-25c8a5c7-f7c3-44be-9689-63f83486790d tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.124338 Apr 13 17:04:23 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 369/1102] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 17:04:23 2023] GET /compute/v2.1/servers/b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c/os-volume_attachments => generated 25 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 17:04:23 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-a4ec3d06-6499-4967-8c3b-444c9d4f04a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:04:23 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-a4ec3d06-6499-4967-8c3b-444c9d4f04a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:04:23 user devstack@n-api.service[62054]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d5f4f53d-a137-4628-9932-f3f71afa82e2] AMQP server on 10.0.0.210:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 13 17:04:23 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_api:SELECT=4 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:04:23 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_cell1:SELECT=8 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:04:23 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-a4ec3d06-6499-4967-8c3b-444c9d4f04a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:04:23 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-a4ec3d06-6499-4967-8c3b-444c9d4f04a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:04:23 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-a4ec3d06-6499-4967-8c3b-444c9d4f04a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:04:23 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-a4ec3d06-6499-4967-8c3b-444c9d4f04a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:04:23 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-a4ec3d06-6499-4967-8c3b-444c9d4f04a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:04:23 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-a4ec3d06-6499-4967-8c3b-444c9d4f04a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:04:23 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-a4ec3d06-6499-4967-8c3b-444c9d4f04a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c] Going to try to terminate instance {{(pid=62054) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 17:04:23 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-a4ec3d06-6499-4967-8c3b-444c9d4f04a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c" status: 204 len: 0 microversion: 2.1 time: 0.123654 Apr 13 17:04:23 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 368/1103] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 17:04:23 2023] DELETE /compute/v2.1/servers/b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 13 17:04:23 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_api:SELECT=5,nova_api:DELETE=1 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:04:23 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_cell1:SELECT=6 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:04:23 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-591c054f-1df4-4365-97af-d831d6c498a8 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:04:23 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-591c054f-1df4-4365-97af-d831d6c498a8 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:04:23 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-591c054f-1df4-4365-97af-d831d6c498a8 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:04:23 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-591c054f-1df4-4365-97af-d831d6c498a8 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:04:23 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-591c054f-1df4-4365-97af-d831d6c498a8 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:04:23 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-591c054f-1df4-4365-97af-d831d6c498a8 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:04:23 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-591c054f-1df4-4365-97af-d831d6c498a8 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:04:23 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-591c054f-1df4-4365-97af-d831d6c498a8 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:04:23 user devstack@n-api.service[62055]: DEBUG nova.policy [None req-591c054f-1df4-4365-97af-d831d6c498a8 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a08b0caad23045c1822cdd0b3ae0769f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097b15faad8249c9bf45623d0c3ab518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62055) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:04:23 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-591c054f-1df4-4365-97af-d831d6c498a8 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c" status: 200 len: 1667 microversion: 2.1 time: 0.194270 Apr 13 17:04:23 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 367/1104] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:04:23 2023] GET /compute/v2.1/servers/b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c => generated 1667 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:04:23 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-2adb3303-3538-46ee-9f11-b9f184300081 req-341a3028-c71a-4da3-96fb-da1476869611 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c", "name": "network-vif-unplugged", "status": "completed", "tag": "70f91af6-4a58-4b9d-a132-93537d398c24"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:04:23 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-2adb3303-3538-46ee-9f11-b9f184300081 req-341a3028-c71a-4da3-96fb-da1476869611 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:04:23 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-2adb3303-3538-46ee-9f11-b9f184300081 req-341a3028-c71a-4da3-96fb-da1476869611 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:04:23 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-2adb3303-3538-46ee-9f11-b9f184300081 req-341a3028-c71a-4da3-96fb-da1476869611 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:04:23 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-2adb3303-3538-46ee-9f11-b9f184300081 req-341a3028-c71a-4da3-96fb-da1476869611 service nova] Creating event network-vif-unplugged:70f91af6-4a58-4b9d-a132-93537d398c24 for instance b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c on user Apr 13 17:04:23 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [req-2adb3303-3538-46ee-9f11-b9f184300081 req-341a3028-c71a-4da3-96fb-da1476869611 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032787 Apr 13 17:04:23 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 370/1105] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:04:23 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:04:25 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-08aa17d1-1ec6-46f9-89e2-58fcbe4b60c2 req-abe812e4-f4a4-4f48-b094-6f8539c6dd3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c", "name": "network-vif-plugged", "status": "completed", "tag": "70f91af6-4a58-4b9d-a132-93537d398c24"}, {"server_uuid": "b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c", "name": "network-vif-deleted", "tag": "70f91af6-4a58-4b9d-a132-93537d398c24"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:04:25 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-08aa17d1-1ec6-46f9-89e2-58fcbe4b60c2 req-abe812e4-f4a4-4f48-b094-6f8539c6dd3d service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:04:25 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-08aa17d1-1ec6-46f9-89e2-58fcbe4b60c2 req-abe812e4-f4a4-4f48-b094-6f8539c6dd3d service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:04:25 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-08aa17d1-1ec6-46f9-89e2-58fcbe4b60c2 req-abe812e4-f4a4-4f48-b094-6f8539c6dd3d service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:04:25 user devstack@n-api.service[62054]: INFO oslo.messaging._drivers.impl_rabbit [-] [d5f4f53d-a137-4628-9932-f3f71afa82e2] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 34426. Apr 13 17:04:25 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-08aa17d1-1ec6-46f9-89e2-58fcbe4b60c2 req-abe812e4-f4a4-4f48-b094-6f8539c6dd3d service nova] Creating event network-vif-plugged:70f91af6-4a58-4b9d-a132-93537d398c24 for instance b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c on user Apr 13 17:04:25 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-08aa17d1-1ec6-46f9-89e2-58fcbe4b60c2 req-abe812e4-f4a4-4f48-b094-6f8539c6dd3d service nova] Creating event network-vif-deleted:70f91af6-4a58-4b9d-a132-93537d398c24 for instance b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c on user Apr 13 17:04:25 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [req-08aa17d1-1ec6-46f9-89e2-58fcbe4b60c2 req-abe812e4-f4a4-4f48-b094-6f8539c6dd3d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.033910 Apr 13 17:04:25 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 369/1106] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:04:25 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:04:39 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-f0b33e8c-15fc-46a9-9be5-baff234f591d tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1385929483"}} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:04:39 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-f0b33e8c-15fc-46a9-9be5-baff234f591d tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:04:39 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_api:SELECT=2 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:04:39 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_cell1:SELECT=6 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:04:39 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-f0b33e8c-15fc-46a9-9be5-baff234f591d tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:04:39 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-f0b33e8c-15fc-46a9-9be5-baff234f591d tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:04:39 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-f0b33e8c-15fc-46a9-9be5-baff234f591d tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:04:39 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-f0b33e8c-15fc-46a9-9be5-baff234f591d tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:04:39 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-f0b33e8c-15fc-46a9-9be5-baff234f591d tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:04:39 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-f0b33e8c-15fc-46a9-9be5-baff234f591d tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:04:39 user devstack@n-api.service[62055]: INFO nova.network.security_group_api [None req-f0b33e8c-15fc-46a9-9be5-baff234f591d tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Removing security group dfd17880-d2de-4078-a281-534db33c04ee from port 6047b3aa-607c-4b10-904a-8497d9a2f82b Apr 13 17:04:39 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-f0b33e8c-15fc-46a9-9be5-baff234f591d tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] 10.0.0.210 "POST /compute/v2.1/servers/652e59f0-b9be-4f45-bb79-2340d9564000/action" status: 202 len: 0 microversion: 2.1 time: 0.664133 Apr 13 17:04:39 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 368/1107] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 17:04:39 2023] POST /compute/v2.1/servers/652e59f0-b9be-4f45-bb79-2340d9564000/action => generated 0 bytes in 666 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 17:04:39 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_api:SELECT=4 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:04:39 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_cell1:SELECT=8 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:04:39 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-cb52e090-4660-4191-ad99-7e5377063a23 req-cdf38163-220f-4b03-8cc5-1585db9a41f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "652e59f0-b9be-4f45-bb79-2340d9564000", "tag": "6047b3aa-607c-4b10-904a-8497d9a2f82b"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:04:39 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-cb52e090-4660-4191-ad99-7e5377063a23 req-cdf38163-220f-4b03-8cc5-1585db9a41f9 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:04:39 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-cb52e090-4660-4191-ad99-7e5377063a23 req-cdf38163-220f-4b03-8cc5-1585db9a41f9 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:04:39 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-cb52e090-4660-4191-ad99-7e5377063a23 req-cdf38163-220f-4b03-8cc5-1585db9a41f9 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:04:39 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-cb52e090-4660-4191-ad99-7e5377063a23 req-cdf38163-220f-4b03-8cc5-1585db9a41f9 service nova] Creating event network-changed:6047b3aa-607c-4b10-904a-8497d9a2f82b for instance 652e59f0-b9be-4f45-bb79-2340d9564000 on user Apr 13 17:04:39 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [req-cb52e090-4660-4191-ad99-7e5377063a23 req-cdf38163-220f-4b03-8cc5-1585db9a41f9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036008 Apr 13 17:04:39 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 371/1108] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:04:39 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:04:40 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:04:40 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:04:40 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [req-0d3ac174-bcd6-468d-80dc-b95a3d009747 req-834502ba-9089-4531-8834-f3144839ecd2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "652e59f0-b9be-4f45-bb79-2340d9564000", "tag": "6047b3aa-607c-4b10-904a-8497d9a2f82b"}]} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:04:40 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-2c850e83-1929-4ab2-8560-08976bf75d0e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:04:40 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-2c850e83-1929-4ab2-8560-08976bf75d0e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:04:40 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-2c850e83-1929-4ab2-8560-08976bf75d0e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:04:40 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-2c850e83-1929-4ab2-8560-08976bf75d0e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:04:40 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-0d3ac174-bcd6-468d-80dc-b95a3d009747 req-834502ba-9089-4531-8834-f3144839ecd2 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:04:40 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-2c850e83-1929-4ab2-8560-08976bf75d0e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:04:40 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-0d3ac174-bcd6-468d-80dc-b95a3d009747 req-834502ba-9089-4531-8834-f3144839ecd2 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:04:40 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-2c850e83-1929-4ab2-8560-08976bf75d0e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:04:40 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-0d3ac174-bcd6-468d-80dc-b95a3d009747 req-834502ba-9089-4531-8834-f3144839ecd2 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:04:40 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-2c850e83-1929-4ab2-8560-08976bf75d0e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:04:40 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-2c850e83-1929-4ab2-8560-08976bf75d0e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:04:40 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-0d3ac174-bcd6-468d-80dc-b95a3d009747 req-834502ba-9089-4531-8834-f3144839ecd2 service nova] Creating event network-changed:6047b3aa-607c-4b10-904a-8497d9a2f82b for instance 652e59f0-b9be-4f45-bb79-2340d9564000 on user Apr 13 17:04:40 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [req-0d3ac174-bcd6-468d-80dc-b95a3d009747 req-834502ba-9089-4531-8834-f3144839ecd2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028615 Apr 13 17:04:40 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 369/1109] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:04:40 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:04:40 user devstack@n-api.service[62054]: DEBUG nova.objects.instance [None req-2c850e83-1929-4ab2-8560-08976bf75d0e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lazy-loading 'services' on Instance uuid 652e59f0-b9be-4f45-bb79-2340d9564000 {{(pid=62054) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 17:04:41 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-2c850e83-1929-4ab2-8560-08976bf75d0e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/652e59f0-b9be-4f45-bb79-2340d9564000/os-volume_attachments/db618723-a806-41ad-ade9-ea9a7ebbb110" status: 202 len: 0 microversion: 2.1 time: 0.237623 Apr 13 17:04:41 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 370/1110] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 17:04:40 2023] DELETE /compute/v2.1/servers/652e59f0-b9be-4f45-bb79-2340d9564000/os-volume_attachments/db618723-a806-41ad-ade9-ea9a7ebbb110 => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 17:04:41 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-5cd69793-9bc8-4a78-956d-9840b04d55b3 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:04:41 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-5cd69793-9bc8-4a78-956d-9840b04d55b3 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:04:41 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-5cd69793-9bc8-4a78-956d-9840b04d55b3 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:04:41 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-5cd69793-9bc8-4a78-956d-9840b04d55b3 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:04:41 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-5cd69793-9bc8-4a78-956d-9840b04d55b3 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:04:41 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-5cd69793-9bc8-4a78-956d-9840b04d55b3 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:04:41 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-5cd69793-9bc8-4a78-956d-9840b04d55b3 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:04:41 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-5cd69793-9bc8-4a78-956d-9840b04d55b3 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:04:41 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-5cd69793-9bc8-4a78-956d-9840b04d55b3 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] 10.0.0.210 "GET /compute/v2.1/servers/652e59f0-b9be-4f45-bb79-2340d9564000/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046544 Apr 13 17:04:41 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 372/1111] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 17:04:41 2023] GET /compute/v2.1/servers/652e59f0-b9be-4f45-bb79-2340d9564000/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:05:13 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_api:SELECT=4 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:05:13 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_cell1:SELECT=6 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:05:13 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-6b793508-6ce5-4039-a806-8052139e4293 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:05:13 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-6b793508-6ce5-4039-a806-8052139e4293 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:05:13 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-6b793508-6ce5-4039-a806-8052139e4293 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:05:13 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-6b793508-6ce5-4039-a806-8052139e4293 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:05:13 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-6b793508-6ce5-4039-a806-8052139e4293 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:05:13 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-6b793508-6ce5-4039-a806-8052139e4293 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:05:13 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-6b793508-6ce5-4039-a806-8052139e4293 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:05:13 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-6b793508-6ce5-4039-a806-8052139e4293 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:05:13 user devstack@n-api.service[62055]: INFO nova.api.openstack.wsgi [None req-6b793508-6ce5-4039-a806-8052139e4293 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] HTTP exception thrown: Instance b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c could not be found. Apr 13 17:05:13 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-6b793508-6ce5-4039-a806-8052139e4293 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Request method failure captured: Apr 13 17:05:13 user devstack@n-api.service[62055]: request: GET /compute/v2.1/servers/b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c HTTP/1.1 Apr 13 17:05:13 user devstack@n-api.service[62055]: Accept: application/json Apr 13 17:05:13 user devstack@n-api.service[62055]: Accept-Encoding: identity Apr 13 17:05:13 user devstack@n-api.service[62055]: Connection: close Apr 13 17:05:13 user devstack@n-api.service[62055]: Content-Length: 0 Apr 13 17:05:13 user devstack@n-api.service[62055]: Content-Type: application/json Apr 13 17:05:13 user devstack@n-api.service[62055]: Host: 10.0.0.210 Apr 13 17:05:13 user devstack@n-api.service[62055]: Openstack-System-Scope: None Apr 13 17:05:13 user devstack@n-api.service[62055]: User-Agent: python-urllib3/1.26.15 Apr 13 17:05:13 user devstack@n-api.service[62055]: X-Auth-Token: gAAAAABkODTDp_J_kOKBdnfqcv57bez4t7SdSp5UwD5DaWQ0e7zYTV516bQ2tGNSMsgSMmjRAeEnvh6eyS2dpIcxQ87aMcZmL4sydtZG6naQIt5z18MsjMDJtaVZWdqVQVJRdnFvavY9T2LJZWcSrFdkSSE2bAqoVJKrPExVvG6GOh-2JZvqC00 Apr 13 17:05:13 user devstack@n-api.service[62055]: X-Domain-Id: None Apr 13 17:05:13 user devstack@n-api.service[62055]: X-Domain-Name: None Apr 13 17:05:13 user devstack@n-api.service[62055]: X-Identity-Status: Confirmed Apr 13 17:05:13 user devstack@n-api.service[62055]: X-Is-Admin-Project: True Apr 13 17:05:13 user devstack@n-api.service[62055]: X-Project-Domain-Id: default Apr 13 17:05:13 user devstack@n-api.service[62055]: X-Project-Domain-Name: Default Apr 13 17:05:13 user devstack@n-api.service[62055]: X-Project-Id: 097b15faad8249c9bf45623d0c3ab518 Apr 13 17:05:13 user devstack@n-api.service[62055]: X-Project-Name: tempest-AttachVolumeNegativeTest-236067262 Apr 13 17:05:13 user devstack@n-api.service[62055]: X-Role: reader,member Apr 13 17:05:13 user devstack@n-api.service[62055]: X-Roles: reader,member Apr 13 17:05:13 user devstack@n-api.service[62055]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/097b15faad8249c9bf45623d0c3ab518"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/097b15faad8249c9bf45623d0c3ab518"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/097b15faad8249c9bf45623d0c3ab518"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 13 17:05:13 user devstack@n-api.service[62055]: X-Tenant: tempest-AttachVolumeNegativeTest-236067262 Apr 13 17:05:13 user devstack@n-api.service[62055]: X-Tenant-Id: 097b15faad8249c9bf45623d0c3ab518 Apr 13 17:05:13 user devstack@n-api.service[62055]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-236067262 Apr 13 17:05:13 user devstack@n-api.service[62055]: X-User: tempest-AttachVolumeNegativeTest-236067262-project-member Apr 13 17:05:13 user devstack@n-api.service[62055]: X-User-Domain-Id: default Apr 13 17:05:13 user devstack@n-api.service[62055]: X-User-Domain-Name: Default Apr 13 17:05:13 user devstack@n-api.service[62055]: X-User-Id: a08b0caad23045c1822cdd0b3ae0769f Apr 13 17:05:13 user devstack@n-api.service[62055]: X-User-Name: tempest-AttachVolumeNegativeTest-236067262-project-member Apr 13 17:05:13 user devstack@n-api.service[62055]: method: > Apr 13 17:05:13 user devstack@n-api.service[62055]: exception: Instance b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c could not be found. Apr 13 17:05:13 user devstack@n-api.service[62055]: action_args: {'id': 'b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c'} Apr 13 17:05:13 user devstack@n-api.service[62055]: {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 17:05:13 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:05:13 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 17:05:13 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 17:05:13 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 17:05:13 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 17:05:13 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 17:05:13 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 17:05:13 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 17:05:13 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 17:05:13 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c could not be found. Apr 13 17:05:13 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 17:05:13 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:05:13 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 17:05:13 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:05:13 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 17:05:13 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 17:05:13 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 17:05:13 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 17:05:13 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 17:05:13 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 17:05:13 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 17:05:13 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 17:05:13 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 17:05:13 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 17:05:13 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 17:05:13 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 17:05:13 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c could not be found. Apr 13 17:05:13 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 17:05:13 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:05:13 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 17:05:13 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:05:13 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 17:05:13 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 17:05:13 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 17:05:13 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 17:05:13 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c could not be found. Apr 13 17:05:13 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 17:05:13 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-6b793508-6ce5-4039-a806-8052139e4293 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Returning 404 to user: Instance b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c could not be found. {{(pid=62055) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 17:05:13 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-6b793508-6ce5-4039-a806-8052139e4293 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c" status: 404 len: 111 microversion: 2.1 time: 0.035132 Apr 13 17:05:13 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 370/1112] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:05:13 2023] GET /compute/v2.1/servers/b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 17:05:13 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_api:SELECT=2 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:05:13 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:05:13 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-2786601f-eae2-40a5-9bb5-098916b0e386 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Calling method '.version_select at 0x7f96e48496c0>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:05:13 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-2786601f-eae2-40a5-9bb5-098916b0e386 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-812505684" status: 202 len: 0 microversion: 2.1 time: 0.032411 Apr 13 17:05:13 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 371/1113] 10.0.0.210 () {62 vars in 1295 bytes} [Thu Apr 13 17:05:13 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-812505684 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 17:05:14 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-68b999f6-69e9-40fb-b94f-f57031eb173f tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Action: 'create', calling method: .version_select at 0x7f96e476dcf0>, body: {"keypair": {"name": "tempest-keypair-1795442799", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBESykv5tW83kHbwBGFQOvSCy+ICNt4W0TQ1jPtqTWGBoErb8Q7X135LOLGGhPK3SnAx4kT7bpNF/X4w5BBRqCpxWFXGF/m9Ir1Ke1mquI92zdi2E1wCJREcaMQNLTOTvVw=="}} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:05:14 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_api:SELECT=4 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:05:14 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_cell1:SELECT=8 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:05:14 user devstack@n-api.service[62053]: DEBUG nova.quota [None req-68b999f6-69e9-40fb-b94f-f57031eb173f tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Getting quotas for project 097b15faad8249c9bf45623d0c3ab518. Resources: {'key_pairs'} {{(pid=62053) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 17:05:14 user devstack@n-api.service[62053]: DEBUG nova.quota [None req-68b999f6-69e9-40fb-b94f-f57031eb173f tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Getting quotas for user a08b0caad23045c1822cdd0b3ae0769f and project 097b15faad8249c9bf45623d0c3ab518. Resources: {'key_pairs'} {{(pid=62053) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 17:05:14 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-68b999f6-69e9-40fb-b94f-f57031eb173f tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.056623 Apr 13 17:05:14 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 373/1114] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 13 17:05:14 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:05:15 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-9f0e305b-6ad7-4fcd-9abe-426524d791c7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2098457470", "imageRef": "708622a9-7465-4492-ade8-b827198f7e30", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "436011a9-c48b-4f33-a576-a245b344dd72"}], "security_groups": [{"name": "tempest-securitygroup--134683921"}], "key_name": "tempest-keypair-1795442799", "user_data": "}} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:05:15 user devstack@n-api.service[62055]: DEBUG nova.network.neutron [None req-9f0e305b-6ad7-4fcd-9abe-426524d791c7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] validate_networks() for [('436011a9-c48b-4f33-a576-a245b344dd72', None, None, None, None, None)] {{(pid=62055) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 17:05:16 user devstack@n-api.service[62055]: DEBUG nova.virt.hardware [None req-9f0e305b-6ad7-4fcd-9abe-426524d791c7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Flavor limits 0:0:0 {{(pid=62055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 17:05:16 user devstack@n-api.service[62055]: DEBUG nova.virt.hardware [None req-9f0e305b-6ad7-4fcd-9abe-426524d791c7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Image limits 0:0:0 {{(pid=62055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 17:05:16 user devstack@n-api.service[62055]: DEBUG nova.virt.hardware [None req-9f0e305b-6ad7-4fcd-9abe-426524d791c7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Flavor pref 0:0:0 {{(pid=62055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 17:05:16 user devstack@n-api.service[62055]: DEBUG nova.virt.hardware [None req-9f0e305b-6ad7-4fcd-9abe-426524d791c7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Image pref 0:0:0 {{(pid=62055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 17:05:16 user devstack@n-api.service[62055]: DEBUG nova.virt.hardware [None req-9f0e305b-6ad7-4fcd-9abe-426524d791c7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 17:05:16 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-9f0e305b-6ad7-4fcd-9abe-426524d791c7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:05:16 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-9f0e305b-6ad7-4fcd-9abe-426524d791c7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:05:16 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-9f0e305b-6ad7-4fcd-9abe-426524d791c7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:05:16 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-9f0e305b-6ad7-4fcd-9abe-426524d791c7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:05:16 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-9f0e305b-6ad7-4fcd-9abe-426524d791c7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:05:16 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-9f0e305b-6ad7-4fcd-9abe-426524d791c7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:05:16 user devstack@n-api.service[62055]: DEBUG nova.quota [None req-9f0e305b-6ad7-4fcd-9abe-426524d791c7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Getting quotas for project 097b15faad8249c9bf45623d0c3ab518. Resources: {'instances', 'cores', 'ram'} {{(pid=62055) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 17:05:16 user devstack@n-api.service[62055]: DEBUG nova.quota [None req-9f0e305b-6ad7-4fcd-9abe-426524d791c7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Getting quotas for user a08b0caad23045c1822cdd0b3ae0769f and project 097b15faad8249c9bf45623d0c3ab518. Resources: {'instances', 'cores', 'ram'} {{(pid=62055) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 17:05:16 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-9f0e305b-6ad7-4fcd-9abe-426524d791c7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Going to run 1 instances... {{(pid=62055) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 17:05:16 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-9f0e305b-6ad7-4fcd-9abe-426524d791c7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: ae339f64-b90f-4399-baa5-1ad1e5051593] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='708622a9-7465-4492-ade8-b827198f7e30',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=62055) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 17:05:16 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-9f0e305b-6ad7-4fcd-9abe-426524d791c7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 0.601627 Apr 13 17:05:16 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 371/1115] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 17:05:15 2023] POST /compute/v2.1/servers => generated 399 bytes in 603 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 17:05:16 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-485407eb-454a-42c3-8033-e80b5c7c3191 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:05:16 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-485407eb-454a-42c3-8033-e80b5c7c3191 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: ae339f64-b90f-4399-baa5-1ad1e5051593] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:05:16 user devstack@n-api.service[62054]: DEBUG nova.policy [None req-485407eb-454a-42c3-8033-e80b5c7c3191 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a08b0caad23045c1822cdd0b3ae0769f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097b15faad8249c9bf45623d0c3ab518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62054) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:05:16 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-485407eb-454a-42c3-8033-e80b5c7c3191 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ae339f64-b90f-4399-baa5-1ad1e5051593" status: 200 len: 1236 microversion: 2.1 time: 0.114087 Apr 13 17:05:16 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 372/1116] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:05:16 2023] GET /compute/v2.1/servers/ae339f64-b90f-4399-baa5-1ad1e5051593 => generated 1236 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:05:18 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-8e8e6ca1-c0b1-4cb7-9fc0-14a361f9001d req-55fbd175-8a98-4f8d-bbff-ff3375116021 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae339f64-b90f-4399-baa5-1ad1e5051593", "tag": "99071c3f-4bc5-47e9-9427-4ed6114e40a5"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:05:18 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-8e8e6ca1-c0b1-4cb7-9fc0-14a361f9001d req-55fbd175-8a98-4f8d-bbff-ff3375116021 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:05:18 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-8e8e6ca1-c0b1-4cb7-9fc0-14a361f9001d req-55fbd175-8a98-4f8d-bbff-ff3375116021 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:05:18 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-8e8e6ca1-c0b1-4cb7-9fc0-14a361f9001d req-55fbd175-8a98-4f8d-bbff-ff3375116021 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:05:18 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-8e8e6ca1-c0b1-4cb7-9fc0-14a361f9001d req-55fbd175-8a98-4f8d-bbff-ff3375116021 service nova] Creating event network-changed:99071c3f-4bc5-47e9-9427-4ed6114e40a5 for instance ae339f64-b90f-4399-baa5-1ad1e5051593 on user Apr 13 17:05:18 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [req-8e8e6ca1-c0b1-4cb7-9fc0-14a361f9001d req-55fbd175-8a98-4f8d-bbff-ff3375116021 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028808 Apr 13 17:05:18 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 374/1117] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:05:18 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:05:20 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [req-420fa94f-151c-4b5b-ab75-c3261ef580a3 req-0e313ded-45cf-45d2-9045-8fc010b22627 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae339f64-b90f-4399-baa5-1ad1e5051593", "name": "network-vif-plugged", "status": "completed", "tag": "99071c3f-4bc5-47e9-9427-4ed6114e40a5"}]} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:05:20 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-420fa94f-151c-4b5b-ab75-c3261ef580a3 req-0e313ded-45cf-45d2-9045-8fc010b22627 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:05:20 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-420fa94f-151c-4b5b-ab75-c3261ef580a3 req-0e313ded-45cf-45d2-9045-8fc010b22627 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:05:20 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-420fa94f-151c-4b5b-ab75-c3261ef580a3 req-0e313ded-45cf-45d2-9045-8fc010b22627 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:05:20 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-420fa94f-151c-4b5b-ab75-c3261ef580a3 req-0e313ded-45cf-45d2-9045-8fc010b22627 service nova] Creating event network-vif-plugged:99071c3f-4bc5-47e9-9427-4ed6114e40a5 for instance ae339f64-b90f-4399-baa5-1ad1e5051593 on user Apr 13 17:05:20 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [req-420fa94f-151c-4b5b-ab75-c3261ef580a3 req-0e313ded-45cf-45d2-9045-8fc010b22627 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038052 Apr 13 17:05:20 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 372/1118] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:05:20 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:05:22 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-8e1ae636-152f-4c7b-99a8-17eccfb0930c req-49a59fb0-4d9d-470f-89db-7f1855ec3860 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae339f64-b90f-4399-baa5-1ad1e5051593", "name": "network-vif-plugged", "status": "completed", "tag": "99071c3f-4bc5-47e9-9427-4ed6114e40a5"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:05:22 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-8e1ae636-152f-4c7b-99a8-17eccfb0930c req-49a59fb0-4d9d-470f-89db-7f1855ec3860 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:05:22 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-8e1ae636-152f-4c7b-99a8-17eccfb0930c req-49a59fb0-4d9d-470f-89db-7f1855ec3860 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:05:22 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-8e1ae636-152f-4c7b-99a8-17eccfb0930c req-49a59fb0-4d9d-470f-89db-7f1855ec3860 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:05:22 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-8e1ae636-152f-4c7b-99a8-17eccfb0930c req-49a59fb0-4d9d-470f-89db-7f1855ec3860 service nova] Creating event network-vif-plugged:99071c3f-4bc5-47e9-9427-4ed6114e40a5 for instance ae339f64-b90f-4399-baa5-1ad1e5051593 on user Apr 13 17:05:22 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [req-8e1ae636-152f-4c7b-99a8-17eccfb0930c req-49a59fb0-4d9d-470f-89db-7f1855ec3860 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033371 Apr 13 17:05:22 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 373/1119] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:05:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:05:31 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_cell0:SELECT=4 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:05:31 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=1 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:05:31 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_cell1:SELECT=2 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:05:31 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-bac70383-d5f4-4a49-a268-11eebde6b7a9 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:05:31 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-bac70383-d5f4-4a49-a268-11eebde6b7a9 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:05:31 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-bac70383-d5f4-4a49-a268-11eebde6b7a9 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:05:31 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-bac70383-d5f4-4a49-a268-11eebde6b7a9 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:05:31 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-bac70383-d5f4-4a49-a268-11eebde6b7a9 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:05:31 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-bac70383-d5f4-4a49-a268-11eebde6b7a9 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:05:31 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-bac70383-d5f4-4a49-a268-11eebde6b7a9 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:05:31 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-bac70383-d5f4-4a49-a268-11eebde6b7a9 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:05:31 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-bac70383-d5f4-4a49-a268-11eebde6b7a9 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] 10.0.0.210 "GET /compute/v2.1/servers/652e59f0-b9be-4f45-bb79-2340d9564000/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.067138 Apr 13 17:05:31 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 375/1120] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 17:05:31 2023] GET /compute/v2.1/servers/652e59f0-b9be-4f45-bb79-2340d9564000/os-volume_attachments => generated 25 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 17:05:31 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_cell0:SELECT=2 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:05:31 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_cell0:SELECT=6 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:05:31 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:05:31 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_cell1:SELECT=6 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:05:31 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-12e8606f-be06-467f-80ed-bfb4e49cc777 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:05:31 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-12e8606f-be06-467f-80ed-bfb4e49cc777 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:05:31 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-12e8606f-be06-467f-80ed-bfb4e49cc777 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:05:31 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-12e8606f-be06-467f-80ed-bfb4e49cc777 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:05:31 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-12e8606f-be06-467f-80ed-bfb4e49cc777 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:05:31 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-12e8606f-be06-467f-80ed-bfb4e49cc777 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:05:31 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-12e8606f-be06-467f-80ed-bfb4e49cc777 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:05:31 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-12e8606f-be06-467f-80ed-bfb4e49cc777 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:05:31 user devstack@n-api.service[62055]: INFO nova.api.openstack.wsgi [None req-12e8606f-be06-467f-80ed-bfb4e49cc777 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] HTTP exception thrown: Instance 652e59f0-b9be-4f45-bb79-2340d9564000 is not attached to volume db618723-a806-41ad-ade9-ea9a7ebbb110 Apr 13 17:05:31 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-12e8606f-be06-467f-80ed-bfb4e49cc777 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Request method failure captured: Apr 13 17:05:31 user devstack@n-api.service[62055]: request: DELETE /compute/v2.1/servers/652e59f0-b9be-4f45-bb79-2340d9564000/os-volume_attachments/db618723-a806-41ad-ade9-ea9a7ebbb110 HTTP/1.1 Apr 13 17:05:31 user devstack@n-api.service[62055]: Accept: application/json Apr 13 17:05:31 user devstack@n-api.service[62055]: Accept-Encoding: identity Apr 13 17:05:31 user devstack@n-api.service[62055]: Connection: close Apr 13 17:05:31 user devstack@n-api.service[62055]: Content-Length: 0 Apr 13 17:05:31 user devstack@n-api.service[62055]: Content-Type: application/json Apr 13 17:05:31 user devstack@n-api.service[62055]: Host: 10.0.0.210 Apr 13 17:05:31 user devstack@n-api.service[62055]: Openstack-System-Scope: None Apr 13 17:05:31 user devstack@n-api.service[62055]: User-Agent: python-urllib3/1.26.15 Apr 13 17:05:31 user devstack@n-api.service[62055]: X-Auth-Token: gAAAAABkODPVZkeqC78r2AGy79LSBx3fRrtpJlQEYWqdQv0kHqzTKfD040BAVw1Ts_OoFgw1yRX2IY3isBZjM91jXVkSN2VNuTwKVCRh4GCrHG232553q0rBQw_GIe18_OXNzLHCCx1Vq6yuQ4UZvddLINfXsS4quZAHEv300O1gXfeEUjGMJu4 Apr 13 17:05:31 user devstack@n-api.service[62055]: X-Domain-Id: None Apr 13 17:05:31 user devstack@n-api.service[62055]: X-Domain-Name: None Apr 13 17:05:31 user devstack@n-api.service[62055]: X-Identity-Status: Confirmed Apr 13 17:05:31 user devstack@n-api.service[62055]: X-Is-Admin-Project: True Apr 13 17:05:31 user devstack@n-api.service[62055]: X-Project-Domain-Id: default Apr 13 17:05:31 user devstack@n-api.service[62055]: X-Project-Domain-Name: Default Apr 13 17:05:31 user devstack@n-api.service[62055]: X-Project-Id: 7edf468527d84954a943bb4c1f7ff54d Apr 13 17:05:31 user devstack@n-api.service[62055]: X-Project-Name: tempest-TestMinimumBasicScenario-419032150 Apr 13 17:05:31 user devstack@n-api.service[62055]: X-Role: reader,member Apr 13 17:05:31 user devstack@n-api.service[62055]: X-Roles: reader,member Apr 13 17:05:31 user devstack@n-api.service[62055]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/7edf468527d84954a943bb4c1f7ff54d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7edf468527d84954a943bb4c1f7ff54d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7edf468527d84954a943bb4c1f7ff54d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 13 17:05:31 user devstack@n-api.service[62055]: X-Tenant: tempest-TestMinimumBasicScenario-419032150 Apr 13 17:05:31 user devstack@n-api.service[62055]: X-Tenant-Id: 7edf468527d84954a943bb4c1f7ff54d Apr 13 17:05:31 user devstack@n-api.service[62055]: X-Tenant-Name: tempest-TestMinimumBasicScenario-419032150 Apr 13 17:05:31 user devstack@n-api.service[62055]: X-User: tempest-TestMinimumBasicScenario-419032150-project-member Apr 13 17:05:31 user devstack@n-api.service[62055]: X-User-Domain-Id: default Apr 13 17:05:31 user devstack@n-api.service[62055]: X-User-Domain-Name: Default Apr 13 17:05:31 user devstack@n-api.service[62055]: X-User-Id: 91a450674d7046ae82f5dd182506c85b Apr 13 17:05:31 user devstack@n-api.service[62055]: X-User-Name: tempest-TestMinimumBasicScenario-419032150-project-member Apr 13 17:05:31 user devstack@n-api.service[62055]: method: > Apr 13 17:05:31 user devstack@n-api.service[62055]: exception: Instance 652e59f0-b9be-4f45-bb79-2340d9564000 is not attached to volume db618723-a806-41ad-ade9-ea9a7ebbb110 Apr 13 17:05:31 user devstack@n-api.service[62055]: action_args: {'server_id': '652e59f0-b9be-4f45-bb79-2340d9564000', 'id': 'db618723-a806-41ad-ade9-ea9a7ebbb110'} Apr 13 17:05:31 user devstack@n-api.service[62055]: {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 17:05:31 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:05:31 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Apr 13 17:05:31 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Apr 13 17:05:31 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Apr 13 17:05:31 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Apr 13 17:05:31 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Apr 13 17:05:31 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Apr 13 17:05:31 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id db618723-a806-41ad-ade9-ea9a7ebbb110. Apr 13 17:05:31 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 17:05:31 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:05:31 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 17:05:31 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:05:31 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 17:05:31 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 17:05:31 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 17:05:31 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 17:05:31 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 17:05:31 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 17:05:31 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Apr 13 17:05:31 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Apr 13 17:05:31 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 652e59f0-b9be-4f45-bb79-2340d9564000 is not attached to volume db618723-a806-41ad-ade9-ea9a7ebbb110 Apr 13 17:05:31 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 17:05:31 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:05:31 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 17:05:31 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:05:31 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 17:05:31 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 17:05:31 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 17:05:31 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 17:05:31 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 652e59f0-b9be-4f45-bb79-2340d9564000 is not attached to volume db618723-a806-41ad-ade9-ea9a7ebbb110 Apr 13 17:05:31 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 17:05:31 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-12e8606f-be06-467f-80ed-bfb4e49cc777 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Returning 404 to user: Instance 652e59f0-b9be-4f45-bb79-2340d9564000 is not attached to volume db618723-a806-41ad-ade9-ea9a7ebbb110 {{(pid=62055) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 17:05:31 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-12e8606f-be06-467f-80ed-bfb4e49cc777 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/652e59f0-b9be-4f45-bb79-2340d9564000/os-volume_attachments/db618723-a806-41ad-ade9-ea9a7ebbb110" status: 404 len: 154 microversion: 2.1 time: 0.137601 Apr 13 17:05:31 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 373/1121] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 17:05:31 2023] DELETE /compute/v2.1/servers/652e59f0-b9be-4f45-bb79-2340d9564000/os-volume_attachments/db618723-a806-41ad-ade9-ea9a7ebbb110 => generated 154 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 17:05:33 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_cell0:SELECT=2 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:05:33 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:05:33 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_cell1:SELECT=2 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:05:33 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-c98d7819-41c9-4bc9-9614-ba01bd7baadb tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:05:33 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-c98d7819-41c9-4bc9-9614-ba01bd7baadb tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:05:33 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-c98d7819-41c9-4bc9-9614-ba01bd7baadb tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:05:33 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-c98d7819-41c9-4bc9-9614-ba01bd7baadb tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:05:33 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-c98d7819-41c9-4bc9-9614-ba01bd7baadb tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:05:33 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-c98d7819-41c9-4bc9-9614-ba01bd7baadb tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:05:33 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-c98d7819-41c9-4bc9-9614-ba01bd7baadb tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:05:33 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-c98d7819-41c9-4bc9-9614-ba01bd7baadb tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:05:33 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-c98d7819-41c9-4bc9-9614-ba01bd7baadb tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] Going to try to terminate instance {{(pid=62054) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 17:05:33 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-c98d7819-41c9-4bc9-9614-ba01bd7baadb tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/652e59f0-b9be-4f45-bb79-2340d9564000" status: 204 len: 0 microversion: 2.1 time: 0.157894 Apr 13 17:05:33 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 374/1122] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 17:05:33 2023] DELETE /compute/v2.1/servers/652e59f0-b9be-4f45-bb79-2340d9564000 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 17:05:33 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-e554d72a-7c6f-494d-afd9-cec93f62ab8c tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:05:33 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-e554d72a-7c6f-494d-afd9-cec93f62ab8c tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:05:33 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-e554d72a-7c6f-494d-afd9-cec93f62ab8c tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:05:33 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-e554d72a-7c6f-494d-afd9-cec93f62ab8c tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:05:33 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-e554d72a-7c6f-494d-afd9-cec93f62ab8c tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:05:33 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-e554d72a-7c6f-494d-afd9-cec93f62ab8c tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:05:33 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-e554d72a-7c6f-494d-afd9-cec93f62ab8c tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:05:33 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-e554d72a-7c6f-494d-afd9-cec93f62ab8c tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:05:33 user devstack@n-api.service[62053]: DEBUG nova.policy [None req-e554d72a-7c6f-494d-afd9-cec93f62ab8c tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a450674d7046ae82f5dd182506c85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edf468527d84954a943bb4c1f7ff54d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62053) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:05:34 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-e554d72a-7c6f-494d-afd9-cec93f62ab8c tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] 10.0.0.210 "GET /compute/v2.1/servers/652e59f0-b9be-4f45-bb79-2340d9564000" status: 200 len: 1542 microversion: 2.1 time: 0.222742 Apr 13 17:05:34 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 376/1123] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:05:33 2023] GET /compute/v2.1/servers/652e59f0-b9be-4f45-bb79-2340d9564000 => generated 1542 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 13 17:05:34 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [req-ffca701b-49bf-4742-b099-df72883686bb req-9b4b4cb8-cb9f-4f70-9160-7e0cbd0f0f02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "652e59f0-b9be-4f45-bb79-2340d9564000", "name": "network-vif-unplugged", "status": "completed", "tag": "6047b3aa-607c-4b10-904a-8497d9a2f82b"}]} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:05:34 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-ffca701b-49bf-4742-b099-df72883686bb req-9b4b4cb8-cb9f-4f70-9160-7e0cbd0f0f02 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:05:34 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-ffca701b-49bf-4742-b099-df72883686bb req-9b4b4cb8-cb9f-4f70-9160-7e0cbd0f0f02 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:05:34 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-ffca701b-49bf-4742-b099-df72883686bb req-9b4b4cb8-cb9f-4f70-9160-7e0cbd0f0f02 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:05:34 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-ffca701b-49bf-4742-b099-df72883686bb req-9b4b4cb8-cb9f-4f70-9160-7e0cbd0f0f02 service nova] Creating event network-vif-unplugged:6047b3aa-607c-4b10-904a-8497d9a2f82b for instance 652e59f0-b9be-4f45-bb79-2340d9564000 on user Apr 13 17:05:34 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [req-ffca701b-49bf-4742-b099-df72883686bb req-9b4b4cb8-cb9f-4f70-9160-7e0cbd0f0f02 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029597 Apr 13 17:05:34 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 374/1124] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:05:34 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:05:35 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-3e9ca456-22fb-4a28-90e2-89f1562a9f2c req-ff47558d-15fd-4644-a804-11276dc0d54f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "652e59f0-b9be-4f45-bb79-2340d9564000", "name": "network-vif-deleted", "tag": "6047b3aa-607c-4b10-904a-8497d9a2f82b"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:05:35 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-3e9ca456-22fb-4a28-90e2-89f1562a9f2c req-ff47558d-15fd-4644-a804-11276dc0d54f service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:05:35 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-3e9ca456-22fb-4a28-90e2-89f1562a9f2c req-ff47558d-15fd-4644-a804-11276dc0d54f service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:05:35 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-3e9ca456-22fb-4a28-90e2-89f1562a9f2c req-ff47558d-15fd-4644-a804-11276dc0d54f service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:05:35 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-3e9ca456-22fb-4a28-90e2-89f1562a9f2c req-ff47558d-15fd-4644-a804-11276dc0d54f service nova] Creating event network-vif-deleted:6047b3aa-607c-4b10-904a-8497d9a2f82b for instance 652e59f0-b9be-4f45-bb79-2340d9564000 on user Apr 13 17:05:35 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [req-3e9ca456-22fb-4a28-90e2-89f1562a9f2c req-ff47558d-15fd-4644-a804-11276dc0d54f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102605 Apr 13 17:05:35 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 375/1125] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:05:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:05:36 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-6cecd3db-a697-4fd3-8510-70463e23b951 req-85b18e81-62e3-407b-b6fc-28c69f5b4d24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "652e59f0-b9be-4f45-bb79-2340d9564000", "name": "network-vif-plugged", "status": "completed", "tag": "6047b3aa-607c-4b10-904a-8497d9a2f82b"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:05:36 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-6cecd3db-a697-4fd3-8510-70463e23b951 req-85b18e81-62e3-407b-b6fc-28c69f5b4d24 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:05:36 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-6cecd3db-a697-4fd3-8510-70463e23b951 req-85b18e81-62e3-407b-b6fc-28c69f5b4d24 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:05:36 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-6cecd3db-a697-4fd3-8510-70463e23b951 req-85b18e81-62e3-407b-b6fc-28c69f5b4d24 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:05:36 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-6cecd3db-a697-4fd3-8510-70463e23b951 req-85b18e81-62e3-407b-b6fc-28c69f5b4d24 service nova] Creating event network-vif-plugged:6047b3aa-607c-4b10-904a-8497d9a2f82b for instance 652e59f0-b9be-4f45-bb79-2340d9564000 on user Apr 13 17:05:36 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [req-6cecd3db-a697-4fd3-8510-70463e23b951 req-85b18e81-62e3-407b-b6fc-28c69f5b4d24 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028860 Apr 13 17:05:36 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 377/1126] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:05:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:06:06 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_api:SELECT=4 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:06:06 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_cell1:SELECT=8 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:06:06 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-71ea17eb-9224-4749-8321-a1e57f941fdf tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:06:06 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-71ea17eb-9224-4749-8321-a1e57f941fdf tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: ae339f64-b90f-4399-baa5-1ad1e5051593] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:06:06 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-71ea17eb-9224-4749-8321-a1e57f941fdf tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:06:06 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-71ea17eb-9224-4749-8321-a1e57f941fdf tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:06:06 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-71ea17eb-9224-4749-8321-a1e57f941fdf tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:06:06 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-71ea17eb-9224-4749-8321-a1e57f941fdf tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:06:06 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-71ea17eb-9224-4749-8321-a1e57f941fdf tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:06:06 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-71ea17eb-9224-4749-8321-a1e57f941fdf tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:06:06 user devstack@n-api.service[62055]: DEBUG nova.policy [None req-71ea17eb-9224-4749-8321-a1e57f941fdf tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a08b0caad23045c1822cdd0b3ae0769f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097b15faad8249c9bf45623d0c3ab518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62055) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:06:06 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-71ea17eb-9224-4749-8321-a1e57f941fdf tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ae339f64-b90f-4399-baa5-1ad1e5051593" status: 200 len: 1544 microversion: 2.1 time: 0.166925 Apr 13 17:06:06 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 375/1127] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:06:06 2023] GET /compute/v2.1/servers/ae339f64-b90f-4399-baa5-1ad1e5051593 => generated 1544 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:06:24 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:06:24 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:06:24 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-21ad92aa-0ee6-4536-854f-40ec9f78a4de tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:06:24 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-21ad92aa-0ee6-4536-854f-40ec9f78a4de tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:06:24 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-21ad92aa-0ee6-4536-854f-40ec9f78a4de tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:06:24 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-21ad92aa-0ee6-4536-854f-40ec9f78a4de tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:06:24 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-21ad92aa-0ee6-4536-854f-40ec9f78a4de tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:06:24 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-21ad92aa-0ee6-4536-854f-40ec9f78a4de tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:06:24 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-21ad92aa-0ee6-4536-854f-40ec9f78a4de tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:06:24 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-21ad92aa-0ee6-4536-854f-40ec9f78a4de tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:06:24 user devstack@n-api.service[62054]: INFO nova.api.openstack.wsgi [None req-21ad92aa-0ee6-4536-854f-40ec9f78a4de tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] HTTP exception thrown: Instance 652e59f0-b9be-4f45-bb79-2340d9564000 could not be found. Apr 13 17:06:24 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-21ad92aa-0ee6-4536-854f-40ec9f78a4de tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Request method failure captured: Apr 13 17:06:24 user devstack@n-api.service[62054]: request: GET /compute/v2.1/servers/652e59f0-b9be-4f45-bb79-2340d9564000 HTTP/1.1 Apr 13 17:06:24 user devstack@n-api.service[62054]: Accept: application/json Apr 13 17:06:24 user devstack@n-api.service[62054]: Accept-Encoding: identity Apr 13 17:06:24 user devstack@n-api.service[62054]: Connection: close Apr 13 17:06:24 user devstack@n-api.service[62054]: Content-Length: 0 Apr 13 17:06:24 user devstack@n-api.service[62054]: Content-Type: application/json Apr 13 17:06:24 user devstack@n-api.service[62054]: Host: 10.0.0.210 Apr 13 17:06:24 user devstack@n-api.service[62054]: Openstack-System-Scope: None Apr 13 17:06:24 user devstack@n-api.service[62054]: User-Agent: python-urllib3/1.26.15 Apr 13 17:06:24 user devstack@n-api.service[62054]: X-Auth-Token: gAAAAABkODPVZkeqC78r2AGy79LSBx3fRrtpJlQEYWqdQv0kHqzTKfD040BAVw1Ts_OoFgw1yRX2IY3isBZjM91jXVkSN2VNuTwKVCRh4GCrHG232553q0rBQw_GIe18_OXNzLHCCx1Vq6yuQ4UZvddLINfXsS4quZAHEv300O1gXfeEUjGMJu4 Apr 13 17:06:24 user devstack@n-api.service[62054]: X-Domain-Id: None Apr 13 17:06:24 user devstack@n-api.service[62054]: X-Domain-Name: None Apr 13 17:06:24 user devstack@n-api.service[62054]: X-Identity-Status: Confirmed Apr 13 17:06:24 user devstack@n-api.service[62054]: X-Is-Admin-Project: True Apr 13 17:06:24 user devstack@n-api.service[62054]: X-Project-Domain-Id: default Apr 13 17:06:24 user devstack@n-api.service[62054]: X-Project-Domain-Name: Default Apr 13 17:06:24 user devstack@n-api.service[62054]: X-Project-Id: 7edf468527d84954a943bb4c1f7ff54d Apr 13 17:06:24 user devstack@n-api.service[62054]: X-Project-Name: tempest-TestMinimumBasicScenario-419032150 Apr 13 17:06:24 user devstack@n-api.service[62054]: X-Role: reader,member Apr 13 17:06:24 user devstack@n-api.service[62054]: X-Roles: reader,member Apr 13 17:06:24 user devstack@n-api.service[62054]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/7edf468527d84954a943bb4c1f7ff54d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7edf468527d84954a943bb4c1f7ff54d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7edf468527d84954a943bb4c1f7ff54d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 13 17:06:24 user devstack@n-api.service[62054]: X-Tenant: tempest-TestMinimumBasicScenario-419032150 Apr 13 17:06:24 user devstack@n-api.service[62054]: X-Tenant-Id: 7edf468527d84954a943bb4c1f7ff54d Apr 13 17:06:24 user devstack@n-api.service[62054]: X-Tenant-Name: tempest-TestMinimumBasicScenario-419032150 Apr 13 17:06:24 user devstack@n-api.service[62054]: X-User: tempest-TestMinimumBasicScenario-419032150-project-member Apr 13 17:06:24 user devstack@n-api.service[62054]: X-User-Domain-Id: default Apr 13 17:06:24 user devstack@n-api.service[62054]: X-User-Domain-Name: Default Apr 13 17:06:24 user devstack@n-api.service[62054]: X-User-Id: 91a450674d7046ae82f5dd182506c85b Apr 13 17:06:24 user devstack@n-api.service[62054]: X-User-Name: tempest-TestMinimumBasicScenario-419032150-project-member Apr 13 17:06:24 user devstack@n-api.service[62054]: method: > Apr 13 17:06:24 user devstack@n-api.service[62054]: exception: Instance 652e59f0-b9be-4f45-bb79-2340d9564000 could not be found. Apr 13 17:06:24 user devstack@n-api.service[62054]: action_args: {'id': '652e59f0-b9be-4f45-bb79-2340d9564000'} Apr 13 17:06:24 user devstack@n-api.service[62054]: {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 17:06:24 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:06:24 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 17:06:24 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 17:06:24 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 17:06:24 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 17:06:24 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 17:06:24 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 17:06:24 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 17:06:24 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 17:06:24 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 652e59f0-b9be-4f45-bb79-2340d9564000 could not be found. Apr 13 17:06:24 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 17:06:24 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:06:24 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 17:06:24 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:06:24 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 17:06:24 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 17:06:24 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 17:06:24 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 17:06:24 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 17:06:24 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 17:06:24 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 17:06:24 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 17:06:24 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 17:06:24 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 17:06:24 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 17:06:24 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 17:06:24 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 652e59f0-b9be-4f45-bb79-2340d9564000 could not be found. Apr 13 17:06:24 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 17:06:24 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:06:24 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 17:06:24 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:06:24 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 17:06:24 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 17:06:24 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 17:06:24 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 17:06:24 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 652e59f0-b9be-4f45-bb79-2340d9564000 could not be found. Apr 13 17:06:24 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 17:06:24 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-21ad92aa-0ee6-4536-854f-40ec9f78a4de tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Returning 404 to user: Instance 652e59f0-b9be-4f45-bb79-2340d9564000 could not be found. {{(pid=62054) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 17:06:24 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-21ad92aa-0ee6-4536-854f-40ec9f78a4de tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] 10.0.0.210 "GET /compute/v2.1/servers/652e59f0-b9be-4f45-bb79-2340d9564000" status: 404 len: 111 microversion: 2.1 time: 0.155627 Apr 13 17:06:24 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 376/1128] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:06:24 2023] GET /compute/v2.1/servers/652e59f0-b9be-4f45-bb79-2340d9564000 => generated 111 bytes in 158 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 17:06:24 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_api:SELECT=6 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:06:24 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_cell1:SELECT=14 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:06:24 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-73906bb7-0581-4e07-ade8-7431a43ac5d4 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Calling method '.version_select at 0x7f96e476e830>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:06:24 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-73906bb7-0581-4e07-ade8-7431a43ac5d4 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-646311077" status: 202 len: 0 microversion: 2.1 time: 0.029346 Apr 13 17:06:24 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 378/1129] 10.0.0.210 () {62 vars in 1346 bytes} [Thu Apr 13 17:06:24 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-646311077 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 17:07:06 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_api:SELECT=2 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:07:06 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_cell1:SELECT=6 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:07:06 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-f37b34a1-717a-4aed-90f3-ad9a2aee89d3 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:07:06 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-f37b34a1-717a-4aed-90f3-ad9a2aee89d3 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: ae339f64-b90f-4399-baa5-1ad1e5051593] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:07:06 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-f37b34a1-717a-4aed-90f3-ad9a2aee89d3 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:07:06 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-f37b34a1-717a-4aed-90f3-ad9a2aee89d3 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:07:06 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-f37b34a1-717a-4aed-90f3-ad9a2aee89d3 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:07:06 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-f37b34a1-717a-4aed-90f3-ad9a2aee89d3 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:07:06 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-f37b34a1-717a-4aed-90f3-ad9a2aee89d3 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:07:06 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-f37b34a1-717a-4aed-90f3-ad9a2aee89d3 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:07:06 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-f37b34a1-717a-4aed-90f3-ad9a2aee89d3 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ae339f64-b90f-4399-baa5-1ad1e5051593/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.106175 Apr 13 17:07:06 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 376/1130] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 13 17:07:06 2023] GET /compute/v2.1/servers/ae339f64-b90f-4399-baa5-1ad1e5051593/os-interface => generated 282 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:07:07 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-6e270420-2b4c-47f8-a288-12690d8c082e req-448d1d5b-3d1e-43e5-bf2f-7df7cb9cd226 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae339f64-b90f-4399-baa5-1ad1e5051593", "tag": "99071c3f-4bc5-47e9-9427-4ed6114e40a5"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:07:07 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_api:SELECT=2 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:07:07 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_cell1:SELECT=2 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:07:07 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-6e270420-2b4c-47f8-a288-12690d8c082e req-448d1d5b-3d1e-43e5-bf2f-7df7cb9cd226 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:07:07 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-6e270420-2b4c-47f8-a288-12690d8c082e req-448d1d5b-3d1e-43e5-bf2f-7df7cb9cd226 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:07:07 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-6e270420-2b4c-47f8-a288-12690d8c082e req-448d1d5b-3d1e-43e5-bf2f-7df7cb9cd226 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:07:07 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-6e270420-2b4c-47f8-a288-12690d8c082e req-448d1d5b-3d1e-43e5-bf2f-7df7cb9cd226 service nova] Creating event network-changed:99071c3f-4bc5-47e9-9427-4ed6114e40a5 for instance ae339f64-b90f-4399-baa5-1ad1e5051593 on user Apr 13 17:07:07 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [req-6e270420-2b4c-47f8-a288-12690d8c082e req-448d1d5b-3d1e-43e5-bf2f-7df7cb9cd226 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045404 Apr 13 17:07:07 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 377/1131] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:07:07 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:07:07 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:07:07 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-2fbec383-fa1e-43c7-8bf7-35e129b11458 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:07:07 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-2fbec383-fa1e-43c7-8bf7-35e129b11458 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: ae339f64-b90f-4399-baa5-1ad1e5051593] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:07:07 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-2fbec383-fa1e-43c7-8bf7-35e129b11458 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:07:07 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-2fbec383-fa1e-43c7-8bf7-35e129b11458 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:07:07 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-2fbec383-fa1e-43c7-8bf7-35e129b11458 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:07:07 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-2fbec383-fa1e-43c7-8bf7-35e129b11458 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:07:07 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-2fbec383-fa1e-43c7-8bf7-35e129b11458 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:07:07 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-2fbec383-fa1e-43c7-8bf7-35e129b11458 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:07:07 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-2fbec383-fa1e-43c7-8bf7-35e129b11458 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ae339f64-b90f-4399-baa5-1ad1e5051593/ips" status: 200 len: 107 microversion: 2.1 time: 0.043318 Apr 13 17:07:07 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 379/1132] 10.0.0.210 () {62 vars in 1325 bytes} [Thu Apr 13 17:07:07 2023] GET /compute/v2.1/servers/ae339f64-b90f-4399-baa5-1ad1e5051593/ips => generated 107 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:07:09 user devstack@n-api.service[62055]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1f6f28ed-4fbb-48ba-87c1-2347dda4f253] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 13 17:07:09 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-c9b9675a-edc7-4a61-96e2-3a284ebaaa60 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "47665adf-cb34-4b24-9861-fc5bfbff2127"}} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:07:09 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-c9b9675a-edc7-4a61-96e2-3a284ebaaa60 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: ae339f64-b90f-4399-baa5-1ad1e5051593] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:07:09 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-c9b9675a-edc7-4a61-96e2-3a284ebaaa60 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:07:09 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-c9b9675a-edc7-4a61-96e2-3a284ebaaa60 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:07:09 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-c9b9675a-edc7-4a61-96e2-3a284ebaaa60 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:07:09 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-c9b9675a-edc7-4a61-96e2-3a284ebaaa60 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:07:09 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-c9b9675a-edc7-4a61-96e2-3a284ebaaa60 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:07:09 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-c9b9675a-edc7-4a61-96e2-3a284ebaaa60 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:07:10 user devstack@n-api.service[62055]: INFO oslo.messaging._drivers.impl_rabbit [-] [1f6f28ed-4fbb-48ba-87c1-2347dda4f253] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 38624. Apr 13 17:07:10 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-c9b9675a-edc7-4a61-96e2-3a284ebaaa60 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] 10.0.0.210 "POST /compute/v2.1/servers/ae339f64-b90f-4399-baa5-1ad1e5051593/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.129421 Apr 13 17:07:10 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 377/1133] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 17:07:09 2023] POST /compute/v2.1/servers/ae339f64-b90f-4399-baa5-1ad1e5051593/os-volume_attachments => generated 194 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:07:19 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_api:SELECT=2 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:07:19 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_cell1:SELECT=2 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:07:19 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-18ba6842-102f-4572-a590-664fddb2968e tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "47665adf-cb34-4b24-9861-fc5bfbff2127"}} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:07:19 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-18ba6842-102f-4572-a590-664fddb2968e tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: ae339f64-b90f-4399-baa5-1ad1e5051593] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:07:19 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-18ba6842-102f-4572-a590-664fddb2968e tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:07:19 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-18ba6842-102f-4572-a590-664fddb2968e tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:07:19 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-18ba6842-102f-4572-a590-664fddb2968e tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:07:19 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-18ba6842-102f-4572-a590-664fddb2968e tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:07:19 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-18ba6842-102f-4572-a590-664fddb2968e tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:07:19 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-18ba6842-102f-4572-a590-664fddb2968e tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:07:19 user devstack@n-api.service[62054]: INFO nova.api.openstack.wsgi [None req-18ba6842-102f-4572-a590-664fddb2968e tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] HTTP exception thrown: Invalid volume: volume 47665adf-cb34-4b24-9861-fc5bfbff2127 is already attached to instances: ae339f64-b90f-4399-baa5-1ad1e5051593 Apr 13 17:07:19 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-18ba6842-102f-4572-a590-664fddb2968e tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Request method failure captured: Apr 13 17:07:19 user devstack@n-api.service[62054]: request: POST /compute/v2.1/servers/ae339f64-b90f-4399-baa5-1ad1e5051593/os-volume_attachments HTTP/1.1 Apr 13 17:07:19 user devstack@n-api.service[62054]: Accept: application/json Apr 13 17:07:19 user devstack@n-api.service[62054]: Accept-Encoding: identity Apr 13 17:07:19 user devstack@n-api.service[62054]: Connection: close Apr 13 17:07:19 user devstack@n-api.service[62054]: Content-Length: 74 Apr 13 17:07:19 user devstack@n-api.service[62054]: Content-Type: application/json Apr 13 17:07:19 user devstack@n-api.service[62054]: Host: 10.0.0.210 Apr 13 17:07:19 user devstack@n-api.service[62054]: Openstack-System-Scope: None Apr 13 17:07:19 user devstack@n-api.service[62054]: User-Agent: python-urllib3/1.26.15 Apr 13 17:07:19 user devstack@n-api.service[62054]: X-Auth-Token: gAAAAABkODTDp_J_kOKBdnfqcv57bez4t7SdSp5UwD5DaWQ0e7zYTV516bQ2tGNSMsgSMmjRAeEnvh6eyS2dpIcxQ87aMcZmL4sydtZG6naQIt5z18MsjMDJtaVZWdqVQVJRdnFvavY9T2LJZWcSrFdkSSE2bAqoVJKrPExVvG6GOh-2JZvqC00 Apr 13 17:07:19 user devstack@n-api.service[62054]: X-Domain-Id: None Apr 13 17:07:19 user devstack@n-api.service[62054]: X-Domain-Name: None Apr 13 17:07:19 user devstack@n-api.service[62054]: X-Identity-Status: Confirmed Apr 13 17:07:19 user devstack@n-api.service[62054]: X-Is-Admin-Project: True Apr 13 17:07:19 user devstack@n-api.service[62054]: X-Project-Domain-Id: default Apr 13 17:07:19 user devstack@n-api.service[62054]: X-Project-Domain-Name: Default Apr 13 17:07:19 user devstack@n-api.service[62054]: X-Project-Id: 097b15faad8249c9bf45623d0c3ab518 Apr 13 17:07:19 user devstack@n-api.service[62054]: X-Project-Name: tempest-AttachVolumeNegativeTest-236067262 Apr 13 17:07:19 user devstack@n-api.service[62054]: X-Role: reader,member Apr 13 17:07:19 user devstack@n-api.service[62054]: X-Roles: reader,member Apr 13 17:07:19 user devstack@n-api.service[62054]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/097b15faad8249c9bf45623d0c3ab518"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/097b15faad8249c9bf45623d0c3ab518"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/097b15faad8249c9bf45623d0c3ab518"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 13 17:07:19 user devstack@n-api.service[62054]: X-Tenant: tempest-AttachVolumeNegativeTest-236067262 Apr 13 17:07:19 user devstack@n-api.service[62054]: X-Tenant-Id: 097b15faad8249c9bf45623d0c3ab518 Apr 13 17:07:19 user devstack@n-api.service[62054]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-236067262 Apr 13 17:07:19 user devstack@n-api.service[62054]: X-User: tempest-AttachVolumeNegativeTest-236067262-project-member Apr 13 17:07:19 user devstack@n-api.service[62054]: X-User-Domain-Id: default Apr 13 17:07:19 user devstack@n-api.service[62054]: X-User-Domain-Name: Default Apr 13 17:07:19 user devstack@n-api.service[62054]: X-User-Id: a08b0caad23045c1822cdd0b3ae0769f Apr 13 17:07:19 user devstack@n-api.service[62054]: X-User-Name: tempest-AttachVolumeNegativeTest-236067262-project-member Apr 13 17:07:19 user devstack@n-api.service[62054]: Apr 13 17:07:19 user devstack@n-api.service[62054]: {"volumeAttachment": {"volumeId": "47665adf-cb34-4b24-9861-fc5bfbff2127"}} Apr 13 17:07:19 user devstack@n-api.service[62054]: method: > Apr 13 17:07:19 user devstack@n-api.service[62054]: exception: Invalid volume: volume 47665adf-cb34-4b24-9861-fc5bfbff2127 is already attached to instances: ae339f64-b90f-4399-baa5-1ad1e5051593 Apr 13 17:07:19 user devstack@n-api.service[62054]: action_args: {'server_id': 'ae339f64-b90f-4399-baa5-1ad1e5051593', 'body': {'volumeAttachment': {'volumeId': '47665adf-cb34-4b24-9861-fc5bfbff2127'}}} Apr 13 17:07:19 user devstack@n-api.service[62054]: {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 17:07:19 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:07:19 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Apr 13 17:07:19 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Apr 13 17:07:19 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 13 17:07:19 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 13 17:07:19 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Apr 13 17:07:19 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Apr 13 17:07:19 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5139, in attach_volume Apr 13 17:07:19 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Apr 13 17:07:19 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4979, in _check_volume_already_attached Apr 13 17:07:19 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Apr 13 17:07:19 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 47665adf-cb34-4b24-9861-fc5bfbff2127 is already attached to instances: ae339f64-b90f-4399-baa5-1ad1e5051593 Apr 13 17:07:19 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 17:07:19 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:07:19 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 17:07:19 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:07:19 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 17:07:19 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 17:07:19 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 17:07:19 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 17:07:19 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 17:07:19 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 17:07:19 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 13 17:07:19 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 17:07:19 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 13 17:07:19 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 17:07:19 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 13 17:07:19 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 17:07:19 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Apr 13 17:07:19 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Apr 13 17:07:19 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 47665adf-cb34-4b24-9861-fc5bfbff2127 is already attached to instances: ae339f64-b90f-4399-baa5-1ad1e5051593 Apr 13 17:07:19 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 17:07:19 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:07:19 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 17:07:19 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:07:19 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 17:07:19 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 17:07:19 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 17:07:19 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 17:07:19 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 47665adf-cb34-4b24-9861-fc5bfbff2127 is already attached to instances: ae339f64-b90f-4399-baa5-1ad1e5051593 Apr 13 17:07:19 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 17:07:19 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-18ba6842-102f-4572-a590-664fddb2968e tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Returning 400 to user: Invalid volume: volume 47665adf-cb34-4b24-9861-fc5bfbff2127 is already attached to instances: ae339f64-b90f-4399-baa5-1ad1e5051593 {{(pid=62054) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 17:07:19 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-18ba6842-102f-4572-a590-664fddb2968e tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] 10.0.0.210 "POST /compute/v2.1/servers/ae339f64-b90f-4399-baa5-1ad1e5051593/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.110413 Apr 13 17:07:19 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 378/1134] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 17:07:19 2023] POST /compute/v2.1/servers/ae339f64-b90f-4399-baa5-1ad1e5051593/os-volume_attachments => generated 174 bytes in 113 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 13 17:07:19 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_api:SELECT=2 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:07:19 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_cell1:SELECT=4 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:07:19 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-c99a00cc-6388-4ffb-a97b-3187676755ff tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:07:19 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-c99a00cc-6388-4ffb-a97b-3187676755ff tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: ae339f64-b90f-4399-baa5-1ad1e5051593] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:07:19 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-c99a00cc-6388-4ffb-a97b-3187676755ff tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:07:19 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-c99a00cc-6388-4ffb-a97b-3187676755ff tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:07:19 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-c99a00cc-6388-4ffb-a97b-3187676755ff tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:07:19 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-c99a00cc-6388-4ffb-a97b-3187676755ff tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:07:19 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-c99a00cc-6388-4ffb-a97b-3187676755ff tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:07:19 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-c99a00cc-6388-4ffb-a97b-3187676755ff tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:07:19 user devstack@n-api.service[62053]: DEBUG nova.objects.instance [None req-c99a00cc-6388-4ffb-a97b-3187676755ff tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lazy-loading 'services' on Instance uuid ae339f64-b90f-4399-baa5-1ad1e5051593 {{(pid=62053) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 17:07:19 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-c99a00cc-6388-4ffb-a97b-3187676755ff tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ae339f64-b90f-4399-baa5-1ad1e5051593/os-volume_attachments/47665adf-cb34-4b24-9861-fc5bfbff2127" status: 202 len: 0 microversion: 2.1 time: 0.164930 Apr 13 17:07:19 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 380/1135] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 17:07:19 2023] DELETE /compute/v2.1/servers/ae339f64-b90f-4399-baa5-1ad1e5051593/os-volume_attachments/47665adf-cb34-4b24-9861-fc5bfbff2127 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 17:07:19 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_api:SELECT=4 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:07:19 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-4db8e657-2f1c-4ef0-9be7-daf3452d4e33 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:07:19 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-4db8e657-2f1c-4ef0-9be7-daf3452d4e33 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: ae339f64-b90f-4399-baa5-1ad1e5051593] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:07:19 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-4db8e657-2f1c-4ef0-9be7-daf3452d4e33 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:07:19 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-4db8e657-2f1c-4ef0-9be7-daf3452d4e33 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:07:19 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-4db8e657-2f1c-4ef0-9be7-daf3452d4e33 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:07:19 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-4db8e657-2f1c-4ef0-9be7-daf3452d4e33 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:07:19 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-4db8e657-2f1c-4ef0-9be7-daf3452d4e33 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:07:19 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-4db8e657-2f1c-4ef0-9be7-daf3452d4e33 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:07:19 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-4db8e657-2f1c-4ef0-9be7-daf3452d4e33 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ae339f64-b90f-4399-baa5-1ad1e5051593/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050572 Apr 13 17:07:19 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 378/1136] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 17:07:19 2023] GET /compute/v2.1/servers/ae339f64-b90f-4399-baa5-1ad1e5051593/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:08:09 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-7f29b6c1-5bce-47e9-9b8d-7996d95a24e2 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:08:09 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-7f29b6c1-5bce-47e9-9b8d-7996d95a24e2 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: ae339f64-b90f-4399-baa5-1ad1e5051593] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:08:09 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_api:SELECT=2 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:08:09 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_cell1:SELECT=6 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:08:09 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-7f29b6c1-5bce-47e9-9b8d-7996d95a24e2 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:08:09 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-7f29b6c1-5bce-47e9-9b8d-7996d95a24e2 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:08:09 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-7f29b6c1-5bce-47e9-9b8d-7996d95a24e2 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:08:09 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-7f29b6c1-5bce-47e9-9b8d-7996d95a24e2 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:08:09 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-7f29b6c1-5bce-47e9-9b8d-7996d95a24e2 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:08:09 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-7f29b6c1-5bce-47e9-9b8d-7996d95a24e2 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:08:09 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-7f29b6c1-5bce-47e9-9b8d-7996d95a24e2 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ae339f64-b90f-4399-baa5-1ad1e5051593/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051005 Apr 13 17:08:09 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 379/1137] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 17:08:09 2023] GET /compute/v2.1/servers/ae339f64-b90f-4399-baa5-1ad1e5051593/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 17:08:09 user devstack@n-api.service[62053]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 13 17:08:09 user devstack@n-api.service[62053]: Thu Apr 13 17:08:09 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ae339f64-b90f-4399-baa5-1ad1e5051593 (ip 10.0.0.210) !!! Apr 13 17:08:09 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_api:SELECT=2 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:08:09 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:08:09 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-a851162d-f7b9-447f-9c8a-c15c81076b07 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:08:09 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-a851162d-f7b9-447f-9c8a-c15c81076b07 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: ae339f64-b90f-4399-baa5-1ad1e5051593] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:08:09 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-a851162d-f7b9-447f-9c8a-c15c81076b07 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:08:09 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-a851162d-f7b9-447f-9c8a-c15c81076b07 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:08:09 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-a851162d-f7b9-447f-9c8a-c15c81076b07 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:08:09 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-a851162d-f7b9-447f-9c8a-c15c81076b07 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:08:09 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-a851162d-f7b9-447f-9c8a-c15c81076b07 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:08:09 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-a851162d-f7b9-447f-9c8a-c15c81076b07 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:08:09 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-a851162d-f7b9-447f-9c8a-c15c81076b07 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: ae339f64-b90f-4399-baa5-1ad1e5051593] Going to try to terminate instance {{(pid=62053) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 17:08:09 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-a851162d-f7b9-447f-9c8a-c15c81076b07 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ae339f64-b90f-4399-baa5-1ad1e5051593" status: 204 len: 0 microversion: 2.1 time: 0.127278 Apr 13 17:08:09 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 381/1138] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 17:08:09 2023] DELETE /compute/v2.1/servers/ae339f64-b90f-4399-baa5-1ad1e5051593 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 17:08:09 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-3d0ac8b8-284c-45a3-926f-300d200bd60c tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:08:09 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-3d0ac8b8-284c-45a3-926f-300d200bd60c tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: ae339f64-b90f-4399-baa5-1ad1e5051593] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:08:09 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_api:SELECT=2 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:08:09 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:08:09 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-3d0ac8b8-284c-45a3-926f-300d200bd60c tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:08:09 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-3d0ac8b8-284c-45a3-926f-300d200bd60c tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:08:09 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-3d0ac8b8-284c-45a3-926f-300d200bd60c tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:08:09 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-3d0ac8b8-284c-45a3-926f-300d200bd60c tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:08:09 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-3d0ac8b8-284c-45a3-926f-300d200bd60c tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:08:09 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-3d0ac8b8-284c-45a3-926f-300d200bd60c tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:08:10 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-28b793e0-30b2-4cbb-96d5-4f355cb0009b req-273727ae-e5d0-4d87-abc4-ac2aa17b1ad4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae339f64-b90f-4399-baa5-1ad1e5051593", "name": "network-vif-unplugged", "status": "completed", "tag": "99071c3f-4bc5-47e9-9427-4ed6114e40a5"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:08:10 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-28b793e0-30b2-4cbb-96d5-4f355cb0009b req-273727ae-e5d0-4d87-abc4-ac2aa17b1ad4 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:08:10 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-28b793e0-30b2-4cbb-96d5-4f355cb0009b req-273727ae-e5d0-4d87-abc4-ac2aa17b1ad4 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:08:10 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-28b793e0-30b2-4cbb-96d5-4f355cb0009b req-273727ae-e5d0-4d87-abc4-ac2aa17b1ad4 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:08:10 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-28b793e0-30b2-4cbb-96d5-4f355cb0009b req-273727ae-e5d0-4d87-abc4-ac2aa17b1ad4 service nova] Creating event network-vif-unplugged:99071c3f-4bc5-47e9-9427-4ed6114e40a5 for instance ae339f64-b90f-4399-baa5-1ad1e5051593 on user Apr 13 17:08:10 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [req-28b793e0-30b2-4cbb-96d5-4f355cb0009b req-273727ae-e5d0-4d87-abc4-ac2aa17b1ad4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.092769 Apr 13 17:08:10 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 380/1139] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:08:10 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:08:10 user devstack@n-api.service[62055]: DEBUG nova.policy [None req-3d0ac8b8-284c-45a3-926f-300d200bd60c tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a08b0caad23045c1822cdd0b3ae0769f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097b15faad8249c9bf45623d0c3ab518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62055) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:08:10 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-3d0ac8b8-284c-45a3-926f-300d200bd60c tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ae339f64-b90f-4399-baa5-1ad1e5051593" status: 200 len: 1669 microversion: 2.1 time: 0.446521 Apr 13 17:08:10 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 379/1140] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:08:09 2023] GET /compute/v2.1/servers/ae339f64-b90f-4399-baa5-1ad1e5051593 => generated 1669 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:08:11 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-625382f6-299d-4b64-b5ac-2de005a6554f req-08087bcb-1fbb-4ec4-823c-f2bb512e2dd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae339f64-b90f-4399-baa5-1ad1e5051593", "name": "network-vif-deleted", "tag": "99071c3f-4bc5-47e9-9427-4ed6114e40a5"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:08:11 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-625382f6-299d-4b64-b5ac-2de005a6554f req-08087bcb-1fbb-4ec4-823c-f2bb512e2dd0 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:08:11 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-625382f6-299d-4b64-b5ac-2de005a6554f req-08087bcb-1fbb-4ec4-823c-f2bb512e2dd0 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:08:11 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-625382f6-299d-4b64-b5ac-2de005a6554f req-08087bcb-1fbb-4ec4-823c-f2bb512e2dd0 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:08:11 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-625382f6-299d-4b64-b5ac-2de005a6554f req-08087bcb-1fbb-4ec4-823c-f2bb512e2dd0 service nova] Creating event network-vif-deleted:99071c3f-4bc5-47e9-9427-4ed6114e40a5 for instance ae339f64-b90f-4399-baa5-1ad1e5051593 on user Apr 13 17:08:11 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [req-625382f6-299d-4b64-b5ac-2de005a6554f req-08087bcb-1fbb-4ec4-823c-f2bb512e2dd0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078625 Apr 13 17:08:11 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 382/1141] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:08:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:08:12 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-37fce6d3-6ab0-46bb-9358-7efa6bba9891 req-260f898e-767a-49da-b751-d6b23671c4b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae339f64-b90f-4399-baa5-1ad1e5051593", "name": "network-vif-plugged", "status": "completed", "tag": "99071c3f-4bc5-47e9-9427-4ed6114e40a5"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:08:12 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-37fce6d3-6ab0-46bb-9358-7efa6bba9891 req-260f898e-767a-49da-b751-d6b23671c4b0 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:08:12 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-37fce6d3-6ab0-46bb-9358-7efa6bba9891 req-260f898e-767a-49da-b751-d6b23671c4b0 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:08:12 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-37fce6d3-6ab0-46bb-9358-7efa6bba9891 req-260f898e-767a-49da-b751-d6b23671c4b0 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:08:12 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-37fce6d3-6ab0-46bb-9358-7efa6bba9891 req-260f898e-767a-49da-b751-d6b23671c4b0 service nova] Creating event network-vif-plugged:99071c3f-4bc5-47e9-9427-4ed6114e40a5 for instance ae339f64-b90f-4399-baa5-1ad1e5051593 on user Apr 13 17:08:12 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [req-37fce6d3-6ab0-46bb-9358-7efa6bba9891 req-260f898e-767a-49da-b751-d6b23671c4b0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028250 Apr 13 17:08:12 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 381/1142] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:08:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:09:00 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-afced8c5-901d-439e-b1cb-e55af8bfb79d tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:09:00 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-afced8c5-901d-439e-b1cb-e55af8bfb79d tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: ae339f64-b90f-4399-baa5-1ad1e5051593] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:09:00 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_api:SELECT=2 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:09:00 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_cell1:SELECT=6 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:09:00 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-afced8c5-901d-439e-b1cb-e55af8bfb79d tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:09:00 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-afced8c5-901d-439e-b1cb-e55af8bfb79d tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:09:00 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-afced8c5-901d-439e-b1cb-e55af8bfb79d tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:09:00 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-afced8c5-901d-439e-b1cb-e55af8bfb79d tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:09:00 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-afced8c5-901d-439e-b1cb-e55af8bfb79d tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:09:00 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-afced8c5-901d-439e-b1cb-e55af8bfb79d tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:09:00 user devstack@n-api.service[62055]: INFO nova.api.openstack.wsgi [None req-afced8c5-901d-439e-b1cb-e55af8bfb79d tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] HTTP exception thrown: Instance ae339f64-b90f-4399-baa5-1ad1e5051593 could not be found. Apr 13 17:09:00 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-afced8c5-901d-439e-b1cb-e55af8bfb79d tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Request method failure captured: Apr 13 17:09:00 user devstack@n-api.service[62055]: request: GET /compute/v2.1/servers/ae339f64-b90f-4399-baa5-1ad1e5051593 HTTP/1.1 Apr 13 17:09:00 user devstack@n-api.service[62055]: Accept: application/json Apr 13 17:09:00 user devstack@n-api.service[62055]: Accept-Encoding: identity Apr 13 17:09:00 user devstack@n-api.service[62055]: Connection: close Apr 13 17:09:00 user devstack@n-api.service[62055]: Content-Length: 0 Apr 13 17:09:00 user devstack@n-api.service[62055]: Content-Type: application/json Apr 13 17:09:00 user devstack@n-api.service[62055]: Host: 10.0.0.210 Apr 13 17:09:00 user devstack@n-api.service[62055]: Openstack-System-Scope: None Apr 13 17:09:00 user devstack@n-api.service[62055]: User-Agent: python-urllib3/1.26.15 Apr 13 17:09:00 user devstack@n-api.service[62055]: X-Auth-Token: gAAAAABkODTDp_J_kOKBdnfqcv57bez4t7SdSp5UwD5DaWQ0e7zYTV516bQ2tGNSMsgSMmjRAeEnvh6eyS2dpIcxQ87aMcZmL4sydtZG6naQIt5z18MsjMDJtaVZWdqVQVJRdnFvavY9T2LJZWcSrFdkSSE2bAqoVJKrPExVvG6GOh-2JZvqC00 Apr 13 17:09:00 user devstack@n-api.service[62055]: X-Domain-Id: None Apr 13 17:09:00 user devstack@n-api.service[62055]: X-Domain-Name: None Apr 13 17:09:00 user devstack@n-api.service[62055]: X-Identity-Status: Confirmed Apr 13 17:09:00 user devstack@n-api.service[62055]: X-Is-Admin-Project: True Apr 13 17:09:00 user devstack@n-api.service[62055]: X-Project-Domain-Id: default Apr 13 17:09:00 user devstack@n-api.service[62055]: X-Project-Domain-Name: Default Apr 13 17:09:00 user devstack@n-api.service[62055]: X-Project-Id: 097b15faad8249c9bf45623d0c3ab518 Apr 13 17:09:00 user devstack@n-api.service[62055]: X-Project-Name: tempest-AttachVolumeNegativeTest-236067262 Apr 13 17:09:00 user devstack@n-api.service[62055]: X-Role: reader,member Apr 13 17:09:00 user devstack@n-api.service[62055]: X-Roles: reader,member Apr 13 17:09:00 user devstack@n-api.service[62055]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/097b15faad8249c9bf45623d0c3ab518"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/097b15faad8249c9bf45623d0c3ab518"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/097b15faad8249c9bf45623d0c3ab518"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 13 17:09:00 user devstack@n-api.service[62055]: X-Tenant: tempest-AttachVolumeNegativeTest-236067262 Apr 13 17:09:00 user devstack@n-api.service[62055]: X-Tenant-Id: 097b15faad8249c9bf45623d0c3ab518 Apr 13 17:09:00 user devstack@n-api.service[62055]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-236067262 Apr 13 17:09:00 user devstack@n-api.service[62055]: X-User: tempest-AttachVolumeNegativeTest-236067262-project-member Apr 13 17:09:00 user devstack@n-api.service[62055]: X-User-Domain-Id: default Apr 13 17:09:00 user devstack@n-api.service[62055]: X-User-Domain-Name: Default Apr 13 17:09:00 user devstack@n-api.service[62055]: X-User-Id: a08b0caad23045c1822cdd0b3ae0769f Apr 13 17:09:00 user devstack@n-api.service[62055]: X-User-Name: tempest-AttachVolumeNegativeTest-236067262-project-member Apr 13 17:09:00 user devstack@n-api.service[62055]: method: > Apr 13 17:09:00 user devstack@n-api.service[62055]: exception: Instance ae339f64-b90f-4399-baa5-1ad1e5051593 could not be found. Apr 13 17:09:00 user devstack@n-api.service[62055]: action_args: {'id': 'ae339f64-b90f-4399-baa5-1ad1e5051593'} Apr 13 17:09:00 user devstack@n-api.service[62055]: {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 17:09:00 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:09:00 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 17:09:00 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 17:09:00 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 17:09:00 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 17:09:00 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 17:09:00 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 17:09:00 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 17:09:00 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 17:09:00 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae339f64-b90f-4399-baa5-1ad1e5051593 could not be found. Apr 13 17:09:00 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 17:09:00 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:09:00 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 17:09:00 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:09:00 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 17:09:00 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 17:09:00 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 17:09:00 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 17:09:00 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 17:09:00 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 17:09:00 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 17:09:00 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 17:09:00 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 17:09:00 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 17:09:00 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 17:09:00 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 17:09:00 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae339f64-b90f-4399-baa5-1ad1e5051593 could not be found. Apr 13 17:09:00 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 17:09:00 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:09:00 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 17:09:00 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:09:00 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 17:09:00 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 17:09:00 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 17:09:00 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 17:09:00 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae339f64-b90f-4399-baa5-1ad1e5051593 could not be found. Apr 13 17:09:00 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 17:09:00 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-afced8c5-901d-439e-b1cb-e55af8bfb79d tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Returning 404 to user: Instance ae339f64-b90f-4399-baa5-1ad1e5051593 could not be found. {{(pid=62055) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 17:09:00 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-afced8c5-901d-439e-b1cb-e55af8bfb79d tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ae339f64-b90f-4399-baa5-1ad1e5051593" status: 404 len: 111 microversion: 2.1 time: 0.039323 Apr 13 17:09:00 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 380/1143] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:09:00 2023] GET /compute/v2.1/servers/ae339f64-b90f-4399-baa5-1ad1e5051593 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 17:09:00 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:09:00 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:09:00 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-57993bcd-2a43-4ed9-a532-dc73e518418b tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Calling method '.version_select at 0x7f96e476d870>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:09:00 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-57993bcd-2a43-4ed9-a532-dc73e518418b tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1795442799" status: 202 len: 0 microversion: 2.1 time: 0.032080 Apr 13 17:09:00 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 383/1144] 10.0.0.210 () {62 vars in 1298 bytes} [Thu Apr 13 17:09:00 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1795442799 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 17:09:01 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_api:SELECT=6 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:09:01 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_cell1:SELECT=10 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:09:01 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-8c293198-4f20-4e2c-8d02-c32f5d1ccfaf tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Action: 'create', calling method: .version_select at 0x7f96e4a62cb0>, body: {"keypair": {"name": "tempest-keypair-2430711", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHK5m7Tr/L5xNhw8mdMAAfBNwQrKi89BUKKxv/AyZXy9Tih9SzklM7CxsnO9Se5bUauoKDHV/YfrTQT7muTX50AFrDBdfPUfTS+ehRBh3U+r4X+sbYEOrWSfhAmnmh7paA=="}} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:09:01 user devstack@n-api.service[62054]: DEBUG nova.quota [None req-8c293198-4f20-4e2c-8d02-c32f5d1ccfaf tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Getting quotas for project 097b15faad8249c9bf45623d0c3ab518. Resources: {'key_pairs'} {{(pid=62054) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 17:09:01 user devstack@n-api.service[62054]: DEBUG nova.quota [None req-8c293198-4f20-4e2c-8d02-c32f5d1ccfaf tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Getting quotas for user a08b0caad23045c1822cdd0b3ae0769f and project 097b15faad8249c9bf45623d0c3ab518. Resources: {'key_pairs'} {{(pid=62054) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 17:09:01 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-8c293198-4f20-4e2c-8d02-c32f5d1ccfaf tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 383 microversion: 2.1 time: 0.052158 Apr 13 17:09:01 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 382/1145] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 13 17:09:01 2023] POST /compute/v2.1/os-keypairs => generated 383 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:09:02 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-a2271a36-0d45-4be0-8c6a-ac7178904d5a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-325520329", "imageRef": "708622a9-7465-4492-ade8-b827198f7e30", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "436011a9-c48b-4f33-a576-a245b344dd72"}], "security_groups": [{"name": "tempest-securitygroup--1181010782"}], "key_name": "tempest-keypair-2430711", "user_data": "}} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:09:02 user devstack@n-api.service[62055]: DEBUG nova.network.neutron [None req-a2271a36-0d45-4be0-8c6a-ac7178904d5a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] validate_networks() for [('436011a9-c48b-4f33-a576-a245b344dd72', None, None, None, None, None)] {{(pid=62055) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 17:09:03 user devstack@n-api.service[62055]: DEBUG nova.virt.hardware [None req-a2271a36-0d45-4be0-8c6a-ac7178904d5a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Flavor limits 0:0:0 {{(pid=62055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 17:09:03 user devstack@n-api.service[62055]: DEBUG nova.virt.hardware [None req-a2271a36-0d45-4be0-8c6a-ac7178904d5a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Image limits 0:0:0 {{(pid=62055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 17:09:03 user devstack@n-api.service[62055]: DEBUG nova.virt.hardware [None req-a2271a36-0d45-4be0-8c6a-ac7178904d5a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Flavor pref 0:0:0 {{(pid=62055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 17:09:03 user devstack@n-api.service[62055]: DEBUG nova.virt.hardware [None req-a2271a36-0d45-4be0-8c6a-ac7178904d5a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Image pref 0:0:0 {{(pid=62055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 17:09:03 user devstack@n-api.service[62055]: DEBUG nova.virt.hardware [None req-a2271a36-0d45-4be0-8c6a-ac7178904d5a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=62055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 17:09:03 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-a2271a36-0d45-4be0-8c6a-ac7178904d5a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:09:03 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-a2271a36-0d45-4be0-8c6a-ac7178904d5a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:09:03 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-a2271a36-0d45-4be0-8c6a-ac7178904d5a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:09:03 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-a2271a36-0d45-4be0-8c6a-ac7178904d5a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:09:03 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-a2271a36-0d45-4be0-8c6a-ac7178904d5a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:09:03 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-a2271a36-0d45-4be0-8c6a-ac7178904d5a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:09:03 user devstack@n-api.service[62055]: DEBUG nova.quota [None req-a2271a36-0d45-4be0-8c6a-ac7178904d5a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Getting quotas for project 097b15faad8249c9bf45623d0c3ab518. Resources: {'instances', 'cores', 'ram'} {{(pid=62055) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 17:09:03 user devstack@n-api.service[62055]: DEBUG nova.quota [None req-a2271a36-0d45-4be0-8c6a-ac7178904d5a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Getting quotas for user a08b0caad23045c1822cdd0b3ae0769f and project 097b15faad8249c9bf45623d0c3ab518. Resources: {'instances', 'cores', 'ram'} {{(pid=62055) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 17:09:03 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-a2271a36-0d45-4be0-8c6a-ac7178904d5a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Going to run 1 instances... {{(pid=62055) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 17:09:03 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-a2271a36-0d45-4be0-8c6a-ac7178904d5a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: f8829c88-70e9-43fb-97b0-d7f46e1de0ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='708622a9-7465-4492-ade8-b827198f7e30',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=62055) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 17:09:03 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-a2271a36-0d45-4be0-8c6a-ac7178904d5a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.576136 Apr 13 17:09:03 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 381/1146] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 17:09:02 2023] POST /compute/v2.1/servers => generated 400 bytes in 577 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 17:09:03 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-91b3663d-58c6-4b11-898a-15d562880601 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:09:03 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-91b3663d-58c6-4b11-898a-15d562880601 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: f8829c88-70e9-43fb-97b0-d7f46e1de0ae] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:09:03 user devstack@n-api.service[62053]: DEBUG nova.policy [None req-91b3663d-58c6-4b11-898a-15d562880601 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a08b0caad23045c1822cdd0b3ae0769f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097b15faad8249c9bf45623d0c3ab518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62053) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:09:03 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-91b3663d-58c6-4b11-898a-15d562880601 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f8829c88-70e9-43fb-97b0-d7f46e1de0ae" status: 200 len: 1232 microversion: 2.1 time: 0.117261 Apr 13 17:09:03 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 384/1147] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:09:03 2023] GET /compute/v2.1/servers/f8829c88-70e9-43fb-97b0-d7f46e1de0ae => generated 1232 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:09:05 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [req-6877908a-b0a9-4b8b-9c76-7769574955e2 req-6bb19238-440a-4dca-84a8-8959c567d644 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8829c88-70e9-43fb-97b0-d7f46e1de0ae", "tag": "fb551510-e993-47ad-b0d1-63c0b5845056"}]} {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:09:05 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-6877908a-b0a9-4b8b-9c76-7769574955e2 req-6bb19238-440a-4dca-84a8-8959c567d644 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:09:05 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-6877908a-b0a9-4b8b-9c76-7769574955e2 req-6bb19238-440a-4dca-84a8-8959c567d644 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:09:05 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [req-6877908a-b0a9-4b8b-9c76-7769574955e2 req-6bb19238-440a-4dca-84a8-8959c567d644 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:09:05 user devstack@n-api.service[62054]: INFO nova.api.openstack.compute.server_external_events [req-6877908a-b0a9-4b8b-9c76-7769574955e2 req-6bb19238-440a-4dca-84a8-8959c567d644 service nova] Creating event network-changed:fb551510-e993-47ad-b0d1-63c0b5845056 for instance f8829c88-70e9-43fb-97b0-d7f46e1de0ae on user Apr 13 17:09:05 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [req-6877908a-b0a9-4b8b-9c76-7769574955e2 req-6bb19238-440a-4dca-84a8-8959c567d644 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029001 Apr 13 17:09:05 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 383/1148] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:09:05 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:09:07 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [req-d2665886-404a-4e82-939a-d225f8c47df9 req-acc7c3d6-1efd-44d0-bbdb-65f83cf1f517 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8829c88-70e9-43fb-97b0-d7f46e1de0ae", "name": "network-vif-plugged", "status": "completed", "tag": "fb551510-e993-47ad-b0d1-63c0b5845056"}]} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:09:07 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-d2665886-404a-4e82-939a-d225f8c47df9 req-acc7c3d6-1efd-44d0-bbdb-65f83cf1f517 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:09:07 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-d2665886-404a-4e82-939a-d225f8c47df9 req-acc7c3d6-1efd-44d0-bbdb-65f83cf1f517 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:09:07 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-d2665886-404a-4e82-939a-d225f8c47df9 req-acc7c3d6-1efd-44d0-bbdb-65f83cf1f517 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:09:07 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-d2665886-404a-4e82-939a-d225f8c47df9 req-acc7c3d6-1efd-44d0-bbdb-65f83cf1f517 service nova] Creating event network-vif-plugged:fb551510-e993-47ad-b0d1-63c0b5845056 for instance f8829c88-70e9-43fb-97b0-d7f46e1de0ae on user Apr 13 17:09:07 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [req-d2665886-404a-4e82-939a-d225f8c47df9 req-acc7c3d6-1efd-44d0-bbdb-65f83cf1f517 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034967 Apr 13 17:09:07 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 382/1149] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:09:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:09:09 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-82427e8c-d317-4b47-94c6-78427ba1399b req-4fb42b2e-f0f0-4a43-baf7-e5841cbdd4e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8829c88-70e9-43fb-97b0-d7f46e1de0ae", "name": "network-vif-plugged", "status": "completed", "tag": "fb551510-e993-47ad-b0d1-63c0b5845056"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:09:09 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-82427e8c-d317-4b47-94c6-78427ba1399b req-4fb42b2e-f0f0-4a43-baf7-e5841cbdd4e9 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:09:09 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-82427e8c-d317-4b47-94c6-78427ba1399b req-4fb42b2e-f0f0-4a43-baf7-e5841cbdd4e9 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:09:09 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-82427e8c-d317-4b47-94c6-78427ba1399b req-4fb42b2e-f0f0-4a43-baf7-e5841cbdd4e9 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:09:09 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-82427e8c-d317-4b47-94c6-78427ba1399b req-4fb42b2e-f0f0-4a43-baf7-e5841cbdd4e9 service nova] Creating event network-vif-plugged:fb551510-e993-47ad-b0d1-63c0b5845056 for instance f8829c88-70e9-43fb-97b0-d7f46e1de0ae on user Apr 13 17:09:09 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [req-82427e8c-d317-4b47-94c6-78427ba1399b req-4fb42b2e-f0f0-4a43-baf7-e5841cbdd4e9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028356 Apr 13 17:09:09 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 385/1150] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:09:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:09:53 user devstack@n-api.service[62054]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d5f4f53d-a137-4628-9932-f3f71afa82e2] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 13 17:09:53 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_cell0:SELECT=4 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:09:53 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=1 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:09:53 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_cell1:SELECT=2 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:09:53 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-4362a849-28cb-498a-82d4-7f882bb57851 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:09:53 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-4362a849-28cb-498a-82d4-7f882bb57851 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: f8829c88-70e9-43fb-97b0-d7f46e1de0ae] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:09:53 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-4362a849-28cb-498a-82d4-7f882bb57851 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:09:53 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-4362a849-28cb-498a-82d4-7f882bb57851 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:09:53 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-4362a849-28cb-498a-82d4-7f882bb57851 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:09:53 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-4362a849-28cb-498a-82d4-7f882bb57851 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:09:53 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-4362a849-28cb-498a-82d4-7f882bb57851 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:09:53 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-4362a849-28cb-498a-82d4-7f882bb57851 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:09:53 user devstack@n-api.service[62054]: DEBUG nova.policy [None req-4362a849-28cb-498a-82d4-7f882bb57851 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a08b0caad23045c1822cdd0b3ae0769f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097b15faad8249c9bf45623d0c3ab518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62054) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:09:53 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-4362a849-28cb-498a-82d4-7f882bb57851 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f8829c88-70e9-43fb-97b0-d7f46e1de0ae" status: 200 len: 1542 microversion: 2.1 time: 0.232668 Apr 13 17:09:53 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 384/1151] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:09:53 2023] GET /compute/v2.1/servers/f8829c88-70e9-43fb-97b0-d7f46e1de0ae => generated 1542 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:10:53 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_cell0:SELECT=2 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:10:53 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_cell0:SELECT=6 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:10:53 user devstack@n-api.service[62055]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 13 17:10:53 user devstack@n-api.service[62055]: Thu Apr 13 17:10:53 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f8829c88-70e9-43fb-97b0-d7f46e1de0ae/os-interface (ip 10.0.0.210) !!! Apr 13 17:10:53 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:10:53 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_cell1:SELECT=6 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:10:53 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-413c9beb-c977-480c-8d60-aa5252692e7d tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:10:53 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-413c9beb-c977-480c-8d60-aa5252692e7d tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: f8829c88-70e9-43fb-97b0-d7f46e1de0ae] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:10:53 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-413c9beb-c977-480c-8d60-aa5252692e7d tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:10:53 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-413c9beb-c977-480c-8d60-aa5252692e7d tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:10:53 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-413c9beb-c977-480c-8d60-aa5252692e7d tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:10:53 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-413c9beb-c977-480c-8d60-aa5252692e7d tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:10:53 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-413c9beb-c977-480c-8d60-aa5252692e7d tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:10:53 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-413c9beb-c977-480c-8d60-aa5252692e7d tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:10:54 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-413c9beb-c977-480c-8d60-aa5252692e7d tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f8829c88-70e9-43fb-97b0-d7f46e1de0ae/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.113497 Apr 13 17:10:54 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 383/1152] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 13 17:10:53 2023] GET /compute/v2.1/servers/f8829c88-70e9-43fb-97b0-d7f46e1de0ae/os-interface => generated 283 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:10:54 user devstack@n-api.service[62053]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f769d44c-a0ce-4038-a872-8a5b800691cd] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 13 17:10:54 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_cell0:SELECT=2 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:10:54 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:10:54 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_cell1:SELECT=2 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:10:54 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-582c7c57-7437-4095-9318-8c0ce09bfa2a req-ad78a78c-64ba-4772-9fec-707a80da8c6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8829c88-70e9-43fb-97b0-d7f46e1de0ae", "tag": "fb551510-e993-47ad-b0d1-63c0b5845056"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:10:54 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-582c7c57-7437-4095-9318-8c0ce09bfa2a req-ad78a78c-64ba-4772-9fec-707a80da8c6b service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:10:54 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-582c7c57-7437-4095-9318-8c0ce09bfa2a req-ad78a78c-64ba-4772-9fec-707a80da8c6b service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:10:54 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-582c7c57-7437-4095-9318-8c0ce09bfa2a req-ad78a78c-64ba-4772-9fec-707a80da8c6b service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:10:54 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-582c7c57-7437-4095-9318-8c0ce09bfa2a req-ad78a78c-64ba-4772-9fec-707a80da8c6b service nova] Creating event network-changed:fb551510-e993-47ad-b0d1-63c0b5845056 for instance f8829c88-70e9-43fb-97b0-d7f46e1de0ae on user Apr 13 17:10:54 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [req-582c7c57-7437-4095-9318-8c0ce09bfa2a req-ad78a78c-64ba-4772-9fec-707a80da8c6b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042237 Apr 13 17:10:54 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 386/1153] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:10:54 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:10:54 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_api:SELECT=2 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:10:54 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_cell1:SELECT=6 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:10:54 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-1cf8b023-d7ec-4904-afce-e2da51f7bedc tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:10:54 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-1cf8b023-d7ec-4904-afce-e2da51f7bedc tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: f8829c88-70e9-43fb-97b0-d7f46e1de0ae] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:10:54 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-1cf8b023-d7ec-4904-afce-e2da51f7bedc tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:10:54 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-1cf8b023-d7ec-4904-afce-e2da51f7bedc tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:10:54 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-1cf8b023-d7ec-4904-afce-e2da51f7bedc tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:10:54 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-1cf8b023-d7ec-4904-afce-e2da51f7bedc tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:10:54 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-1cf8b023-d7ec-4904-afce-e2da51f7bedc tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:10:54 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-1cf8b023-d7ec-4904-afce-e2da51f7bedc tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:10:54 user devstack@n-api.service[62054]: INFO oslo.messaging._drivers.impl_rabbit [-] [d5f4f53d-a137-4628-9932-f3f71afa82e2] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 41602. Apr 13 17:10:54 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-1cf8b023-d7ec-4904-afce-e2da51f7bedc tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f8829c88-70e9-43fb-97b0-d7f46e1de0ae/ips" status: 200 len: 108 microversion: 2.1 time: 0.044849 Apr 13 17:10:54 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 385/1154] 10.0.0.210 () {62 vars in 1325 bytes} [Thu Apr 13 17:10:54 2023] GET /compute/v2.1/servers/f8829c88-70e9-43fb-97b0-d7f46e1de0ae/ips => generated 108 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:10:56 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-86e7dd9b-26ad-46d2-9e42-450c309e9d4a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3580dd91-02eb-43a3-ab09-739929338961"}} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:10:56 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-86e7dd9b-26ad-46d2-9e42-450c309e9d4a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: f8829c88-70e9-43fb-97b0-d7f46e1de0ae] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:10:56 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-86e7dd9b-26ad-46d2-9e42-450c309e9d4a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:10:56 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-86e7dd9b-26ad-46d2-9e42-450c309e9d4a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:10:56 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-86e7dd9b-26ad-46d2-9e42-450c309e9d4a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:10:56 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-86e7dd9b-26ad-46d2-9e42-450c309e9d4a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:10:56 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-86e7dd9b-26ad-46d2-9e42-450c309e9d4a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:10:56 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-86e7dd9b-26ad-46d2-9e42-450c309e9d4a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:10:56 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-86e7dd9b-26ad-46d2-9e42-450c309e9d4a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] 10.0.0.210 "POST /compute/v2.1/servers/f8829c88-70e9-43fb-97b0-d7f46e1de0ae/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.297514 Apr 13 17:10:56 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 384/1155] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 17:10:56 2023] POST /compute/v2.1/servers/f8829c88-70e9-43fb-97b0-d7f46e1de0ae/os-volume_attachments => generated 194 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:11:03 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-4a5f154a-ded2-447f-aef4-10a4184dd332 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:11:03 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-4a5f154a-ded2-447f-aef4-10a4184dd332 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: f8829c88-70e9-43fb-97b0-d7f46e1de0ae] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:11:03 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-4a5f154a-ded2-447f-aef4-10a4184dd332 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:11:03 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-4a5f154a-ded2-447f-aef4-10a4184dd332 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:11:03 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-4a5f154a-ded2-447f-aef4-10a4184dd332 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:11:03 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-4a5f154a-ded2-447f-aef4-10a4184dd332 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:11:03 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-4a5f154a-ded2-447f-aef4-10a4184dd332 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:11:03 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-4a5f154a-ded2-447f-aef4-10a4184dd332 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:11:03 user devstack@n-api.service[62053]: INFO oslo.messaging._drivers.impl_rabbit [-] [f769d44c-a0ce-4038-a872-8a5b800691cd] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 52224. Apr 13 17:11:03 user devstack@n-api.service[62053]: DEBUG nova.objects.instance [None req-4a5f154a-ded2-447f-aef4-10a4184dd332 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lazy-loading 'services' on Instance uuid f8829c88-70e9-43fb-97b0-d7f46e1de0ae {{(pid=62053) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 17:11:03 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-4a5f154a-ded2-447f-aef4-10a4184dd332 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f8829c88-70e9-43fb-97b0-d7f46e1de0ae/os-volume_attachments/3580dd91-02eb-43a3-ab09-739929338961" status: 202 len: 0 microversion: 2.1 time: 0.174677 Apr 13 17:11:03 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 387/1156] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 17:11:03 2023] DELETE /compute/v2.1/servers/f8829c88-70e9-43fb-97b0-d7f46e1de0ae/os-volume_attachments/3580dd91-02eb-43a3-ab09-739929338961 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 17:11:03 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-c69ac9fa-698f-4f0f-85df-ff869a9d2557 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:11:03 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-c69ac9fa-698f-4f0f-85df-ff869a9d2557 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: f8829c88-70e9-43fb-97b0-d7f46e1de0ae] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:11:03 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-c69ac9fa-698f-4f0f-85df-ff869a9d2557 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:11:03 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-c69ac9fa-698f-4f0f-85df-ff869a9d2557 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:11:03 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-c69ac9fa-698f-4f0f-85df-ff869a9d2557 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:11:03 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-c69ac9fa-698f-4f0f-85df-ff869a9d2557 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:11:03 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-c69ac9fa-698f-4f0f-85df-ff869a9d2557 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:11:03 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-c69ac9fa-698f-4f0f-85df-ff869a9d2557 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:11:03 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-c69ac9fa-698f-4f0f-85df-ff869a9d2557 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f8829c88-70e9-43fb-97b0-d7f46e1de0ae/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042092 Apr 13 17:11:03 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 386/1157] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 17:11:03 2023] GET /compute/v2.1/servers/f8829c88-70e9-43fb-97b0-d7f46e1de0ae/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:11:53 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-635e5222-9cc9-4db9-8e50-4a3c2b0f1754 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:11:53 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-635e5222-9cc9-4db9-8e50-4a3c2b0f1754 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: f8829c88-70e9-43fb-97b0-d7f46e1de0ae] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:11:53 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_api:SELECT=4 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:11:53 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_cell1:SELECT=15,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:11:53 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-635e5222-9cc9-4db9-8e50-4a3c2b0f1754 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:11:53 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-635e5222-9cc9-4db9-8e50-4a3c2b0f1754 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:11:53 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-635e5222-9cc9-4db9-8e50-4a3c2b0f1754 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:11:53 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-635e5222-9cc9-4db9-8e50-4a3c2b0f1754 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:11:53 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-635e5222-9cc9-4db9-8e50-4a3c2b0f1754 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:11:53 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-635e5222-9cc9-4db9-8e50-4a3c2b0f1754 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:11:53 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-635e5222-9cc9-4db9-8e50-4a3c2b0f1754 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f8829c88-70e9-43fb-97b0-d7f46e1de0ae/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.058985 Apr 13 17:11:53 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 385/1158] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 17:11:53 2023] GET /compute/v2.1/servers/f8829c88-70e9-43fb-97b0-d7f46e1de0ae/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 17:11:53 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_api:SELECT=4 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:11:53 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_cell1:SELECT=11,nova_cell1:INSERT=1 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:11:53 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-5edeb147-971a-4879-8f43-40611586c6ac tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:11:53 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-5edeb147-971a-4879-8f43-40611586c6ac tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: f8829c88-70e9-43fb-97b0-d7f46e1de0ae] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:11:53 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-5edeb147-971a-4879-8f43-40611586c6ac tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:11:53 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-5edeb147-971a-4879-8f43-40611586c6ac tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:11:53 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-5edeb147-971a-4879-8f43-40611586c6ac tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:11:53 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-5edeb147-971a-4879-8f43-40611586c6ac tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:11:53 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-5edeb147-971a-4879-8f43-40611586c6ac tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:11:53 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-5edeb147-971a-4879-8f43-40611586c6ac tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:11:53 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-5edeb147-971a-4879-8f43-40611586c6ac tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: f8829c88-70e9-43fb-97b0-d7f46e1de0ae] Going to try to terminate instance {{(pid=62053) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 17:11:53 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-5edeb147-971a-4879-8f43-40611586c6ac tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f8829c88-70e9-43fb-97b0-d7f46e1de0ae" status: 204 len: 0 microversion: 2.1 time: 0.128582 Apr 13 17:11:53 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 388/1159] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 17:11:53 2023] DELETE /compute/v2.1/servers/f8829c88-70e9-43fb-97b0-d7f46e1de0ae => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 17:11:53 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-e4108c88-94af-4730-926e-a89a0d5f257e tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:11:53 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-e4108c88-94af-4730-926e-a89a0d5f257e tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: f8829c88-70e9-43fb-97b0-d7f46e1de0ae] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:11:53 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_api:SELECT=4 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:11:53 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_cell1:SELECT=10 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:11:53 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-e4108c88-94af-4730-926e-a89a0d5f257e tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:11:53 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-e4108c88-94af-4730-926e-a89a0d5f257e tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:11:53 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-e4108c88-94af-4730-926e-a89a0d5f257e tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:11:53 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-e4108c88-94af-4730-926e-a89a0d5f257e tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:11:53 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-e4108c88-94af-4730-926e-a89a0d5f257e tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:11:53 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-e4108c88-94af-4730-926e-a89a0d5f257e tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:11:53 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [req-da501647-729b-4ea6-8458-c04fe11478f2 req-1e518593-b7f2-45e2-be1e-0c7a8f213eb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8829c88-70e9-43fb-97b0-d7f46e1de0ae", "name": "network-vif-unplugged", "status": "completed", "tag": "fb551510-e993-47ad-b0d1-63c0b5845056"}]} {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:11:54 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-da501647-729b-4ea6-8458-c04fe11478f2 req-1e518593-b7f2-45e2-be1e-0c7a8f213eb6 service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:11:54 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-da501647-729b-4ea6-8458-c04fe11478f2 req-1e518593-b7f2-45e2-be1e-0c7a8f213eb6 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:11:54 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [req-da501647-729b-4ea6-8458-c04fe11478f2 req-1e518593-b7f2-45e2-be1e-0c7a8f213eb6 service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:11:54 user devstack@n-api.service[62055]: INFO nova.api.openstack.compute.server_external_events [req-da501647-729b-4ea6-8458-c04fe11478f2 req-1e518593-b7f2-45e2-be1e-0c7a8f213eb6 service nova] Creating event network-vif-unplugged:fb551510-e993-47ad-b0d1-63c0b5845056 for instance f8829c88-70e9-43fb-97b0-d7f46e1de0ae on user Apr 13 17:11:54 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [req-da501647-729b-4ea6-8458-c04fe11478f2 req-1e518593-b7f2-45e2-be1e-0c7a8f213eb6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034885 Apr 13 17:11:54 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 386/1160] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:11:53 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:11:54 user devstack@n-api.service[62054]: DEBUG nova.policy [None req-e4108c88-94af-4730-926e-a89a0d5f257e tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a08b0caad23045c1822cdd0b3ae0769f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097b15faad8249c9bf45623d0c3ab518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=62054) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 17:11:54 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-e4108c88-94af-4730-926e-a89a0d5f257e tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f8829c88-70e9-43fb-97b0-d7f46e1de0ae" status: 200 len: 1666 microversion: 2.1 time: 0.365722 Apr 13 17:11:54 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 387/1161] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:11:53 2023] GET /compute/v2.1/servers/f8829c88-70e9-43fb-97b0-d7f46e1de0ae => generated 1666 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 17:11:56 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [req-3696ddf8-64ff-42c3-bcca-1c47f2037017 req-e8d4f9d5-8d11-47fe-9e9d-9ca555b87d4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8829c88-70e9-43fb-97b0-d7f46e1de0ae", "name": "network-vif-plugged", "status": "completed", "tag": "fb551510-e993-47ad-b0d1-63c0b5845056"}, {"server_uuid": "f8829c88-70e9-43fb-97b0-d7f46e1de0ae", "name": "network-vif-deleted", "tag": "fb551510-e993-47ad-b0d1-63c0b5845056"}]} {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 17:11:56 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-3696ddf8-64ff-42c3-bcca-1c47f2037017 req-e8d4f9d5-8d11-47fe-9e9d-9ca555b87d4a service nova] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:11:56 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-3696ddf8-64ff-42c3-bcca-1c47f2037017 req-e8d4f9d5-8d11-47fe-9e9d-9ca555b87d4a service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:11:56 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [req-3696ddf8-64ff-42c3-bcca-1c47f2037017 req-e8d4f9d5-8d11-47fe-9e9d-9ca555b87d4a service nova] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:11:56 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-3696ddf8-64ff-42c3-bcca-1c47f2037017 req-e8d4f9d5-8d11-47fe-9e9d-9ca555b87d4a service nova] Creating event network-vif-plugged:fb551510-e993-47ad-b0d1-63c0b5845056 for instance f8829c88-70e9-43fb-97b0-d7f46e1de0ae on user Apr 13 17:11:56 user devstack@n-api.service[62053]: INFO nova.api.openstack.compute.server_external_events [req-3696ddf8-64ff-42c3-bcca-1c47f2037017 req-e8d4f9d5-8d11-47fe-9e9d-9ca555b87d4a service nova] Creating event network-vif-deleted:fb551510-e993-47ad-b0d1-63c0b5845056 for instance f8829c88-70e9-43fb-97b0-d7f46e1de0ae on user Apr 13 17:11:56 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [req-3696ddf8-64ff-42c3-bcca-1c47f2037017 req-e8d4f9d5-8d11-47fe-9e9d-9ca555b87d4a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.030232 Apr 13 17:11:56 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 389/1162] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 17:11:56 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 17:12:44 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_api:SELECT=4 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:12:44 user devstack@n-api.service[62055]: DEBUG dbcounter [-] [62055] Writing DB stats nova_cell1:SELECT=8 {{(pid=62055) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:12:44 user devstack@n-api.service[62055]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 13 17:12:44 user devstack@n-api.service[62055]: Thu Apr 13 17:12:44 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f8829c88-70e9-43fb-97b0-d7f46e1de0ae (ip 10.0.0.210) !!! Apr 13 17:12:44 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-62c37221-0a80-488b-a760-c27e304d9ae9 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:12:44 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-62c37221-0a80-488b-a760-c27e304d9ae9 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: f8829c88-70e9-43fb-97b0-d7f46e1de0ae] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:12:44 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-62c37221-0a80-488b-a760-c27e304d9ae9 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:12:44 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-62c37221-0a80-488b-a760-c27e304d9ae9 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:12:44 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-62c37221-0a80-488b-a760-c27e304d9ae9 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:12:44 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-62c37221-0a80-488b-a760-c27e304d9ae9 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:12:44 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-62c37221-0a80-488b-a760-c27e304d9ae9 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:12:44 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-62c37221-0a80-488b-a760-c27e304d9ae9 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:12:44 user devstack@n-api.service[62055]: INFO nova.api.openstack.wsgi [None req-62c37221-0a80-488b-a760-c27e304d9ae9 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] HTTP exception thrown: Instance f8829c88-70e9-43fb-97b0-d7f46e1de0ae could not be found. Apr 13 17:12:44 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-62c37221-0a80-488b-a760-c27e304d9ae9 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Request method failure captured: Apr 13 17:12:44 user devstack@n-api.service[62055]: request: GET /compute/v2.1/servers/f8829c88-70e9-43fb-97b0-d7f46e1de0ae HTTP/1.1 Apr 13 17:12:44 user devstack@n-api.service[62055]: Accept: application/json Apr 13 17:12:44 user devstack@n-api.service[62055]: Accept-Encoding: identity Apr 13 17:12:44 user devstack@n-api.service[62055]: Connection: close Apr 13 17:12:44 user devstack@n-api.service[62055]: Content-Length: 0 Apr 13 17:12:44 user devstack@n-api.service[62055]: Content-Type: application/json Apr 13 17:12:44 user devstack@n-api.service[62055]: Host: 10.0.0.210 Apr 13 17:12:44 user devstack@n-api.service[62055]: Openstack-System-Scope: None Apr 13 17:12:44 user devstack@n-api.service[62055]: User-Agent: python-urllib3/1.26.15 Apr 13 17:12:44 user devstack@n-api.service[62055]: X-Auth-Token: gAAAAABkODTDp_J_kOKBdnfqcv57bez4t7SdSp5UwD5DaWQ0e7zYTV516bQ2tGNSMsgSMmjRAeEnvh6eyS2dpIcxQ87aMcZmL4sydtZG6naQIt5z18MsjMDJtaVZWdqVQVJRdnFvavY9T2LJZWcSrFdkSSE2bAqoVJKrPExVvG6GOh-2JZvqC00 Apr 13 17:12:44 user devstack@n-api.service[62055]: X-Domain-Id: None Apr 13 17:12:44 user devstack@n-api.service[62055]: X-Domain-Name: None Apr 13 17:12:44 user devstack@n-api.service[62055]: X-Identity-Status: Confirmed Apr 13 17:12:44 user devstack@n-api.service[62055]: X-Is-Admin-Project: True Apr 13 17:12:44 user devstack@n-api.service[62055]: X-Project-Domain-Id: default Apr 13 17:12:44 user devstack@n-api.service[62055]: X-Project-Domain-Name: Default Apr 13 17:12:44 user devstack@n-api.service[62055]: X-Project-Id: 097b15faad8249c9bf45623d0c3ab518 Apr 13 17:12:44 user devstack@n-api.service[62055]: X-Project-Name: tempest-AttachVolumeNegativeTest-236067262 Apr 13 17:12:44 user devstack@n-api.service[62055]: X-Role: reader,member Apr 13 17:12:44 user devstack@n-api.service[62055]: X-Roles: reader,member Apr 13 17:12:44 user devstack@n-api.service[62055]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/097b15faad8249c9bf45623d0c3ab518"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/097b15faad8249c9bf45623d0c3ab518"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/097b15faad8249c9bf45623d0c3ab518"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 13 17:12:44 user devstack@n-api.service[62055]: X-Tenant: tempest-AttachVolumeNegativeTest-236067262 Apr 13 17:12:44 user devstack@n-api.service[62055]: X-Tenant-Id: 097b15faad8249c9bf45623d0c3ab518 Apr 13 17:12:44 user devstack@n-api.service[62055]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-236067262 Apr 13 17:12:44 user devstack@n-api.service[62055]: X-User: tempest-AttachVolumeNegativeTest-236067262-project-member Apr 13 17:12:44 user devstack@n-api.service[62055]: X-User-Domain-Id: default Apr 13 17:12:44 user devstack@n-api.service[62055]: X-User-Domain-Name: Default Apr 13 17:12:44 user devstack@n-api.service[62055]: X-User-Id: a08b0caad23045c1822cdd0b3ae0769f Apr 13 17:12:44 user devstack@n-api.service[62055]: X-User-Name: tempest-AttachVolumeNegativeTest-236067262-project-member Apr 13 17:12:44 user devstack@n-api.service[62055]: method: > Apr 13 17:12:44 user devstack@n-api.service[62055]: exception: Instance f8829c88-70e9-43fb-97b0-d7f46e1de0ae could not be found. Apr 13 17:12:44 user devstack@n-api.service[62055]: action_args: {'id': 'f8829c88-70e9-43fb-97b0-d7f46e1de0ae'} Apr 13 17:12:44 user devstack@n-api.service[62055]: {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 17:12:44 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:12:44 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 17:12:44 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 17:12:44 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 17:12:44 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 17:12:44 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 17:12:44 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 17:12:44 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 17:12:44 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 17:12:44 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8829c88-70e9-43fb-97b0-d7f46e1de0ae could not be found. Apr 13 17:12:44 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 17:12:44 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:12:44 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 17:12:44 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:12:44 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 17:12:44 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 17:12:44 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 17:12:44 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 17:12:44 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 17:12:44 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 17:12:44 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 17:12:44 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 17:12:44 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 17:12:44 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 17:12:44 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 17:12:44 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 17:12:44 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8829c88-70e9-43fb-97b0-d7f46e1de0ae could not be found. Apr 13 17:12:44 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 17:12:44 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:12:44 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 17:12:44 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:12:44 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 17:12:44 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 17:12:44 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 17:12:44 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 17:12:44 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8829c88-70e9-43fb-97b0-d7f46e1de0ae could not be found. Apr 13 17:12:44 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 17:12:44 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-62c37221-0a80-488b-a760-c27e304d9ae9 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Returning 404 to user: Instance f8829c88-70e9-43fb-97b0-d7f46e1de0ae could not be found. {{(pid=62055) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 17:12:44 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-62c37221-0a80-488b-a760-c27e304d9ae9 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f8829c88-70e9-43fb-97b0-d7f46e1de0ae" status: 404 len: 111 microversion: 2.1 time: 0.041008 Apr 13 17:12:44 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 387/1163] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:12:44 2023] GET /compute/v2.1/servers/f8829c88-70e9-43fb-97b0-d7f46e1de0ae => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 17:12:44 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-3d0e5f87-6c06-48fd-aaeb-899e5b286385 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Calling method '.version_select at 0x7f96e475a560>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:12:44 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_api:SELECT=2 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:12:44 user devstack@n-api.service[62054]: DEBUG dbcounter [-] [62054] Writing DB stats nova_cell1:SELECT=6 {{(pid=62054) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:12:44 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-3d0e5f87-6c06-48fd-aaeb-899e5b286385 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2430711" status: 202 len: 0 microversion: 2.1 time: 0.027151 Apr 13 17:12:44 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 388/1164] 10.0.0.210 () {62 vars in 1289 bytes} [Thu Apr 13 17:12:44 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2430711 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 17:12:47 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:12:47 user devstack@n-api.service[62053]: DEBUG dbcounter [-] [62053] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=62053) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 17:12:47 user devstack@n-api.service[62053]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 13 17:12:47 user devstack@n-api.service[62053]: Thu Apr 13 17:12:47 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f8829c88-70e9-43fb-97b0-d7f46e1de0ae (ip 10.0.0.210) !!! Apr 13 17:12:47 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-b32813f0-18c4-40aa-9540-2f27d4e6ad95 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:12:47 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-b32813f0-18c4-40aa-9540-2f27d4e6ad95 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: f8829c88-70e9-43fb-97b0-d7f46e1de0ae] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:12:47 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-b32813f0-18c4-40aa-9540-2f27d4e6ad95 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:12:47 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-b32813f0-18c4-40aa-9540-2f27d4e6ad95 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:12:47 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-b32813f0-18c4-40aa-9540-2f27d4e6ad95 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:12:47 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-b32813f0-18c4-40aa-9540-2f27d4e6ad95 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:12:47 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-b32813f0-18c4-40aa-9540-2f27d4e6ad95 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:12:47 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-b32813f0-18c4-40aa-9540-2f27d4e6ad95 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:12:47 user devstack@n-api.service[62053]: INFO nova.api.openstack.wsgi [None req-b32813f0-18c4-40aa-9540-2f27d4e6ad95 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] HTTP exception thrown: Instance f8829c88-70e9-43fb-97b0-d7f46e1de0ae could not be found. Apr 13 17:12:47 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-b32813f0-18c4-40aa-9540-2f27d4e6ad95 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Request method failure captured: Apr 13 17:12:47 user devstack@n-api.service[62053]: request: DELETE /compute/v2.1/servers/f8829c88-70e9-43fb-97b0-d7f46e1de0ae HTTP/1.1 Apr 13 17:12:47 user devstack@n-api.service[62053]: Accept: application/json Apr 13 17:12:47 user devstack@n-api.service[62053]: Accept-Encoding: identity Apr 13 17:12:47 user devstack@n-api.service[62053]: Connection: close Apr 13 17:12:47 user devstack@n-api.service[62053]: Content-Length: 0 Apr 13 17:12:47 user devstack@n-api.service[62053]: Content-Type: application/json Apr 13 17:12:47 user devstack@n-api.service[62053]: Host: 10.0.0.210 Apr 13 17:12:47 user devstack@n-api.service[62053]: Openstack-System-Scope: None Apr 13 17:12:47 user devstack@n-api.service[62053]: User-Agent: python-urllib3/1.26.15 Apr 13 17:12:47 user devstack@n-api.service[62053]: X-Auth-Token: gAAAAABkODTDp_J_kOKBdnfqcv57bez4t7SdSp5UwD5DaWQ0e7zYTV516bQ2tGNSMsgSMmjRAeEnvh6eyS2dpIcxQ87aMcZmL4sydtZG6naQIt5z18MsjMDJtaVZWdqVQVJRdnFvavY9T2LJZWcSrFdkSSE2bAqoVJKrPExVvG6GOh-2JZvqC00 Apr 13 17:12:47 user devstack@n-api.service[62053]: X-Domain-Id: None Apr 13 17:12:47 user devstack@n-api.service[62053]: X-Domain-Name: None Apr 13 17:12:47 user devstack@n-api.service[62053]: X-Identity-Status: Confirmed Apr 13 17:12:47 user devstack@n-api.service[62053]: X-Is-Admin-Project: True Apr 13 17:12:47 user devstack@n-api.service[62053]: X-Project-Domain-Id: default Apr 13 17:12:47 user devstack@n-api.service[62053]: X-Project-Domain-Name: Default Apr 13 17:12:47 user devstack@n-api.service[62053]: X-Project-Id: 097b15faad8249c9bf45623d0c3ab518 Apr 13 17:12:47 user devstack@n-api.service[62053]: X-Project-Name: tempest-AttachVolumeNegativeTest-236067262 Apr 13 17:12:47 user devstack@n-api.service[62053]: X-Role: reader,member Apr 13 17:12:47 user devstack@n-api.service[62053]: X-Roles: reader,member Apr 13 17:12:47 user devstack@n-api.service[62053]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/097b15faad8249c9bf45623d0c3ab518"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/097b15faad8249c9bf45623d0c3ab518"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/097b15faad8249c9bf45623d0c3ab518"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 13 17:12:47 user devstack@n-api.service[62053]: X-Tenant: tempest-AttachVolumeNegativeTest-236067262 Apr 13 17:12:47 user devstack@n-api.service[62053]: X-Tenant-Id: 097b15faad8249c9bf45623d0c3ab518 Apr 13 17:12:47 user devstack@n-api.service[62053]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-236067262 Apr 13 17:12:47 user devstack@n-api.service[62053]: X-User: tempest-AttachVolumeNegativeTest-236067262-project-member Apr 13 17:12:47 user devstack@n-api.service[62053]: X-User-Domain-Id: default Apr 13 17:12:47 user devstack@n-api.service[62053]: X-User-Domain-Name: Default Apr 13 17:12:47 user devstack@n-api.service[62053]: X-User-Id: a08b0caad23045c1822cdd0b3ae0769f Apr 13 17:12:47 user devstack@n-api.service[62053]: X-User-Name: tempest-AttachVolumeNegativeTest-236067262-project-member Apr 13 17:12:47 user devstack@n-api.service[62053]: method: > Apr 13 17:12:47 user devstack@n-api.service[62053]: exception: Instance f8829c88-70e9-43fb-97b0-d7f46e1de0ae could not be found. Apr 13 17:12:47 user devstack@n-api.service[62053]: action_args: {'id': 'f8829c88-70e9-43fb-97b0-d7f46e1de0ae'} Apr 13 17:12:47 user devstack@n-api.service[62053]: {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 17:12:47 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:12:47 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 17:12:47 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 17:12:47 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 17:12:47 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 17:12:47 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 17:12:47 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 17:12:47 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 17:12:47 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 17:12:47 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8829c88-70e9-43fb-97b0-d7f46e1de0ae could not be found. Apr 13 17:12:47 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 17:12:47 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:12:47 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 17:12:47 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:12:47 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 17:12:47 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 17:12:47 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 17:12:47 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 17:12:47 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 17:12:47 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 17:12:47 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 17:12:47 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 17:12:47 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 17:12:47 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 17:12:47 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 17:12:47 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 17:12:47 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 17:12:47 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 17:12:47 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8829c88-70e9-43fb-97b0-d7f46e1de0ae could not be found. Apr 13 17:12:47 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 17:12:47 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:12:47 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 17:12:47 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:12:47 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 17:12:47 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 17:12:47 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 17:12:47 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 17:12:47 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8829c88-70e9-43fb-97b0-d7f46e1de0ae could not be found. Apr 13 17:12:47 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 17:12:47 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-b32813f0-18c4-40aa-9540-2f27d4e6ad95 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Returning 404 to user: Instance f8829c88-70e9-43fb-97b0-d7f46e1de0ae could not be found. {{(pid=62053) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 17:12:47 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-b32813f0-18c4-40aa-9540-2f27d4e6ad95 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f8829c88-70e9-43fb-97b0-d7f46e1de0ae" status: 404 len: 111 microversion: 2.1 time: 0.049794 Apr 13 17:12:47 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 390/1165] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 17:12:47 2023] DELETE /compute/v2.1/servers/f8829c88-70e9-43fb-97b0-d7f46e1de0ae => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 17:12:47 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-6bf47360-98a3-41ea-b9a6-5cae44ccefc4 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:12:47 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-6bf47360-98a3-41ea-b9a6-5cae44ccefc4 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: f8829c88-70e9-43fb-97b0-d7f46e1de0ae] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:12:47 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-6bf47360-98a3-41ea-b9a6-5cae44ccefc4 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:12:47 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-6bf47360-98a3-41ea-b9a6-5cae44ccefc4 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:12:47 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-6bf47360-98a3-41ea-b9a6-5cae44ccefc4 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:12:47 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-6bf47360-98a3-41ea-b9a6-5cae44ccefc4 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:12:47 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-6bf47360-98a3-41ea-b9a6-5cae44ccefc4 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:12:47 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-6bf47360-98a3-41ea-b9a6-5cae44ccefc4 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:12:47 user devstack@n-api.service[62055]: INFO nova.api.openstack.wsgi [None req-6bf47360-98a3-41ea-b9a6-5cae44ccefc4 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] HTTP exception thrown: Instance f8829c88-70e9-43fb-97b0-d7f46e1de0ae could not be found. Apr 13 17:12:47 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-6bf47360-98a3-41ea-b9a6-5cae44ccefc4 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Request method failure captured: Apr 13 17:12:47 user devstack@n-api.service[62055]: request: GET /compute/v2.1/servers/f8829c88-70e9-43fb-97b0-d7f46e1de0ae HTTP/1.1 Apr 13 17:12:47 user devstack@n-api.service[62055]: Accept: application/json Apr 13 17:12:47 user devstack@n-api.service[62055]: Accept-Encoding: identity Apr 13 17:12:47 user devstack@n-api.service[62055]: Connection: close Apr 13 17:12:47 user devstack@n-api.service[62055]: Content-Length: 0 Apr 13 17:12:47 user devstack@n-api.service[62055]: Content-Type: application/json Apr 13 17:12:47 user devstack@n-api.service[62055]: Host: 10.0.0.210 Apr 13 17:12:47 user devstack@n-api.service[62055]: Openstack-System-Scope: None Apr 13 17:12:47 user devstack@n-api.service[62055]: User-Agent: python-urllib3/1.26.15 Apr 13 17:12:47 user devstack@n-api.service[62055]: X-Auth-Token: gAAAAABkODTDp_J_kOKBdnfqcv57bez4t7SdSp5UwD5DaWQ0e7zYTV516bQ2tGNSMsgSMmjRAeEnvh6eyS2dpIcxQ87aMcZmL4sydtZG6naQIt5z18MsjMDJtaVZWdqVQVJRdnFvavY9T2LJZWcSrFdkSSE2bAqoVJKrPExVvG6GOh-2JZvqC00 Apr 13 17:12:47 user devstack@n-api.service[62055]: X-Domain-Id: None Apr 13 17:12:47 user devstack@n-api.service[62055]: X-Domain-Name: None Apr 13 17:12:47 user devstack@n-api.service[62055]: X-Identity-Status: Confirmed Apr 13 17:12:47 user devstack@n-api.service[62055]: X-Is-Admin-Project: True Apr 13 17:12:47 user devstack@n-api.service[62055]: X-Project-Domain-Id: default Apr 13 17:12:47 user devstack@n-api.service[62055]: X-Project-Domain-Name: Default Apr 13 17:12:47 user devstack@n-api.service[62055]: X-Project-Id: 097b15faad8249c9bf45623d0c3ab518 Apr 13 17:12:47 user devstack@n-api.service[62055]: X-Project-Name: tempest-AttachVolumeNegativeTest-236067262 Apr 13 17:12:47 user devstack@n-api.service[62055]: X-Role: reader,member Apr 13 17:12:47 user devstack@n-api.service[62055]: X-Roles: reader,member Apr 13 17:12:47 user devstack@n-api.service[62055]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/097b15faad8249c9bf45623d0c3ab518"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/097b15faad8249c9bf45623d0c3ab518"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/097b15faad8249c9bf45623d0c3ab518"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 13 17:12:47 user devstack@n-api.service[62055]: X-Tenant: tempest-AttachVolumeNegativeTest-236067262 Apr 13 17:12:47 user devstack@n-api.service[62055]: X-Tenant-Id: 097b15faad8249c9bf45623d0c3ab518 Apr 13 17:12:47 user devstack@n-api.service[62055]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-236067262 Apr 13 17:12:47 user devstack@n-api.service[62055]: X-User: tempest-AttachVolumeNegativeTest-236067262-project-member Apr 13 17:12:47 user devstack@n-api.service[62055]: X-User-Domain-Id: default Apr 13 17:12:47 user devstack@n-api.service[62055]: X-User-Domain-Name: Default Apr 13 17:12:47 user devstack@n-api.service[62055]: X-User-Id: a08b0caad23045c1822cdd0b3ae0769f Apr 13 17:12:47 user devstack@n-api.service[62055]: X-User-Name: tempest-AttachVolumeNegativeTest-236067262-project-member Apr 13 17:12:47 user devstack@n-api.service[62055]: method: > Apr 13 17:12:47 user devstack@n-api.service[62055]: exception: Instance f8829c88-70e9-43fb-97b0-d7f46e1de0ae could not be found. Apr 13 17:12:47 user devstack@n-api.service[62055]: action_args: {'id': 'f8829c88-70e9-43fb-97b0-d7f46e1de0ae'} Apr 13 17:12:47 user devstack@n-api.service[62055]: {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 17:12:47 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:12:47 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 17:12:47 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 17:12:47 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 17:12:47 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 17:12:47 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 17:12:47 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 17:12:47 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 17:12:47 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 17:12:47 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8829c88-70e9-43fb-97b0-d7f46e1de0ae could not be found. Apr 13 17:12:47 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 17:12:47 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:12:47 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 17:12:47 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:12:47 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 17:12:47 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 17:12:47 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 17:12:47 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 17:12:47 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 17:12:47 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 17:12:47 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 17:12:47 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 17:12:47 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 17:12:47 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 17:12:47 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 17:12:47 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 17:12:47 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8829c88-70e9-43fb-97b0-d7f46e1de0ae could not be found. Apr 13 17:12:47 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 17:12:47 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:12:47 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 17:12:47 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:12:47 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 17:12:47 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 17:12:47 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 17:12:47 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 17:12:47 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8829c88-70e9-43fb-97b0-d7f46e1de0ae could not be found. Apr 13 17:12:47 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 17:12:47 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-6bf47360-98a3-41ea-b9a6-5cae44ccefc4 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Returning 404 to user: Instance f8829c88-70e9-43fb-97b0-d7f46e1de0ae could not be found. {{(pid=62055) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 17:12:47 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-6bf47360-98a3-41ea-b9a6-5cae44ccefc4 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f8829c88-70e9-43fb-97b0-d7f46e1de0ae" status: 404 len: 111 microversion: 2.1 time: 0.034326 Apr 13 17:12:47 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 388/1166] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:12:47 2023] GET /compute/v2.1/servers/f8829c88-70e9-43fb-97b0-d7f46e1de0ae => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 17:12:49 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-57100e58-3d9f-47d5-bdff-18c5e45f3211 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:12:49 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-57100e58-3d9f-47d5-bdff-18c5e45f3211 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: ae339f64-b90f-4399-baa5-1ad1e5051593] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:12:49 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-57100e58-3d9f-47d5-bdff-18c5e45f3211 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:12:49 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-57100e58-3d9f-47d5-bdff-18c5e45f3211 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:12:49 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-57100e58-3d9f-47d5-bdff-18c5e45f3211 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:12:49 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-57100e58-3d9f-47d5-bdff-18c5e45f3211 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:12:49 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-57100e58-3d9f-47d5-bdff-18c5e45f3211 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:12:49 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-57100e58-3d9f-47d5-bdff-18c5e45f3211 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:12:49 user devstack@n-api.service[62054]: INFO nova.api.openstack.wsgi [None req-57100e58-3d9f-47d5-bdff-18c5e45f3211 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] HTTP exception thrown: Instance ae339f64-b90f-4399-baa5-1ad1e5051593 could not be found. Apr 13 17:12:49 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-57100e58-3d9f-47d5-bdff-18c5e45f3211 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Request method failure captured: Apr 13 17:12:49 user devstack@n-api.service[62054]: request: DELETE /compute/v2.1/servers/ae339f64-b90f-4399-baa5-1ad1e5051593 HTTP/1.1 Apr 13 17:12:49 user devstack@n-api.service[62054]: Accept: application/json Apr 13 17:12:49 user devstack@n-api.service[62054]: Accept-Encoding: identity Apr 13 17:12:49 user devstack@n-api.service[62054]: Connection: close Apr 13 17:12:49 user devstack@n-api.service[62054]: Content-Length: 0 Apr 13 17:12:49 user devstack@n-api.service[62054]: Content-Type: application/json Apr 13 17:12:49 user devstack@n-api.service[62054]: Host: 10.0.0.210 Apr 13 17:12:49 user devstack@n-api.service[62054]: Openstack-System-Scope: None Apr 13 17:12:49 user devstack@n-api.service[62054]: User-Agent: python-urllib3/1.26.15 Apr 13 17:12:49 user devstack@n-api.service[62054]: X-Auth-Token: gAAAAABkODTDp_J_kOKBdnfqcv57bez4t7SdSp5UwD5DaWQ0e7zYTV516bQ2tGNSMsgSMmjRAeEnvh6eyS2dpIcxQ87aMcZmL4sydtZG6naQIt5z18MsjMDJtaVZWdqVQVJRdnFvavY9T2LJZWcSrFdkSSE2bAqoVJKrPExVvG6GOh-2JZvqC00 Apr 13 17:12:49 user devstack@n-api.service[62054]: X-Domain-Id: None Apr 13 17:12:49 user devstack@n-api.service[62054]: X-Domain-Name: None Apr 13 17:12:49 user devstack@n-api.service[62054]: X-Identity-Status: Confirmed Apr 13 17:12:49 user devstack@n-api.service[62054]: X-Is-Admin-Project: True Apr 13 17:12:49 user devstack@n-api.service[62054]: X-Project-Domain-Id: default Apr 13 17:12:49 user devstack@n-api.service[62054]: X-Project-Domain-Name: Default Apr 13 17:12:49 user devstack@n-api.service[62054]: X-Project-Id: 097b15faad8249c9bf45623d0c3ab518 Apr 13 17:12:49 user devstack@n-api.service[62054]: X-Project-Name: tempest-AttachVolumeNegativeTest-236067262 Apr 13 17:12:49 user devstack@n-api.service[62054]: X-Role: reader,member Apr 13 17:12:49 user devstack@n-api.service[62054]: X-Roles: reader,member Apr 13 17:12:49 user devstack@n-api.service[62054]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/097b15faad8249c9bf45623d0c3ab518"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/097b15faad8249c9bf45623d0c3ab518"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/097b15faad8249c9bf45623d0c3ab518"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 13 17:12:49 user devstack@n-api.service[62054]: X-Tenant: tempest-AttachVolumeNegativeTest-236067262 Apr 13 17:12:49 user devstack@n-api.service[62054]: X-Tenant-Id: 097b15faad8249c9bf45623d0c3ab518 Apr 13 17:12:49 user devstack@n-api.service[62054]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-236067262 Apr 13 17:12:49 user devstack@n-api.service[62054]: X-User: tempest-AttachVolumeNegativeTest-236067262-project-member Apr 13 17:12:49 user devstack@n-api.service[62054]: X-User-Domain-Id: default Apr 13 17:12:49 user devstack@n-api.service[62054]: X-User-Domain-Name: Default Apr 13 17:12:49 user devstack@n-api.service[62054]: X-User-Id: a08b0caad23045c1822cdd0b3ae0769f Apr 13 17:12:49 user devstack@n-api.service[62054]: X-User-Name: tempest-AttachVolumeNegativeTest-236067262-project-member Apr 13 17:12:49 user devstack@n-api.service[62054]: method: > Apr 13 17:12:49 user devstack@n-api.service[62054]: exception: Instance ae339f64-b90f-4399-baa5-1ad1e5051593 could not be found. Apr 13 17:12:49 user devstack@n-api.service[62054]: action_args: {'id': 'ae339f64-b90f-4399-baa5-1ad1e5051593'} Apr 13 17:12:49 user devstack@n-api.service[62054]: {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 17:12:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:12:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 17:12:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 17:12:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 17:12:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 17:12:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 17:12:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 17:12:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 17:12:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 17:12:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae339f64-b90f-4399-baa5-1ad1e5051593 could not be found. Apr 13 17:12:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 17:12:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:12:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 17:12:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:12:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 17:12:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 17:12:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 17:12:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 17:12:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 17:12:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 17:12:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 17:12:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 17:12:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 17:12:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 17:12:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 17:12:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 17:12:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 17:12:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 17:12:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae339f64-b90f-4399-baa5-1ad1e5051593 could not be found. Apr 13 17:12:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 17:12:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:12:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 17:12:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:12:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 17:12:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 17:12:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 17:12:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 17:12:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae339f64-b90f-4399-baa5-1ad1e5051593 could not be found. Apr 13 17:12:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 17:12:49 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-57100e58-3d9f-47d5-bdff-18c5e45f3211 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Returning 404 to user: Instance ae339f64-b90f-4399-baa5-1ad1e5051593 could not be found. {{(pid=62054) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 17:12:49 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-57100e58-3d9f-47d5-bdff-18c5e45f3211 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ae339f64-b90f-4399-baa5-1ad1e5051593" status: 404 len: 111 microversion: 2.1 time: 0.030432 Apr 13 17:12:49 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 389/1167] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 17:12:49 2023] DELETE /compute/v2.1/servers/ae339f64-b90f-4399-baa5-1ad1e5051593 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 17:12:49 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-eae6167d-bc49-4210-9b45-90a97c2a581f tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:12:49 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-eae6167d-bc49-4210-9b45-90a97c2a581f tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: ae339f64-b90f-4399-baa5-1ad1e5051593] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:12:49 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-eae6167d-bc49-4210-9b45-90a97c2a581f tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:12:49 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-eae6167d-bc49-4210-9b45-90a97c2a581f tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:12:49 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-eae6167d-bc49-4210-9b45-90a97c2a581f tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:12:49 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-eae6167d-bc49-4210-9b45-90a97c2a581f tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:12:49 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-eae6167d-bc49-4210-9b45-90a97c2a581f tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:12:49 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-eae6167d-bc49-4210-9b45-90a97c2a581f tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:12:49 user devstack@n-api.service[62053]: INFO nova.api.openstack.wsgi [None req-eae6167d-bc49-4210-9b45-90a97c2a581f tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] HTTP exception thrown: Instance ae339f64-b90f-4399-baa5-1ad1e5051593 could not be found. Apr 13 17:12:49 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-eae6167d-bc49-4210-9b45-90a97c2a581f tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Request method failure captured: Apr 13 17:12:49 user devstack@n-api.service[62053]: request: GET /compute/v2.1/servers/ae339f64-b90f-4399-baa5-1ad1e5051593 HTTP/1.1 Apr 13 17:12:49 user devstack@n-api.service[62053]: Accept: application/json Apr 13 17:12:49 user devstack@n-api.service[62053]: Accept-Encoding: identity Apr 13 17:12:49 user devstack@n-api.service[62053]: Connection: close Apr 13 17:12:49 user devstack@n-api.service[62053]: Content-Length: 0 Apr 13 17:12:49 user devstack@n-api.service[62053]: Content-Type: application/json Apr 13 17:12:49 user devstack@n-api.service[62053]: Host: 10.0.0.210 Apr 13 17:12:49 user devstack@n-api.service[62053]: Openstack-System-Scope: None Apr 13 17:12:49 user devstack@n-api.service[62053]: User-Agent: python-urllib3/1.26.15 Apr 13 17:12:49 user devstack@n-api.service[62053]: X-Auth-Token: gAAAAABkODTDp_J_kOKBdnfqcv57bez4t7SdSp5UwD5DaWQ0e7zYTV516bQ2tGNSMsgSMmjRAeEnvh6eyS2dpIcxQ87aMcZmL4sydtZG6naQIt5z18MsjMDJtaVZWdqVQVJRdnFvavY9T2LJZWcSrFdkSSE2bAqoVJKrPExVvG6GOh-2JZvqC00 Apr 13 17:12:49 user devstack@n-api.service[62053]: X-Domain-Id: None Apr 13 17:12:49 user devstack@n-api.service[62053]: X-Domain-Name: None Apr 13 17:12:49 user devstack@n-api.service[62053]: X-Identity-Status: Confirmed Apr 13 17:12:49 user devstack@n-api.service[62053]: X-Is-Admin-Project: True Apr 13 17:12:49 user devstack@n-api.service[62053]: X-Project-Domain-Id: default Apr 13 17:12:49 user devstack@n-api.service[62053]: X-Project-Domain-Name: Default Apr 13 17:12:49 user devstack@n-api.service[62053]: X-Project-Id: 097b15faad8249c9bf45623d0c3ab518 Apr 13 17:12:49 user devstack@n-api.service[62053]: X-Project-Name: tempest-AttachVolumeNegativeTest-236067262 Apr 13 17:12:49 user devstack@n-api.service[62053]: X-Role: reader,member Apr 13 17:12:49 user devstack@n-api.service[62053]: X-Roles: reader,member Apr 13 17:12:49 user devstack@n-api.service[62053]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/097b15faad8249c9bf45623d0c3ab518"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/097b15faad8249c9bf45623d0c3ab518"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/097b15faad8249c9bf45623d0c3ab518"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 13 17:12:49 user devstack@n-api.service[62053]: X-Tenant: tempest-AttachVolumeNegativeTest-236067262 Apr 13 17:12:49 user devstack@n-api.service[62053]: X-Tenant-Id: 097b15faad8249c9bf45623d0c3ab518 Apr 13 17:12:49 user devstack@n-api.service[62053]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-236067262 Apr 13 17:12:49 user devstack@n-api.service[62053]: X-User: tempest-AttachVolumeNegativeTest-236067262-project-member Apr 13 17:12:49 user devstack@n-api.service[62053]: X-User-Domain-Id: default Apr 13 17:12:49 user devstack@n-api.service[62053]: X-User-Domain-Name: Default Apr 13 17:12:49 user devstack@n-api.service[62053]: X-User-Id: a08b0caad23045c1822cdd0b3ae0769f Apr 13 17:12:49 user devstack@n-api.service[62053]: X-User-Name: tempest-AttachVolumeNegativeTest-236067262-project-member Apr 13 17:12:49 user devstack@n-api.service[62053]: method: > Apr 13 17:12:49 user devstack@n-api.service[62053]: exception: Instance ae339f64-b90f-4399-baa5-1ad1e5051593 could not be found. Apr 13 17:12:49 user devstack@n-api.service[62053]: action_args: {'id': 'ae339f64-b90f-4399-baa5-1ad1e5051593'} Apr 13 17:12:49 user devstack@n-api.service[62053]: {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 17:12:49 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:12:49 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 17:12:49 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 17:12:49 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 17:12:49 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 17:12:49 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 17:12:49 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 17:12:49 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 17:12:49 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 17:12:49 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae339f64-b90f-4399-baa5-1ad1e5051593 could not be found. Apr 13 17:12:49 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 17:12:49 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:12:49 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 17:12:49 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:12:49 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 17:12:49 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 17:12:49 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 17:12:49 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 17:12:49 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 17:12:49 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 17:12:49 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 17:12:49 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 17:12:49 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 17:12:49 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 17:12:49 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 17:12:49 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 17:12:49 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae339f64-b90f-4399-baa5-1ad1e5051593 could not be found. Apr 13 17:12:49 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 17:12:49 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:12:49 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 17:12:49 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:12:49 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 17:12:49 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 17:12:49 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 17:12:49 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 17:12:49 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae339f64-b90f-4399-baa5-1ad1e5051593 could not be found. Apr 13 17:12:49 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 17:12:49 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-eae6167d-bc49-4210-9b45-90a97c2a581f tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Returning 404 to user: Instance ae339f64-b90f-4399-baa5-1ad1e5051593 could not be found. {{(pid=62053) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 17:12:49 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-eae6167d-bc49-4210-9b45-90a97c2a581f tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ae339f64-b90f-4399-baa5-1ad1e5051593" status: 404 len: 111 microversion: 2.1 time: 0.033611 Apr 13 17:12:49 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 391/1168] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:12:49 2023] GET /compute/v2.1/servers/ae339f64-b90f-4399-baa5-1ad1e5051593 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 17:12:49 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-da987c1b-be71-4ad5-8ef3-ab9d77729a59 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:12:49 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-da987c1b-be71-4ad5-8ef3-ab9d77729a59 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: e101522a-965b-43da-9408-07e341a9103a] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:12:49 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-da987c1b-be71-4ad5-8ef3-ab9d77729a59 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:12:49 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-da987c1b-be71-4ad5-8ef3-ab9d77729a59 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:12:49 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-da987c1b-be71-4ad5-8ef3-ab9d77729a59 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:12:49 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-da987c1b-be71-4ad5-8ef3-ab9d77729a59 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:12:49 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-da987c1b-be71-4ad5-8ef3-ab9d77729a59 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:12:49 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-da987c1b-be71-4ad5-8ef3-ab9d77729a59 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:12:49 user devstack@n-api.service[62055]: INFO nova.api.openstack.wsgi [None req-da987c1b-be71-4ad5-8ef3-ab9d77729a59 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] HTTP exception thrown: Instance e101522a-965b-43da-9408-07e341a9103a could not be found. Apr 13 17:12:49 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-da987c1b-be71-4ad5-8ef3-ab9d77729a59 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Request method failure captured: Apr 13 17:12:49 user devstack@n-api.service[62055]: request: DELETE /compute/v2.1/servers/e101522a-965b-43da-9408-07e341a9103a HTTP/1.1 Apr 13 17:12:49 user devstack@n-api.service[62055]: Accept: application/json Apr 13 17:12:49 user devstack@n-api.service[62055]: Accept-Encoding: identity Apr 13 17:12:49 user devstack@n-api.service[62055]: Connection: close Apr 13 17:12:49 user devstack@n-api.service[62055]: Content-Length: 0 Apr 13 17:12:49 user devstack@n-api.service[62055]: Content-Type: application/json Apr 13 17:12:49 user devstack@n-api.service[62055]: Host: 10.0.0.210 Apr 13 17:12:49 user devstack@n-api.service[62055]: Openstack-System-Scope: None Apr 13 17:12:49 user devstack@n-api.service[62055]: User-Agent: python-urllib3/1.26.15 Apr 13 17:12:49 user devstack@n-api.service[62055]: X-Auth-Token: gAAAAABkODTDp_J_kOKBdnfqcv57bez4t7SdSp5UwD5DaWQ0e7zYTV516bQ2tGNSMsgSMmjRAeEnvh6eyS2dpIcxQ87aMcZmL4sydtZG6naQIt5z18MsjMDJtaVZWdqVQVJRdnFvavY9T2LJZWcSrFdkSSE2bAqoVJKrPExVvG6GOh-2JZvqC00 Apr 13 17:12:49 user devstack@n-api.service[62055]: X-Domain-Id: None Apr 13 17:12:49 user devstack@n-api.service[62055]: X-Domain-Name: None Apr 13 17:12:49 user devstack@n-api.service[62055]: X-Identity-Status: Confirmed Apr 13 17:12:49 user devstack@n-api.service[62055]: X-Is-Admin-Project: True Apr 13 17:12:49 user devstack@n-api.service[62055]: X-Project-Domain-Id: default Apr 13 17:12:49 user devstack@n-api.service[62055]: X-Project-Domain-Name: Default Apr 13 17:12:49 user devstack@n-api.service[62055]: X-Project-Id: 097b15faad8249c9bf45623d0c3ab518 Apr 13 17:12:49 user devstack@n-api.service[62055]: X-Project-Name: tempest-AttachVolumeNegativeTest-236067262 Apr 13 17:12:49 user devstack@n-api.service[62055]: X-Role: reader,member Apr 13 17:12:49 user devstack@n-api.service[62055]: X-Roles: reader,member Apr 13 17:12:49 user devstack@n-api.service[62055]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/097b15faad8249c9bf45623d0c3ab518"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/097b15faad8249c9bf45623d0c3ab518"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/097b15faad8249c9bf45623d0c3ab518"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 13 17:12:49 user devstack@n-api.service[62055]: X-Tenant: tempest-AttachVolumeNegativeTest-236067262 Apr 13 17:12:49 user devstack@n-api.service[62055]: X-Tenant-Id: 097b15faad8249c9bf45623d0c3ab518 Apr 13 17:12:49 user devstack@n-api.service[62055]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-236067262 Apr 13 17:12:49 user devstack@n-api.service[62055]: X-User: tempest-AttachVolumeNegativeTest-236067262-project-member Apr 13 17:12:49 user devstack@n-api.service[62055]: X-User-Domain-Id: default Apr 13 17:12:49 user devstack@n-api.service[62055]: X-User-Domain-Name: Default Apr 13 17:12:49 user devstack@n-api.service[62055]: X-User-Id: a08b0caad23045c1822cdd0b3ae0769f Apr 13 17:12:49 user devstack@n-api.service[62055]: X-User-Name: tempest-AttachVolumeNegativeTest-236067262-project-member Apr 13 17:12:49 user devstack@n-api.service[62055]: method: > Apr 13 17:12:49 user devstack@n-api.service[62055]: exception: Instance e101522a-965b-43da-9408-07e341a9103a could not be found. Apr 13 17:12:49 user devstack@n-api.service[62055]: action_args: {'id': 'e101522a-965b-43da-9408-07e341a9103a'} Apr 13 17:12:49 user devstack@n-api.service[62055]: {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 17:12:49 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:12:49 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 17:12:49 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 17:12:49 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 17:12:49 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 17:12:49 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 17:12:49 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 17:12:49 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 17:12:49 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 17:12:49 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e101522a-965b-43da-9408-07e341a9103a could not be found. Apr 13 17:12:49 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 17:12:49 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:12:49 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 17:12:49 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:12:49 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 17:12:49 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 17:12:49 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 17:12:49 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 17:12:49 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 17:12:49 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 17:12:49 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 17:12:49 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 17:12:49 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 17:12:49 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 17:12:49 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 17:12:49 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 17:12:49 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 17:12:49 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 17:12:49 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e101522a-965b-43da-9408-07e341a9103a could not be found. Apr 13 17:12:49 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 17:12:49 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:12:49 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 17:12:49 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:12:49 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 17:12:49 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 17:12:49 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 17:12:49 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 17:12:49 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e101522a-965b-43da-9408-07e341a9103a could not be found. Apr 13 17:12:49 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 17:12:49 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-da987c1b-be71-4ad5-8ef3-ab9d77729a59 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Returning 404 to user: Instance e101522a-965b-43da-9408-07e341a9103a could not be found. {{(pid=62055) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 17:12:49 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-da987c1b-be71-4ad5-8ef3-ab9d77729a59 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e101522a-965b-43da-9408-07e341a9103a" status: 404 len: 111 microversion: 2.1 time: 0.033316 Apr 13 17:12:49 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 389/1169] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 17:12:49 2023] DELETE /compute/v2.1/servers/e101522a-965b-43da-9408-07e341a9103a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 17:12:49 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-997353b0-a623-487d-ba18-d16252758715 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Calling method '>' {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:12:49 user devstack@n-api.service[62054]: DEBUG nova.compute.api [None req-997353b0-a623-487d-ba18-d16252758715 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: e101522a-965b-43da-9408-07e341a9103a] Fetching instance by UUID {{(pid=62054) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:12:49 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-997353b0-a623-487d-ba18-d16252758715 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:12:49 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-997353b0-a623-487d-ba18-d16252758715 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:12:49 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-997353b0-a623-487d-ba18-d16252758715 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:12:49 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-997353b0-a623-487d-ba18-d16252758715 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:12:49 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-997353b0-a623-487d-ba18-d16252758715 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:12:49 user devstack@n-api.service[62054]: DEBUG oslo_concurrency.lockutils [None req-997353b0-a623-487d-ba18-d16252758715 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62054) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:12:49 user devstack@n-api.service[62054]: INFO nova.api.openstack.wsgi [None req-997353b0-a623-487d-ba18-d16252758715 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] HTTP exception thrown: Instance e101522a-965b-43da-9408-07e341a9103a could not be found. Apr 13 17:12:49 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-997353b0-a623-487d-ba18-d16252758715 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Request method failure captured: Apr 13 17:12:49 user devstack@n-api.service[62054]: request: GET /compute/v2.1/servers/e101522a-965b-43da-9408-07e341a9103a HTTP/1.1 Apr 13 17:12:49 user devstack@n-api.service[62054]: Accept: application/json Apr 13 17:12:49 user devstack@n-api.service[62054]: Accept-Encoding: identity Apr 13 17:12:49 user devstack@n-api.service[62054]: Connection: close Apr 13 17:12:49 user devstack@n-api.service[62054]: Content-Length: 0 Apr 13 17:12:49 user devstack@n-api.service[62054]: Content-Type: application/json Apr 13 17:12:49 user devstack@n-api.service[62054]: Host: 10.0.0.210 Apr 13 17:12:49 user devstack@n-api.service[62054]: Openstack-System-Scope: None Apr 13 17:12:49 user devstack@n-api.service[62054]: User-Agent: python-urllib3/1.26.15 Apr 13 17:12:49 user devstack@n-api.service[62054]: X-Auth-Token: gAAAAABkODTDp_J_kOKBdnfqcv57bez4t7SdSp5UwD5DaWQ0e7zYTV516bQ2tGNSMsgSMmjRAeEnvh6eyS2dpIcxQ87aMcZmL4sydtZG6naQIt5z18MsjMDJtaVZWdqVQVJRdnFvavY9T2LJZWcSrFdkSSE2bAqoVJKrPExVvG6GOh-2JZvqC00 Apr 13 17:12:49 user devstack@n-api.service[62054]: X-Domain-Id: None Apr 13 17:12:49 user devstack@n-api.service[62054]: X-Domain-Name: None Apr 13 17:12:49 user devstack@n-api.service[62054]: X-Identity-Status: Confirmed Apr 13 17:12:49 user devstack@n-api.service[62054]: X-Is-Admin-Project: True Apr 13 17:12:49 user devstack@n-api.service[62054]: X-Project-Domain-Id: default Apr 13 17:12:49 user devstack@n-api.service[62054]: X-Project-Domain-Name: Default Apr 13 17:12:49 user devstack@n-api.service[62054]: X-Project-Id: 097b15faad8249c9bf45623d0c3ab518 Apr 13 17:12:49 user devstack@n-api.service[62054]: X-Project-Name: tempest-AttachVolumeNegativeTest-236067262 Apr 13 17:12:49 user devstack@n-api.service[62054]: X-Role: reader,member Apr 13 17:12:49 user devstack@n-api.service[62054]: X-Roles: reader,member Apr 13 17:12:49 user devstack@n-api.service[62054]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/097b15faad8249c9bf45623d0c3ab518"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/097b15faad8249c9bf45623d0c3ab518"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/097b15faad8249c9bf45623d0c3ab518"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 13 17:12:49 user devstack@n-api.service[62054]: X-Tenant: tempest-AttachVolumeNegativeTest-236067262 Apr 13 17:12:49 user devstack@n-api.service[62054]: X-Tenant-Id: 097b15faad8249c9bf45623d0c3ab518 Apr 13 17:12:49 user devstack@n-api.service[62054]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-236067262 Apr 13 17:12:49 user devstack@n-api.service[62054]: X-User: tempest-AttachVolumeNegativeTest-236067262-project-member Apr 13 17:12:49 user devstack@n-api.service[62054]: X-User-Domain-Id: default Apr 13 17:12:49 user devstack@n-api.service[62054]: X-User-Domain-Name: Default Apr 13 17:12:49 user devstack@n-api.service[62054]: X-User-Id: a08b0caad23045c1822cdd0b3ae0769f Apr 13 17:12:49 user devstack@n-api.service[62054]: X-User-Name: tempest-AttachVolumeNegativeTest-236067262-project-member Apr 13 17:12:49 user devstack@n-api.service[62054]: method: > Apr 13 17:12:49 user devstack@n-api.service[62054]: exception: Instance e101522a-965b-43da-9408-07e341a9103a could not be found. Apr 13 17:12:49 user devstack@n-api.service[62054]: action_args: {'id': 'e101522a-965b-43da-9408-07e341a9103a'} Apr 13 17:12:49 user devstack@n-api.service[62054]: {{(pid=62054) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 17:12:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:12:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 17:12:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 17:12:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 17:12:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 17:12:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 17:12:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 17:12:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 17:12:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 17:12:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e101522a-965b-43da-9408-07e341a9103a could not be found. Apr 13 17:12:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 17:12:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:12:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 17:12:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:12:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 17:12:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 17:12:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 17:12:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 17:12:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 17:12:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 17:12:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 17:12:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 17:12:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 17:12:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 17:12:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 17:12:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 17:12:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e101522a-965b-43da-9408-07e341a9103a could not be found. Apr 13 17:12:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 17:12:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:12:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 17:12:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:12:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 17:12:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 17:12:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 17:12:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 17:12:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e101522a-965b-43da-9408-07e341a9103a could not be found. Apr 13 17:12:49 user devstack@n-api.service[62054]: ERROR nova.api.openstack.wsgi Apr 13 17:12:49 user devstack@n-api.service[62054]: DEBUG nova.api.openstack.wsgi [None req-997353b0-a623-487d-ba18-d16252758715 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Returning 404 to user: Instance e101522a-965b-43da-9408-07e341a9103a could not be found. {{(pid=62054) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 17:12:49 user devstack@n-api.service[62054]: INFO nova.api.openstack.requestlog [None req-997353b0-a623-487d-ba18-d16252758715 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e101522a-965b-43da-9408-07e341a9103a" status: 404 len: 111 microversion: 2.1 time: 0.029841 Apr 13 17:12:49 user devstack@n-api.service[62054]: [pid: 62054|app: 0|req: 390/1170] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:12:49 2023] GET /compute/v2.1/servers/e101522a-965b-43da-9408-07e341a9103a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 17:12:52 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-a4e861ce-0350-4f3c-84a1-17783564b2e4 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Calling method '>' {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:12:52 user devstack@n-api.service[62053]: DEBUG nova.compute.api [None req-a4e861ce-0350-4f3c-84a1-17783564b2e4 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c] Fetching instance by UUID {{(pid=62053) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:12:52 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-a4e861ce-0350-4f3c-84a1-17783564b2e4 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:12:52 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-a4e861ce-0350-4f3c-84a1-17783564b2e4 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:12:52 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-a4e861ce-0350-4f3c-84a1-17783564b2e4 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:12:52 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-a4e861ce-0350-4f3c-84a1-17783564b2e4 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:12:52 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-a4e861ce-0350-4f3c-84a1-17783564b2e4 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:12:52 user devstack@n-api.service[62053]: DEBUG oslo_concurrency.lockutils [None req-a4e861ce-0350-4f3c-84a1-17783564b2e4 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62053) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:12:52 user devstack@n-api.service[62053]: INFO nova.api.openstack.wsgi [None req-a4e861ce-0350-4f3c-84a1-17783564b2e4 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] HTTP exception thrown: Instance b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c could not be found. Apr 13 17:12:52 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-a4e861ce-0350-4f3c-84a1-17783564b2e4 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Request method failure captured: Apr 13 17:12:52 user devstack@n-api.service[62053]: request: DELETE /compute/v2.1/servers/b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c HTTP/1.1 Apr 13 17:12:52 user devstack@n-api.service[62053]: Accept: application/json Apr 13 17:12:52 user devstack@n-api.service[62053]: Accept-Encoding: identity Apr 13 17:12:52 user devstack@n-api.service[62053]: Connection: close Apr 13 17:12:52 user devstack@n-api.service[62053]: Content-Length: 0 Apr 13 17:12:52 user devstack@n-api.service[62053]: Content-Type: application/json Apr 13 17:12:52 user devstack@n-api.service[62053]: Host: 10.0.0.210 Apr 13 17:12:52 user devstack@n-api.service[62053]: Openstack-System-Scope: None Apr 13 17:12:52 user devstack@n-api.service[62053]: User-Agent: python-urllib3/1.26.15 Apr 13 17:12:52 user devstack@n-api.service[62053]: X-Auth-Token: gAAAAABkODTDp_J_kOKBdnfqcv57bez4t7SdSp5UwD5DaWQ0e7zYTV516bQ2tGNSMsgSMmjRAeEnvh6eyS2dpIcxQ87aMcZmL4sydtZG6naQIt5z18MsjMDJtaVZWdqVQVJRdnFvavY9T2LJZWcSrFdkSSE2bAqoVJKrPExVvG6GOh-2JZvqC00 Apr 13 17:12:52 user devstack@n-api.service[62053]: X-Domain-Id: None Apr 13 17:12:52 user devstack@n-api.service[62053]: X-Domain-Name: None Apr 13 17:12:52 user devstack@n-api.service[62053]: X-Identity-Status: Confirmed Apr 13 17:12:52 user devstack@n-api.service[62053]: X-Is-Admin-Project: True Apr 13 17:12:52 user devstack@n-api.service[62053]: X-Project-Domain-Id: default Apr 13 17:12:52 user devstack@n-api.service[62053]: X-Project-Domain-Name: Default Apr 13 17:12:52 user devstack@n-api.service[62053]: X-Project-Id: 097b15faad8249c9bf45623d0c3ab518 Apr 13 17:12:52 user devstack@n-api.service[62053]: X-Project-Name: tempest-AttachVolumeNegativeTest-236067262 Apr 13 17:12:52 user devstack@n-api.service[62053]: X-Role: reader,member Apr 13 17:12:52 user devstack@n-api.service[62053]: X-Roles: reader,member Apr 13 17:12:52 user devstack@n-api.service[62053]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/097b15faad8249c9bf45623d0c3ab518"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/097b15faad8249c9bf45623d0c3ab518"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/097b15faad8249c9bf45623d0c3ab518"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 13 17:12:52 user devstack@n-api.service[62053]: X-Tenant: tempest-AttachVolumeNegativeTest-236067262 Apr 13 17:12:52 user devstack@n-api.service[62053]: X-Tenant-Id: 097b15faad8249c9bf45623d0c3ab518 Apr 13 17:12:52 user devstack@n-api.service[62053]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-236067262 Apr 13 17:12:52 user devstack@n-api.service[62053]: X-User: tempest-AttachVolumeNegativeTest-236067262-project-member Apr 13 17:12:52 user devstack@n-api.service[62053]: X-User-Domain-Id: default Apr 13 17:12:52 user devstack@n-api.service[62053]: X-User-Domain-Name: Default Apr 13 17:12:52 user devstack@n-api.service[62053]: X-User-Id: a08b0caad23045c1822cdd0b3ae0769f Apr 13 17:12:52 user devstack@n-api.service[62053]: X-User-Name: tempest-AttachVolumeNegativeTest-236067262-project-member Apr 13 17:12:52 user devstack@n-api.service[62053]: method: > Apr 13 17:12:52 user devstack@n-api.service[62053]: exception: Instance b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c could not be found. Apr 13 17:12:52 user devstack@n-api.service[62053]: action_args: {'id': 'b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c'} Apr 13 17:12:52 user devstack@n-api.service[62053]: {{(pid=62053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 17:12:52 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:12:52 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 17:12:52 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 17:12:52 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 17:12:52 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 17:12:52 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 17:12:52 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 17:12:52 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 17:12:52 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 17:12:52 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c could not be found. Apr 13 17:12:52 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 17:12:52 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:12:52 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 17:12:52 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:12:52 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 17:12:52 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 17:12:52 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 17:12:52 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 17:12:52 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 17:12:52 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 17:12:52 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 17:12:52 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 17:12:52 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 17:12:52 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 17:12:52 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 17:12:52 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 17:12:52 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 17:12:52 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 17:12:52 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c could not be found. Apr 13 17:12:52 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 17:12:52 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:12:52 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 17:12:52 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:12:52 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 17:12:52 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 17:12:52 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 17:12:52 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 17:12:52 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c could not be found. Apr 13 17:12:52 user devstack@n-api.service[62053]: ERROR nova.api.openstack.wsgi Apr 13 17:12:52 user devstack@n-api.service[62053]: DEBUG nova.api.openstack.wsgi [None req-a4e861ce-0350-4f3c-84a1-17783564b2e4 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Returning 404 to user: Instance b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c could not be found. {{(pid=62053) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 17:12:52 user devstack@n-api.service[62053]: INFO nova.api.openstack.requestlog [None req-a4e861ce-0350-4f3c-84a1-17783564b2e4 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c" status: 404 len: 111 microversion: 2.1 time: 0.047376 Apr 13 17:12:52 user devstack@n-api.service[62053]: [pid: 62053|app: 0|req: 392/1171] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 17:12:52 2023] DELETE /compute/v2.1/servers/b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 17:12:52 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-9e716b19-10c5-4737-af40-5ed4bf7bb01f tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Calling method '>' {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 17:12:52 user devstack@n-api.service[62055]: DEBUG nova.compute.api [None req-9e716b19-10c5-4737-af40-5ed4bf7bb01f tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c] Fetching instance by UUID {{(pid=62055) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 17:12:52 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-9e716b19-10c5-4737-af40-5ed4bf7bb01f tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:12:52 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-9e716b19-10c5-4737-af40-5ed4bf7bb01f tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:12:52 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-9e716b19-10c5-4737-af40-5ed4bf7bb01f tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:12:52 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-9e716b19-10c5-4737-af40-5ed4bf7bb01f tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 17:12:52 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-9e716b19-10c5-4737-af40-5ed4bf7bb01f tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 17:12:52 user devstack@n-api.service[62055]: DEBUG oslo_concurrency.lockutils [None req-9e716b19-10c5-4737-af40-5ed4bf7bb01f tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "32d212d5-26fb-41ef-bcfb-e4b208444da1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=62055) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 17:12:52 user devstack@n-api.service[62055]: INFO nova.api.openstack.wsgi [None req-9e716b19-10c5-4737-af40-5ed4bf7bb01f tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] HTTP exception thrown: Instance b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c could not be found. Apr 13 17:12:52 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-9e716b19-10c5-4737-af40-5ed4bf7bb01f tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Request method failure captured: Apr 13 17:12:52 user devstack@n-api.service[62055]: request: GET /compute/v2.1/servers/b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c HTTP/1.1 Apr 13 17:12:52 user devstack@n-api.service[62055]: Accept: application/json Apr 13 17:12:52 user devstack@n-api.service[62055]: Accept-Encoding: identity Apr 13 17:12:52 user devstack@n-api.service[62055]: Connection: close Apr 13 17:12:52 user devstack@n-api.service[62055]: Content-Length: 0 Apr 13 17:12:52 user devstack@n-api.service[62055]: Content-Type: application/json Apr 13 17:12:52 user devstack@n-api.service[62055]: Host: 10.0.0.210 Apr 13 17:12:52 user devstack@n-api.service[62055]: Openstack-System-Scope: None Apr 13 17:12:52 user devstack@n-api.service[62055]: User-Agent: python-urllib3/1.26.15 Apr 13 17:12:52 user devstack@n-api.service[62055]: X-Auth-Token: gAAAAABkODTDp_J_kOKBdnfqcv57bez4t7SdSp5UwD5DaWQ0e7zYTV516bQ2tGNSMsgSMmjRAeEnvh6eyS2dpIcxQ87aMcZmL4sydtZG6naQIt5z18MsjMDJtaVZWdqVQVJRdnFvavY9T2LJZWcSrFdkSSE2bAqoVJKrPExVvG6GOh-2JZvqC00 Apr 13 17:12:52 user devstack@n-api.service[62055]: X-Domain-Id: None Apr 13 17:12:52 user devstack@n-api.service[62055]: X-Domain-Name: None Apr 13 17:12:52 user devstack@n-api.service[62055]: X-Identity-Status: Confirmed Apr 13 17:12:52 user devstack@n-api.service[62055]: X-Is-Admin-Project: True Apr 13 17:12:52 user devstack@n-api.service[62055]: X-Project-Domain-Id: default Apr 13 17:12:52 user devstack@n-api.service[62055]: X-Project-Domain-Name: Default Apr 13 17:12:52 user devstack@n-api.service[62055]: X-Project-Id: 097b15faad8249c9bf45623d0c3ab518 Apr 13 17:12:52 user devstack@n-api.service[62055]: X-Project-Name: tempest-AttachVolumeNegativeTest-236067262 Apr 13 17:12:52 user devstack@n-api.service[62055]: X-Role: reader,member Apr 13 17:12:52 user devstack@n-api.service[62055]: X-Roles: reader,member Apr 13 17:12:52 user devstack@n-api.service[62055]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/097b15faad8249c9bf45623d0c3ab518"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/097b15faad8249c9bf45623d0c3ab518"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/097b15faad8249c9bf45623d0c3ab518"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 13 17:12:52 user devstack@n-api.service[62055]: X-Tenant: tempest-AttachVolumeNegativeTest-236067262 Apr 13 17:12:52 user devstack@n-api.service[62055]: X-Tenant-Id: 097b15faad8249c9bf45623d0c3ab518 Apr 13 17:12:52 user devstack@n-api.service[62055]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-236067262 Apr 13 17:12:52 user devstack@n-api.service[62055]: X-User: tempest-AttachVolumeNegativeTest-236067262-project-member Apr 13 17:12:52 user devstack@n-api.service[62055]: X-User-Domain-Id: default Apr 13 17:12:52 user devstack@n-api.service[62055]: X-User-Domain-Name: Default Apr 13 17:12:52 user devstack@n-api.service[62055]: X-User-Id: a08b0caad23045c1822cdd0b3ae0769f Apr 13 17:12:52 user devstack@n-api.service[62055]: X-User-Name: tempest-AttachVolumeNegativeTest-236067262-project-member Apr 13 17:12:52 user devstack@n-api.service[62055]: method: > Apr 13 17:12:52 user devstack@n-api.service[62055]: exception: Instance b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c could not be found. Apr 13 17:12:52 user devstack@n-api.service[62055]: action_args: {'id': 'b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c'} Apr 13 17:12:52 user devstack@n-api.service[62055]: {{(pid=62055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 17:12:52 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:12:52 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 17:12:52 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 17:12:52 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 17:12:52 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 17:12:52 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 17:12:52 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 17:12:52 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 17:12:52 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 17:12:52 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c could not be found. Apr 13 17:12:52 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 17:12:52 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:12:52 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 17:12:52 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:12:52 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 17:12:52 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 17:12:52 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 17:12:52 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 17:12:52 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 17:12:52 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 17:12:52 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 17:12:52 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 17:12:52 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 17:12:52 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 17:12:52 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 17:12:52 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 17:12:52 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c could not be found. Apr 13 17:12:52 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 17:12:52 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 17:12:52 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 17:12:52 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 17:12:52 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 17:12:52 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 17:12:52 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 17:12:52 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 17:12:52 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c could not be found. Apr 13 17:12:52 user devstack@n-api.service[62055]: ERROR nova.api.openstack.wsgi Apr 13 17:12:52 user devstack@n-api.service[62055]: DEBUG nova.api.openstack.wsgi [None req-9e716b19-10c5-4737-af40-5ed4bf7bb01f tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Returning 404 to user: Instance b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c could not be found. {{(pid=62055) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 17:12:52 user devstack@n-api.service[62055]: INFO nova.api.openstack.requestlog [None req-9e716b19-10c5-4737-af40-5ed4bf7bb01f tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c" status: 404 len: 111 microversion: 2.1 time: 0.040913 Apr 13 17:12:52 user devstack@n-api.service[62055]: [pid: 62055|app: 0|req: 390/1172] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 17:12:52 2023] GET /compute/v2.1/servers/b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0)